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In This Issue 


Dear Readers, 


I would like to share with you good news on two fronts. First, the upcoming December issue will 
mark the 25" anniversary of Survey Methodology. This issue of the journal will be slightly larger 
than usual and will contain papers from some very prominent statisticians of our time. Second, we 
are looking into producing an electronic version of the Journal. Our current plan is to make the 
December 1999 issue available on a special Web site. All current subscribers will be able to 
download the Journal free of charge. Based on the response to this trial we will see if it is feasible 
to offer the Journal in that medium instead of or in addition to the current paper version . Watch for 
further information in the next issue. As usual your comments and suggestions are always welcome. 

This issue covers a variety of topics - three papers on small area estimation, four papers on 
general estimation issues and two each on new sampling designs and data analysis. 

Kroger, Sarndal and Teikari they introduce a new family of sampling designs, called Poisson 
Mixture Sampling, which comprises of a weighted mixture of Poisson and Bernoulli sampling. 
Through a Monte Carlo study using Finnish data, they empirically show that, for a variety of point 
estimators, Poisson Mixture Sampling is more efficient than the usual Poisson sampling. 

Bell and Kramer deal with the long standing problem of estimating the variance of X-11 
estimators. Each month, statistical bureaus throughout the world publish the raw estimates of 
variables along with a corresponding measure of error, usually a standard error or a coefficient of 
variation. However, the corresponding seasonally adjusted or trend estimates, obtained by 
application of the X-11 method, do not have such an associated measure of error. Bell and Kramer 
present an interesting approach that offers a practical solution to this problem. They calculate two 
sources of error: one resulting from the sampling error and the other resulting from the use of 
ARIMA extrapolations at the two ends of the series. 

De Haan, Opperdoes and Schut discuss sampling the items in a commodity group for input to the 
Consumer Price Index using scanner data. While most statistical offices currently use a judgmental 
selection procedure, this naturally leads to biased estimates. The authors address the question of 
whether probability sampling would lead to better results in terms of mean square error, with 
interesting results. 

Pierre Duchesne considers a new class of robust calibration estimators used to obtain constrained 
weights at given intervals. The process involves changing carefully selected robust default weights 
into calibrated weights. In a brief empirical study, the new estimators are illustrated and compared 
to estimators which have already been proposed. 

Tillé investigates a repeated sampling approach which takes into account auxiliary information. 
First he generalizes the use of conditional inclusion probabilities for use with any sampling design. 
He then constructs estimators that can be viewed as optimal linear estimators, and compares them 
with the GREG-estimator. He contrasts all of the estimators via a set of simulations. Finally he 
discusses the problem of interaction between the design and the auxiliary variables. 

Prasad and Rao consider the problem of small area estimation through the use of a random 
effects model. While traditional methods rely on model-based methods to obtain estimates of small 
area means, Prasad and Rao obtain design-based (model-assisted) estimates by integrating survey 
weights. Corresponding model-based estimators of the mean squared errors (MSE) of the small area 
estimates are also derived. Through simulation results, they show that their MSE estimator has low 
bias and is quite stable. 

In their paper on small area estimation, Moura and Holt focus on multilevel models, which make 
use of auxiliary information at both the unit and the small area levels, and allow small area random 
effects for both the intercepts and the regression slopes. The fixed and random effects parameters 
are estimated using restricted iterative generalized least squares. The mean square error is 
approximated. Simulations show that the model can lead to better small area estimators than those 
based on simpler models, that overspecification of the model does not lead to a serious loss of 
efficiency, and that the MSE approximation and associated MSE estimator work well. 


In This Issue 


Chattopadhyay, Lahiri, Larsen and Reimnitz consider estimation of proportions for rare events 
in small areas. Their method is illustrated and compared to other approaches using data from a 
telephone survey of alcohol and drug use. Their proposed estimator combines 
census-based demographic estimates of population within age/sex/county groups with survey-based 
empirical Bayes estimates of proportions within those groups. A jackknife estimator of mean square 
error is proposed which captures variability due to estimation of model parameters. 

The problem of estimating longitudinal low income proportions from a longitudinal survey having 
a complex design is studied in Rubin-Bleuer and Kovacevic. Two design-based estimators are 
considered: one based on both the longitudinal and cross-sectional sample, called the “mixed 
estimator”, and one based entirely on the longitudinal sample. Through simulation, the two 
estimators are compared in the presence of attrition using models of compensation that assume 
“missing at random” and “completely missing at random” underlying mechanisms. The results are 
illustrated using data from two longitudinal sueveys. 

Tate considers linking data on the same individuals from subsequent quarters of the British 
Labour Force Survey, a rotating panel survey in which one fifth of the sample is renewed at each 
occasion. She analyzes the various factors which can introduce bias into analyses derived from such 
linked data. In particular, she studies the possible effects of sample attrition, respondent errors and 
proxy respondents. She also considers various approaches to adjusting for these biases. 

Finally, in a short note, Gabler, Haeder and Lahiri present a model-based justification for Kish’s 
well known formula for design effects. They show that the result is actually a conservative value 
for the actual design effect. 


The Editor 
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Poisson Mixture Sampling: A Family of Designs for 
Coordinated Selection Using Permanent Random Numbers 


HANNU KROGER, CARL-ERIK SARNDAL and ISMO TEIKARI! 


ABSTRACT 


This paper introduces Poisson Mixture sampling, a family of sampling designs so named because each member of the family 
is a mixture of two Poisson sampling designs, Poisson mps sampling and Bernoulli sampling. These two designs are at 
opposite ends of a continuous spectrum, indexed by a continuous parameter. Poisson Mixture sampling is conceived for 
use with the highly skewed populations often arising in business surveys. It gives the statistician a range of different options 
for the extent of the sample coordination and the control of response burden. Some Poisson Mixture sampling designs give 
considerably more precise estimates than the usual Poisson mps sampling. This result is noteworthy, because Poisson mps 
is in itself highly efficient, assuming it is based on a strong measure of size. 


KEY WORDS: Business surveys; Skewed populations; Response burden; Regression estimators. 


1. THE OBJECTIVES OF POISSON 
MIXTURE SAMPLING 


Poisson Mixture (Pomix) sampling is a family of 
sampling designs suitable for business surveys with its often 
highly skewed populations. The Pomix family contains the 
traditional Bernoulli sampling and Poisson mps sampling 
designs as two special cases, situated at the two extremes of 
a range of possibilities indexed by a continuous parameter. 
This parameter, called the Bernoulli width and denoted B, 
satisfies 0 < B < fp, where f, is the predetermined expected 
sampling fraction in the “take-some” portion of the popu- 
lation, that is, the portion where randomized selection is 
applied. 

Random numbers, in the form of independent realiza- 
tions of the Unif (0,1) random variable, are commonly used 
in modern computerized sample selection. Fan, Muller and 
Rezucha (1962) introduced several sequential (unit by unit) 
drawing mechanisms based on random numbers. Now, 
Pomix sampling is based on the Permanent Random 
Number (PRN) technique, which calls for assigning at birth 
a random number to each unit in the frame (the business 
register, in the case of a business survey). The random 
number is permanent in the sense of remaining attached to 
the unit during its entire lifetime. The PRN technique 
makes it easy to achieve coordination of samples and 
control of response burden. Early references to sampling 
with the aid of PRN’s are Brewer, Early and Joyce (1972) 
and Atmer, Thulin and Backlund (1975). A recent review 
of different PRN techniques, and important extensions, are 
given in Ohlsson (1995). 

Poisson maps sampling has the desirable feature of 
selecting large units with relatively greater probability than 
small units, whose contribution to estimated population 
totals will in any case be relatively minor. Coordination of 


Poisson mps samples with the aid of PRN’s was introduced 
by Brewer et al., (1972) and is discussed subsequently by 
several authors, including Sunter (1977) and Ohlsson 
(1995); 

Similarly as in Poisson mps, Pomix sampling allows 
control of the response burden, as explained in the next 
section. Larger enterprises will be selected relatively more 
often than smaller ones. The selection is controlled through 
rotation so as to distribute the response burden. Another 
objective of Pomix sampling is for all (or a substantial 
portion) of the population units to be included in sample 
(therefore observed, so that their basic data can be updated) 
with regularity over a period of time. The objective can be, 
for example, that every enterprise should be in sample at 
least once during a ten or twelve year period. 


2. THE SELECTION PROCEDURE UNDER 
POISSON MIXTURE SAMPLING 


Denote the finite population as U = {1,...,k,..., N}, 
where the integer k represents the k-th population unit. 
Denote by y the variable of interest and by y, its value for 
unit k; y, is unknown before sample selection and 
observation. With the unit k € U is also associated a known 
positive size measure x,. Its role in Pomix sampling is to 
bring about a more frequent selection of the larger units; in 
addition, the size variable should be used as an auxiliary 
variable at the estimation stage. 

A sample, s, is realized from the population U. The size 
of s may be random; its expected size, denoted n, is a 
number fixed in advance. We allow s to consist of two 
nonoverlapping parts, s = 5,.USp, where 5S, is called the 
certainty part of s and s, the randomization part of s. The 
part s., consisting of very large units selected with 
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probability one, is designated in a preliminary step, with the 
aid of the known size measures x,. One procedure for this 
is given in section 3. Depending on the population charac- 
teristics, it could happen that no certainty part is designated, 
so that s,. is the empty set, but this eventuality is rather 
exceptional with the highly skewed populations usually 
occurring in business surveys. 

A frequently used synonymous term for the certainty part 
is take-all stratum. If the take-all stratum is denoted U,, a 
probabilistic description is to say that s,. is drawn from the 
take-all stratum U; so that s,. = U; with probability one. 
We denote the size of s. = U, by ne. 

Next, the randomization sample, 5p, is selected from the 
rest of the population, U, = U - U;, of size Np =N - ne. 
It consists of units with inclusion probability 2, strictly less 
than unity. In this paper, s, is drawn by Pomix sampling 
(thus it uses the PRN technique). The size of s 4 is random; 
its expected size, denoted np, is fixed by the equation 
Niet 

In this paper, we use the term Poisson sampling for 
selection corresponding to independent unit by unit 
Bernoulli trials with any inclusion probabilities 2,. More 
specifically, by Poisson mps we mean Poisson sampling 
with 1, directly proportional to a measure of size. Bernoulli 
sampling is the special case of Poisson sampling where all 
7, are equal. 

For Pomix sampling, we need some more notation. For 
unit ke U Fe define the relative size measure 


A, = indy DA ad & 


We can from now on assume that A el forall ke U Ai 
because if A — 1 had not been true for certain units ke U 2 
then the procedure in section 3 for constructing the certainty 
part of the sample would in effect have assigned those units 
to the certainty part 5... 

We now define Pomix sampling with the aid of a two- 
dimensional diagram. On the horizontal axis, a unit’s PRN 
is plotted. On the vertical axis, a size-related measure, Q He 
is plotted. At each survey occasion, a new sampling selec- 
tion region is designated by rotation in this diagram, and 
sample coordination is realized in the manner that we now 
describe. 

Pomix sampling is characterized by two parameters, B 
and f,, where f, such that 0<f, =n,/N,<1 denotes the 
fixed expected sampling rate in Up; = U-U,._ The para- 
meter B, called the Bernoulli width, is such that 0 < B < fp. 
For every unit ke U oe define 


R 


(2.1) 


(2.2) 


where er po Ne For B=0, we have Q, =A,, 
which is the size measure for the usual Poisson mps sam- 
pling. At the other extreme, B = f,, we have Q, = 0 for all 
keU,,; in this case, size will play no role in the selection 
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from U pe which will be seen to reduce to Bernoulli 
sampling. The measures Q, are used in Pomix selection of 
coordinated samples, as we now describe. 

Start with a plot of the points (r,, Q,) for k € U,, where 
r, denotes the PRN attached at birth to unit k, and Q, is 
given by (2.2). With reference to Figure 1, Pomix sampling 
is defined as follows: Include in the randomization sample, s pe 
all units having PRN’s r, falling in the (0, B] interval, and 
also include some units having PRN’s r, in the (B, 1] 
interval, namely, those for which Q, is at least equal to a 
threshold value situated on the line joining the points (B, 0) 
and (1, 1). The selection area is thus the shaded part of 
Figure 1. Note that since A .< 1 forall ke U p> we have by 
(2.2) that Q,< (1 - B/f,)/(1 - B) <1 forall ke U,, when 
O0<B<fh. 

For Poisson mps sampling, the inclusion probability of 
unit kis 2, = A, given by (2.1). Coordination of PRN-based 
Poisson samples was introduced by Brewer et al., (1972) 
using a graphical representation corresponding to B = 0 in 
Figures 1 and 2. At each occasion, the selection area is then 
a triangle; the unit’s PRN on the horizontal axis is plotted 
against the unit’s size measure, A,, on the vertical axis. 
Coordination is obtained by “moving the selection area 
over” to the right. Coordination of Pomix samples is 
realized in a similar fashion. 


5 4 : DB 1 r 


Fig 1. Sampling at time 1 Fig 2. Sampling at time 2 


Figures | and 2 illustrate how coordinated Pomix sam- 
pling from U, = U - U;, can be carried out at two consec- 
utive survey occasions. In each of the two figures, the 
sample is defined as the set of units for which the point 
(r,, Q,) falls in the shaded area. The “starting point” on the 
PRN axis is the point to the right of which we start to count 
units for inclusion in the sample. At time | (Figure 1), the 
starting point is 0; at time 2 (Figure 2), the starting point is 
D. (In general, the starting point can be a randomly selected 
point in the unit interval; in other words, the sample iden- 
tified in Figure 2 is also the one that would be selected at 
time ¢=1 if at that time the randomly selected starting 
point on the PRN axis had been equal to D.) 

A convenient way to achieve sample rotation is through 
the constant shift method, which implies that the starting 
point is moved over to the right by a fixed amount at every 
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new occasion of sampling; see Ohlsson (1995). The con- 
stant D is called the constant shift. The starting point at time 
3 would thus be 2D, and so on. 

In the following we examine Pomix sampling and esti- 
mation at a single occasion, and we can concentrate on 
Figure | (time 1), with starting point 0 on the PRN axis. 
The algorithm for Pomix sampling with parameters B and 
Tee and starting point 0, is thus as follows: From Figure 1, 
unit k is included in the randomization part, s,, (i) if 
U-7, a8, orm B <7, <and 0,2 (7,-B)/ (1 -B). 

Consequently, k is included in s, if 


O<r,<B+Q,(1-B). 


Because r, ~ Unif (0,1), the first order inclusion probabili- 


ties under Pomix sampling are 


(2:3) 


B+Q,( -B) for ke U, 
as 8 for ke Ug. 


It is easy to see that the inclusion probabilities satisfy the 
necessary requirement that their sum must equal the 
expected sample size fixed in advance: 


De Ty, = Die I Qi {B+O,(1 - B)} SC ae: 


We now note two extreme cases of the family of Pomix 
sampling schemes: Bernoulli sampling is obtained if B = f, 
in the Pomix algorithm, because then Q < O forallke U ne 
and the algorithm becomes: Include unit k € U, in sp if 
O<r,<f,, which is Bernoulli sampling. Poisson amps 
sampling is obtained if B =O in the Pomix algorithm, 
because then the algorithm becomes: Include unit k € U, 
in Sp if O<r,<A,, where A, is given by (2.1). But this is 
Poisson mps sampling from U,,, the inclusion probability 
being 2, =A,, that is, directly proportional to the size 
measure X,. 

Pomix sampling is a mixture of Poisson mps and 
Bernoulli in that the Pomix inclusion probability, 
nm, = B+Q,(1 - B), equals a linear combination of the 
inclusion probabilities that apply under the two extreme 
designs, weighted by the relative Bernoulli width, A = Bij ae 
ae O<A< 1. Wehave x, =) *+(1 -A)av*, where 

=f, for all k (Bernoulli) and Fie = A, (Poisson mps). 

Serie character of Pomix sampling is deemed by its 
two parameters, B and ips To illustrate, we note from (2.1) 
and (2.3) that the inclusion probability of unit ke U, is 
m, =B+(1 - B/f,)A,. Thus, fora unit k that is large (but 
not large enough to qualify for s.. = U,), so that A, is near 
unity, we have, to close approximation, 1, = B + 1 - B/fp. 
By contrast, for a unit that is small, so that its value A j is 
very near zero, we have, to close approximation, 7, = B, 
independently of the size. For example, with f, = 10%, the 
following Table 1 shows how the inclusion probability 1, 
varies with B, where B=0 is Poisson maps, and 
B =f, = 0.10 is Bernoulli. 


k? 


Table 1 
Values of the Inclusion Probability 2, as a Function 
of the Parameter B and the Relative Size A, 
When the Fixed Expected Sampling Rate, f,, is 0.1 


Values of 7, 


Value of B 0 0.03 0.05 0.07 0.10 
A, =0(small unit) 0 003501055" 0:07 010 
A, = | (large unit) 1 OF/3 505 ae 60:37 010 


This illustrates that for a Pomix sampling design close to 
Bernoulli (B near 0.10), the inclusion probabilities of large 
and small units alike lie near the fixed expected sampling 
rate, 0.10. By contrast, in a Pomix design close to Poisson 
mps (B near 0), a small unit is practically certain not to be in 
sample, and a large unit is practically sure to be in sample. 
The table also illustrates how Pomix sampling with an inter- 
mediate value of B will modify the inclusion probabilities: 
a small unit’s chances to appear in the sample are decreased 
somewhat compared to Bernoulli, and the selection of a 
large unit becomes less probable than under Poisson aps. 

The implications for response burden are: The total 
response burden on the population rests the same for all 
values of B; an expected total of n=n, +n c units are 
always asked to report. Compared to Poisson aps (B = 0), 
the fixing of a value B in the interior of the interval [0, f,] 
will have the effect of shifting some of the response burden 
from larger onto smaller units; at the same time the preci- 
sion of the estimates is increased in many cases (see 
sections 5 and 6). 

Finally, we need to mention the second order inclusion 
probabilities under Pomix sampling, because they are 
required for the design-based variance calculation. They are 
simple. If ,, denotes the probability that units k and/ are 
both in the sample, then 


Big (2.4) 


for keleU=Ulu Ue because the PRN’s r, are 
independent realizations of the Unif(0,1) random variable. 
For k = 1, we have 1,, = 1, =, The multiplicative feature 
(2.4) of the 2,, greatly simplifies the design-based variance 
calculation. We get a simple, single-sum variance estimator, 
as in (4.2) below. 


3. DETERMINING THE CERTAINTY 
PART OF THE SAMPLE 


If the population is highly skewed, a set of units (the 
certainty part of the sample, s,) will be sampled with 
probability one, and Pomix sampling can be used for 
randomized selection in the remaining part of the popula- 
tion, U Py Several procedures could be considered for the 
construction of the certainty set; here we give one that is 
reasonable (though not necessarily optimal) and used in the 


Monte Carlo simulation reported later in section 5. The 
certainty set is designated with the aid of the known posi- 
tive size measures x, through the following procedure in 
one or more steps. An expected sample size, n, is fixed for 
the whole sample, s =s,U5,. In step one, compute the 
relative size measures A,,. = nx,/)', x, for k € U. Those 
units k, if any, for which A,,) 21 are assigned to the 
certainty part. They form a set lees U_q); let its size be 
Nc): The procedure is then repeated to see if additional 
units should be assigned to the certainty part. In step two, 
calculate the relative size measures A,, K(2) =(n- Nea) 

x,/Yx, Where the summation extends over the set 
U - Uea- If Aya) <1 forall ke U - U a), the procedure 
stops, and the final certainty part is 5, = Vea: But if 
Aya 2 1 for some units, then these are also cnn to the 
certainty part, and so on until a step is reached where all 
intermediate relative size measures A, are less than unity. 
The ultimate certainty part s,, will contain, say, n_ units, 
and we then have A,< 1 for all keU- Sc, Where 
A, =Npx,/) x, with np =n — n¢, and the sum extends over 
Us se 


4. ESTIMATION FOLLOWING POMIX 
SAMPLING 


Although the auxiliary variable serves a useful purpose 
at the sampling stage, we advocate using it also at the esti- 
mation stage. To estimate the population total, Y = ve 
consider the generalized regression (GREG) estimator 


Y GREG =). By Ey Vy (4.1) 


where a, = 1/m, is the sampling weight and the second 
weight, the g-weight, is given by 


FeO Sp O)0 Wes fer 


where x, denotes the auxiliary vector value for unit k, 
X=)'.a,x,, and T,=)) a,x,x,/c,. The auxiliary infor- 
mation requirement is that the vector total X = )’,,x, must 
be known from a reliable source. The unidimensional size 
variable x, used for computing the Q, in the Pomix 
sampling scheme can be one of the components of x, or it 
can a linear combination of the components of x,. In the 
empirical study reported in section 5, x, is unidimensional, 
and 2, gr The constants Goss specified by the user, 
provide a means of weighing the data, in addition to the 
survey weights a,. An often used choice is c, = 1 for all k. 

A commonly used estimator of the variance of the 
GREG estimator (see Sarndal, Swensson and Wretman 
1992, Ch. 6) is given as a quadratic form in g,e,, where e, 
is the regression — residual €, =); ae, b, where 
b = Te "ya a,x,y,/c,. One of the advantages of Pomix 
sampling is that the corresponding variance estimation is 
simple. This is because the PRN’s r, are independent 
realizations from the Unif(0,1) distribution. Hence equation 
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(2.4) applies, and all product terms of the quadratic form 
are zero. With only the squared terms left, the variance 
estimator becomes simply V = )’.a,(a, ~ 1)g, ee Finally, 
because a,-1=0 for all kKeEs,, we get the variance 
estimator used in the Monte Carlo study reported later in 
section 5, namely, 


Vy), a(4,- 1g, e,- (4.2) 


5. A MONTE CARLO STUDY OF POMIX 
SAMPLING USING FINNISH DATA 


To illustrate various aspects of Pomix sampling, we 
conducted a Monte Carlo study involving four different 
estimators of the population total Y. The experiment 
involved repeated draws of samples as well as repeated 
assignments of the set of N PRN’s to the population units. 
Note that since every assignment of the N PRN’s to the 
population units is a random outcome, a proper Monte 
Carlo study also requires repetitions of the PRN assign- 
ments. Therefore, after the first assignment of the N 
PRN’s, we selected 100 Pomix samples, using a fixed 
value of the Bernoulli width B. (Each sample was realized 
using a new, randomly selected starting point on the PRN 
axis). Then a new set of N PRN’s were assigned, 100 
additional samples were drawn, and so on, until we had 
reached 100 x 100 = 10,000 PRN/sample pairs, for the 
given value of B. For each of the 10,000 pairs, we 
computed the four point estimators, the corresponding four 
variance estimators, and the corresponding four confidence 
intervals. With 10,000 repetitions, we expect the Monte 
Carlo error to be rather small. 

The four estimators used in the Monte Carlo study have 
the following expressions, where a, = 1/7, is the sampling 
weight of unit k, and 7, is given by (2.3): 


1. The Horvitz-Thompson estimator, 
Y=), 4D yo vie Dee Ay Va: 
2. The (combined) ratio estimator, 
Yoaeub. 


where IX =) ve andaai=) nays) 
special case of (4.1) such that x, =x 


a,X,: It is a 
pa Ce 


3. The GREG estimator 


Y; = De baa ee Pd bX. 7 poe a,.,) 
where X, = Lu *k and b, = dla aia, = Lyi Da 
haa - ee It’ i a epee case of (4.1) such that 


(dy. 


2 , and CG 
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4. The (separate) ratio estimator, 
Lae Date Vy + Xb, 


where X, = Lupe and b, = yg tk Yi Ls e te Bae 


For Poisson mps sampling (B = 0), we have b, = 
OER n, » where n, is the random size of sp; the 
corresponding estimator Y, was considered by Brewer 
et al., (1972). Now Ves and Y, differ in that the regression 
slope is calculated in Y, on the pooled sample s, but in Ye 
the slope is calculated separately for the randomization 
sample sp. Finally, Y, differs from Y, and Y, in that it 
uses the weighting a,(a, - 1), instead of just a,. Note that 
all of Y,, and Y; and Y, are members of the GREG family 
of estimators given by (a. 1). By equating Y,, Y, and Ys to 
(4.1), we find the g-weights implied by ech a the ines 
estimators. These weights are required for the variance 
estimation. We can expect the simulation to show that Ve Ys 
and he which use the auxiliary variable both at the Besien 
stage ‘and at the estimation stage, will improve on (have 
smaller variance than) the HT estimator Y » which uses the 
auxiliary information only at the sampling stage, but the 
extent of the improvement is unpredictable and interesting 
to observe. 

We used a real data population for the Monte Carlo 
simulation. This population consists of N = 1,000 Finnish 
enterprises. For enterprise k, k = 1, ..., 1,000, y, is number 
of employees (full time equivalents) x 10, and x, is the 
wages paid by the enterprise to its employees, in thousands 
of FIM (Finnish Marks). The auxiliary information (wages 
paid) comes from the Finnish tax authority’s VAT register. 
The employment variable is the one requiring estimation. 
The 1,000 units were selected (in an essentially random 
manner) from an original larger population of Finnish 
enterprises. Units with a value of zero either on y, or on x, 
were eliminated so that the simulation results would not be 
disturbed by extraneous factors. Consequently, as for the 
values y, and x,, the population used in the simulation is 
a natural one, but because of the elimination of units, its 
features (mean, standard deviation, skewness, etc.) differ 
from those of the original larger population. 

The population y-total to be estimated is Y =)’, y, = 
169,168. We fixed the expected sample size for the total 
sample, s = ScUSp, ash = 100. The procedure described 
in section 3 was used to determine the certainty part s,. of 
the sample. This resulted in a certainty part s,, consisting 
of the largest 29 = n, units. The rest of the population, 
U, = U - s_ has the following descriptive characteristics: 
Its size is N, = 1,000 - 29 = 971; the total of yis Y, = 
46,138 (which equals 27% of the entire population total Y 
= 169,168); the coefficient of variation (standard deviation 


divided by mean) is 1.78 for the variable y and 1.94 for 
the variable x; the coefficient of correlation between x and 
yis 0.965. The randomization part s,, of expected size np 
= 100 - 29 = 71 units, is realized, in the simulation, by 
repeated Pomix sample selection from U,. A plot of 
(x,,y,) for the units k in U, is shown in the Appendix. 

To see the effect of the Bernoulli width, we carried out 
the simulation for a range of different B-values: B = 0, 0.01, 
.. 0.07, and, in addition, B = f, = np/N, = 71/971 = 0.073 
(which gives Bernoulli). For each value of B, 100 x 100 = 
10,000 PRN/sample pairs were realized, and the results 
were used to calculate, for each of the four point estimators, 
five Monte Carlo summary statistics. These are as follows, 
if Y denotes one of the four point estimators, V the corre- 
sponding variance estimator obtained from (4.2), and 
(Y- an, ay V, Yaz, es V) the corresponding confidence 
interval for Y at the rome! confidence level 1- a, where 
2; -g/2 18 the standard normal score, z, _,/. = 1.960 for 
Ose 57, and: z, 24), — 14645 for.a;= 10%: 


(1) MCEY = the Monte Carlo expectation of the point 
estimator Y, that is, the arithmetic mean of the 10,000 
point estimates; 


(2) MCV Y = the Monte Carlo variance of the point 
estimator Y, that is, the variance of the 10,000 point 
estimates; 


(3) MCE V= the Monte Carlo expectation of the variance 
estimator V, that is, the arithmetic mean of the 10,000 
variance estimates; 


(4) MCRTE95 = Monte Carlo coverage rate for nominal 
95% confidence intervals, that is, the number of times 
that the target parameter Y is contained in the 
confidence interval, divided by 10,000, and expressed 
in per cent; 


(5) MCRTE90 = Monte Carlo coverage rate for nominal 
90% confidence intervals; its definition is analogous to 
that of MCRTE95. 


The simulation results are shown in Table 2 (Average 
sample size, Monte Carlo variance; Monte Carlo expecta- 
tion of variance estimator) and in Table 3 (Monte Carlo 
coverage rates). The tables do not show MCEY, because 
in all cases this quantity was very close to the target para- 
meter value Y = 169,168, confirming that all estimators are 
essentially unbiased. The deviation of MCE Y from Y was 
in all cases less than 0.14%, in most cases considerably 
less. The average sample size over the 10,000 repetitions is 
seen to be very close to n = 100, as it should. 


Table 2 
Results of Simulation Study for Different Bernoulli Widths B: Average Sample Size, MCV ¥ and MCEV; 


est. 7 Refers to Estimator Y;; wile 


Bernoulli Average MCVY 

width B sample size esta eSta2 est. 3 
0.000 99.95 24.56 3.63 3.43 
0.010 100.05 22.74 1.96 1.84 
0.020 100.04 24.75 1.82 Sea 
0.025 100.09 25,5) 1.82 1.78 
0.030 100.06 28.03 1.83 1.80 
0.040 99.86 Some 2.01 2.03 
0.050 100.02 42.25 2.56 2.64 
0.060 IY) 56.08 3.42 3.65 
0.070 100.05 90.73 4.80 5.47 
0.073 100.02 119.13 6.06 7.09 

Table 3 
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., 4. (Values in the Last Eight Columns to be Multiplied by 10°.) 


MCE V 
est. 4 est. 1 est. 2 est. 3 est. 4 
3.46 24.92 3.67 3.43 3.46 
1.85 D393 1.98 1.86 1.87 
1.78 29.37 1.85 eal 1.78 
1-79 26.86 1.87 1.81 1.82 
1.81 28.58 1.91 Si, 1.88 
2.06 33.54 2.11 lal NS} 
2.67 41.42 2.48 DSN ASS) 
3.67 55.70 3.20 3.24 3.44 
S., 91.28 4.89 4.72 Sail/ 
7.43 116.27 6.00 5.34 6.49 


Results of Simulation Study for Different Bernoulli Widths B: Coverage Rates in % of Nominal 95% and 
90% Confidence Intervals, MCRTE95 and MCRTE90; est. 7 Refers to Estimator Yj SNF cacy 


Bernoulli nominal 95% confidence level 

width B esta est. 2 est. 3 est. 4 
0.000 94.50 92.03 SDI) 92.48 
0.010 95.20 93.13 93.47 93,52 
0.020 95.06 94.23 93.88 93.88 
0.025 95.06 OBMIS 94.56 94.70 
0.030 94.63 94.12 94.09 94.19 
0.040 93.84 94.44 94.47 94.64 
0.050 98597) 94.38 93.76 93.82 
0.060 93.54 OBES, ODN2 92.69 
0.070 92.93 94.99 90.67 92.03 
0.073 91.03 95.02 88.03 90.46 


Tables 2 and 3 generate these comments: 


ie 


Let us begin the examination of Table 2 by a comparison 
of Monte Carlo variances across estimators, for a fixed 
Bernoulli width B. This shows that, for every value e 
B, there is little to choose between es Ve and Mes 

terms of variance. By contrast, the HT Sapna ’, se 
considerably greater variance. To illustrate, the Tatio 
MCV Y,/MCV i. equals 3.43/24.56 = 0.140 for B = 0 
(Poisson mps), 1.80/28.03 = 0.064 for B = 0.03, and 
7.09/119.13 = 0.060 for B = 0.073 (Bernoulli). This 
confirms that the HT estimator is a poor choice 
compared to an alternative that uses the strongly corre- 
lated auxiliary variable. This is true, not surprisingly, for 
Bernoulli, but also for B-values near the lower end of the 
[0, f,] interval, which shows that the sampling design 
alone does not extract all the power of the auxiliary 
variable, even though with B near zero, we are close to 
a Strict mps selection (thus supposedly highly efficient). 
Part of the reason that the HT estimator has a 


nominal 90% confidence level 


Staal estas esta est. 4 
89.70 86.36 87.35 86.74 
90.43 88.06 87.93 88.02 
90.36 89.36 88.49 88.55 
90.64 89.15 89.73 89.72 
89.85 89.06 88.70 88.86 
88.77 89.60 89.41 89.60 
88.67 88.67 88.08 88.53 
89.10 87.57 85.99 87.27 
88.40 88.62 84.27 86.11 
86.53 88.62 81.26 83.86 


comparatively large variance is that the randomness of 
the sample size under Pomix sampling penalizes the HT 
estimator (but not the GREG estimators). Since the HT 
estimator is inefficient, we do not further discuss it. 


Examining the small differences between ee Ve and ¥ 7 
we note in Table 2: As measured by the Monte Carlo 
variance, ie, is better than Ye for all Bernoulli widths B, 
but only Seperaelll so. Also, Y, and Y,, are better than Y, 
at the lower end of the eee of B- values, SSI 
because of the fact that in ie we allow the certainty part 
the sample to contribute to the slope estimate, somewhat 
inappropriately, since there is only an estimation 
problem for the randomization part. But at the upper 
end, the relation is reversed and for the upper extreme 
B = 0.073 (Bernoulli), Ys iS clearly better than Ne 
That the differences sean Ve ve and 16 are sO small 
is not surprising, because all are varieties of the GREG 
estimator (4.1) using essentially the same auxiliary 
information. 
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3. Table 2 confirms that the proposed variance estimator V 
works well, as we would expect; MCE V is with few 
exceptions very close to the target that V aims at 
estimating, that is, the variance of Y, measured here by 
MCV Y. This holds for all estimators and all values of 
B, with a few notable exceptions, namely, in the case of Ye 
and V6: when B is close to the upper extreme (Bernoulli): 
Then the variance estimator underestimates the variance. 


4. The most interesting result in Table 2 we consider to be 
the fact that the variance of ig. or Ke or ee when 
viewed as a function of the Bernoulli width B, does not 
attain its minimum at B = 0 (Poisson mps), as one might 
have initially guessed, but rather for a value of B 
somewhere between 0.02 and 0.03. Moreover, the 
improvement of the case B = 0.02 over the case B = 0 is 
substantial for all of ee ie and Fe Measuring this 
improvement by MCV( YIB= 0. 02) divided by 

MCVW(Y | B= 0), we find that this ratio is only about 
50% for all of Y; ye and Ys More precisely, for Ns the 
ratio is 1.82/3. 63 = 0. aie ey Ye itis 1.77/3.43 = 0. 516, 
and for Y, it is 1.78/3.46 = 0. 514. In view of these 
results, we added a simulation for B = 0.025, a value not 
examined in the original round of simulations. The 
results, also displayed in Table 1, confirm that a 
minimum variance is obtained, for all three estimators, ee Nie 
and Ge at a point in the vicinity of B = 0.025. ‘One 
possible explanation of why it is considerably better to 
take B to be a value distinctly greater than B = 0 (which 
gives Poisson amps) is the following: When B is 0 (or 
very near 0), the units with the smallest x-values, when 
selected, will have unduly large weights, which induces 
high variability. This is avoided by choosing B clearly 
away from zero. 


5. The Monte Carlo results in Table 3 concerning the cove- 
rage rates show that the variance estimation and the 
confidence interval procedure function to satisfaction. 
As theory leads us to expect, MCRTE95 and MCRTE90 
are close, for all four estimators, to their theoretical 
values, 95% and 90%, respectively. Only for and ie 
and ihe when B gets close to the upper Sune 
(enioultiy, do we notice any marked tendency for the 
MCRTE to drop below the nominal value, resulting in 
part from the underestimation of variance mentioned 
earlier. 


6. FURTHER EVIDENCE THAT POMIX 
SAMPLING IS MORE EFFICIENT THAN 
POISSON zps SAMPLING 


Initially we had no strong reason to believe that Pomix 
sampling combined with a GREG estimator would be more 
efficient for some Bernoulli widths B in the interior of 
[0, f,] than for Poisson mps (B =0). The strong improve- 
ment — a variance reduction of around 50% for our 


particular population — was rather surprising. For other 
populations, the variance reduction can be more or less than 
the 50% we found. Because our finding is data dependent, 
it is desirable to provide some more general evidence in 
support of the proposition that Pomix sampling with a 
B-value well into the interior of [0,f,] is better than 
Poisson aps sampling (B = 0). We now present some 
evidence of this kind. 

We examined the Taylor variance of Y (that is, the 
variance of the Taylor linearized Se) It is given by 
(see Sarndal et al., 1992, Ch. 6) Vray = Ly (a, - DE, 
where E, is the population analogue of the Simple based 
residual e, used in the variance estimator (4.2). For 
example, for the estimator Ge the residual in question is 
=y, — 5.x, with b; = ite (a, - ly, %/ Lu, (aze Mee 
for Y,, b, = his yy! Ly, x, replaces De 

It is reasonable to. model the aed residual as 
E, =07x,(1 +68,), where p satisfies 0 < p < 2, and 6, is 
near zero. This ee panes to assuming a Sipcrponulanon 
model y, = x,' B + €,, where the €, are independent errors 
with model epeced value zero for every k, and e, gs 
model variance o”x,’. Using the approximation E, oe 
x,’,and that a, = 1/m, with 1, given by (2.3), we fave 


Van o Dap {H(B, p) -T(p)} 


where H(B,p) =x y, De (Be Ue b) mle mand 
T(p) =¥, U, cae Now congider a fixed value of p such that 
Ora <2): “We want to find out if H(B, p) has a smaller 
value for some B in the interior of the interval [0, f,], 
compared to its value at B= 0, whichis H(0, p). To this 
end, let us examine if the derivative H’(B, p) = 
OH (B, p)/OB is negative at B=0. We find 


(ae Dx, s- 


H’(B, p) Adi Dots x4 be, ~¥y,)[BXy 


Its value at B=0is H’ (0, p) = (%1,,/ fr) Yu.%t & —*Fu,)- 
The o ; of GH (Ol pp) is fie same as that of 
Lu, Xe -X,,). But this quantity equals, apart from the 
facthr 1 ee 15, the covariance in U, between x; * and 
oy 8 U, Ga that=x-- x U, has zero mean). When p 
satisfies 0 < p <2, this covariance is negative: when x, 

increases, x, - xy. increases steadily, and x, ? decreases 
steadily (and remains always positive). The sign of 
H'(0, p) is therefore negative; consequently, it is not at 
B = 0 that H(B, p) attains its minimum value, but for some 
B in the interior of (0, f,]. Now for p = 2, H'(0, p) = 0, and 
H(B, p) has a minimum at B = 0. 

These considerations raise the question whether the 
population used for our simulation in section 5 corresponds 
to a value of p € [0, 2], but distinctly less than 2, so that we 
can expect significant gains from Pomix sampling. To 
obtain an answer, we estimated p by fitting the logarithmic 
version of the model E, =o°x;'(1 + 6,) to the data avail- 
able ftor-U,= UU. That is, we fitted W,=a+ pz, 


R a Tr < B)x,] 7 
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where w, = log He, =y, — b,x, with b, = Dyk y/ Ly, 

X,; 2, = log x,,and ais an fitercept term. We obtained the 
value p = 1 45, by treating p as a linear regression slope 
estimated as p = Lu (W,-Wy )(%4-Zy Ly, S- Zi 4 

Since this p-value i is sees oy less than 2; our Monte 
Carlo population is indeed one where one can expect 
significant gains from the use of Pomix sampling with a 
value of B in the interior of [0, fp]. 


7. CONCLUDING DISCUSSION AND 
TENTATIVE RECOMMENDATIONS 


The survey sampler will ask: If I consider using Pomix 
sampling for my survey, combined with a GREG estimator, 
what is an appropriate choice for B? Recall that in this 
paper we found, for one particular population, that a large 
efficiency gain (roughly 50% variance reduction compared 
to Poisson mps) is realized by fixing the Pomix parameter 
B at around 30% of f,. We were led to suspect that the 
variance gain is related to residual error characteristics, and 
this was confirmed in Section 6 which presented evidence 
that when the squared residual pattern conforms to 
E, = 07x)’, where p satisfies 0 < p < 2, as is the case in 
many business survey populations, then Pomix sampling 
with B in the interior of the interval [0, f,] may well be 
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advantageous. However, the present paper does not address 
the question of the optimal choice of B. A difficulty is that 
in practice the value of B must be fixed at the design stage, 
and that the optimal B depends on unknown population 
characteristics. Prior knowledge of the population, notably 
about its residual variance structure, can guide the choice of 
B. 

Our tentative recommendations based on this paper are: 
If prior information suggests a squared residual pattern 
conforming to o’ x,’ with p < 2, then use Pomix sampling 
with B = 0.3 fp. On the other hand, if in reality the 
unknown p is such that p > 2, then, although the best choice 
in this case might be B = 0 (Poisson mps), little harm would 
probably be done to use B = 0.3 f,, because the variance 
viewed as a function of B is likely to increase at a gentle 
rate. Therefore, B = 0.3 fp, seems a reasonable all-purpose 
suggestion. These recommendations are tentative; the 
question merits a further study that lies beyond the scope of 
this paper. 
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APPENDIX 


700 


SCATTER PLOT OF X AND Y 
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Figure 3. Scatter plot of x (yearly wages) against y (employment) for the portion U r of the Monte Carlo population of 1,000 Finnish 


enterprises. 
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Toward Variances for X-11 Seasonal Adjustments 


WILLIAM R. BELL and MATTHEW KRAMER’ 


ABSTRACT 


We develop an approach to estimating variances for X-11 seasonal adjustments that recognizes the effects of sampling error 
and errors from forecast extension. In our approach, seasonal adjustment error in the central values of a sufficiently long 
series results only from the effect of the X-11 filtering on the sampling errors. Towards either end of the series, we also 
recognize the contribution to seasonal adjustment error from forecast and backcast errors. We extend the approach to 
produce variances of errors in X-11 trend estimates, and to recognize error in estimation of regression coefficients used to 
model, e.g., calendar effects. In empirical results, the contribution of sampling error often dominated the seasonal 
adjustment variances. Trend estimate variances, however, showed large increases at the ends of series due to the effects 
of fore/backcast error. Nonstationarities in the sampling errors produced striking patterns in the seasonal adjustment and 


trend estimate variances. 


KEY WORDS: Sampling error; Forecast error; Trading-day; ARIMA model. 


1. INTRODUCTION 


The problem of how to obtain variances for seasonally 
adjusted data is long-standing (President’s Committee to 
Appraise Employment and Unemployment Statistics 1962). 
Model-based methods of seasonal adjustment (see Bell and 
Hillmer 1984, for a discussion) use results from signal 
extraction theory to produce estimates and associated error 
variances of the seasonal and nonseasonal components. 
Most official seasonal adjustments, however, are made 
using empirical methods, most notably X-11 (Shishkin, 
Young and Musgrave 1967) or X-11-ARIMA (Dagum 
1975). These methods are based on fixed filters, not 
models, and so it is not obvious how to calculate variances 
of the seasonal adjustment errors. Various approaches for 
obtaining variances for X-11 seasonal adjustments have 
been proposed, as summarized below. 

Wolter and Monsour (1981) suggested two approaches. 
They recognized that many time series that are seasonally 
adjusted are estimates from repeated sample surveys, and 
thus are subject to sampling error. Their first approach 
accounts only for the effect of sampling error on the 
variance associated with seasonal adjustments. Their 
second approach tries to also reflect uncertainty due to 
stochastic time series variation in the seasonal adjustment 
variances. However, this second approach assumes that, 
apart from regression terms, the time series is stationary. 
This type of model is now seldom used for seasonal time 
series. Also, their second approach contains a conceptual 
error: it produces the variance of the seasonally adjusted 
estimate, instead of the desired variance of the error in the 
seasonally adjusted estimate. 

Burridge and Wallis (1985) investigated use of the 
steady-state Kalman filter for calculation of model-based 
seasonal adjustment variances, and applied this approach to 


a model they obtained previously (Burridge and Wallis 
1984) for approximating the X-11 filters. They suggested 
that this approach could be used to, “provide measures of 
the variability of the X-11 method when it is applied to data 
for which it is optimal,” (p. 551), but cautioned against 
doing this when the X-11 filter would be suboptimal (i.e., 
very different from the optimal model-based filter). 
Hausman and Watson (1985) suggested an approach to 
estimating the mean squared error for X-11 when it is used 
in suboptimal situations. Bell and Hillmer (1984, section 
4.3.4) pointed out a problem with the use of model-based 
approximations to X-11 for calculating seasonal adjustment 
variances. The problem is that X-11 filters (or any seasonal 
adjustment filter, for that matter) are not sufficient to 
uniquely determine models for the observed series and its 
components. 

Pfeffermann (1994) developed an approach that 
recognizes the contributions of sampling error and irregular 
variation (time series variation in the irregular component) 
to X-11 seasonal adjustment variances. The properties of 
the combined error (sampling error plus irregular) are 
estimated using the X-11 estimated irregular. These 
properties are then used to estimate two types of seasonal 
adjustment variances. A drawback to this approach is that 
it relies on an assumption that the X-11 adjustment filter 
annihilates the seasonal component and reproduces the 
trend component. (Note Pfeffermann (1994, p. 90), 
discussion surrounding equation (2.7).) Violations of this 
assumption in practice compromise the approach to an 
extent which appears difficult to assess. Thus, this 
assumption seems to us highly questionable and also, in any 
particular case, uncheckable. A second drawback is that 
one of the variance types proposed by Pfeffermann assumes 
that the X-11 seasonally adjusted series, rather than the 
trend estimate, is taken as an estimate of the trend. Breidt 
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(1992) and Pfeffermann, Morry and Wong (1993) further 
develop Pfeffermann’s general approach. 

The goal of this paper is the development and application 
of an approach to obtaining variances for X-11 seasonal 
adjustments accounting for two sources of error. The first 
error source is sampling error. The second is error that 
arises from the need to extend the time series with forecasts 
and backcasts before applying the symmetric X-11filters. 
These latter errors lead to seasonal adjustment revisions 
(Pierce 1980). Note that revisions eventually vanish as 
sufficient data beyond the time point being adjusted become 
available. Also note that a seasonally adjusted series will 
not contain sampling error if the corresponding unadjusted 
series does not. This is the case for certain economic time 
series, €.g., export and import statistics for most countries. 

Our approach assumes that the X-11 seasonal adjustment 
target (what we assume application of X-11 is intended to 
estimate) is what would result from application of the 
symmetric linear X-11 filter (with no forecast and backcast 
extension required) if the series contained no sampling 
error. While this definition of target might be criticized for 
ignoring time series variation in the underlying seasonal 
and nonseasonal components, we think this may be 
appropriate for typical users of X-11 seasonally adjusted 
data. Such users are most likely to be concerned about 
uncertainty reflected in differences between initial adjust- 
ments and final adjustments, i.e., in revisions. Some of 
these users will also be aware that the unadjusted series 
consists of sample-based estimates of the true underlying 
population quantities, and will realize that the effects of 
sampling error on adjustments should also be reflected in 
seasonal adjustment variances. 

Our development is based on use of the symmetric linear 
X-11 filters. We assume that the symmetric filters are 
applied to the series extended with minimum mean squared 
error forecasts and backcasts. In practice, the forecasts and 
backcasts are obtained from a fitted time series model. This 
is in the spirit of the X-11-ARIMA method of Dagum 
(1975), but with full forecast and backcast extension, as 
recommended by Geweke (1978), Pierce (1980), and 
Bobbitt and Otto (1990). Our results apply directly to the 
use of additive or log-additive X-11 (with forecast and 
backcast extension), and the log-additive results are 
assumed to apply approximately (Young 1968) to 
multiplicative X-11. 

Section 2 of this paper develops our approach, which 
builds on the first approach of Wolter and Monsour (1981). 
The differences between the two approaches are discussed 
in section 2.4. Section 3 then discusses three extensions to 
the results of section 2. The first is to note that our approach 
works equally well with seasonal, trend, or irregular 
estimates, and that more generality is easily accommodated 
by allowing different filter choices for different months. 
The second extension produces variances of estimates of 
month-to-month or year-to-year change. Finally, when 
seasonal adjustment involves estimation of regression 


effects (e.g., for trading-day or holiday variation), the 
results are extended to allow for additional variance due to 
error in estimating the regression parameters. 

Section 4 then presents several examples illustrating the 
basic approach and the extensions given in section 3. One 
thing evident from the examples is that for time series with 
sampling error, our seasonal adjustment variances will often 
be dominated by the contribution of the sampling error. In 
the center of the series, our results effectively reduce to the 
first approach results of Wolter and Monsour. Our results 
do differ from those of Wolter and Monsour near the end of 
the series. This is important since the most recent 
seasonally adjusted values receive the most scrutiny. Also, 
the contribution of forecast and backcast error to trend 
estimate variances can be very large at the ends of a time 
series. Other results of particular interest are the effects of 
certain nonstationarities in the sampling errors. The 
examples of section 4 show that nonstationarities such as 
sampling error variances that change over time, or periodic 
independent redrawings of the sample, can yield striking 
changes in the pattern of the variances of seasonally 
adjusted data or trend estimates over time. 

Section 5 provides concluding remarks. 


2. METHODOLOGY 


Define the observed unadjusted time series as y, for 
t=1,...,n. Time series that are seasonally adjusted are 
often estimates obtained from repeated (monthly or quar- 
terly) sample surveys, and thus can be viewed as composed 
of a true underlying time series Y,, and a series of sampling 
errors €, assumed uncorrelated with Y,. (See Bell and 
Hillmer 1990.) In vector notation, y, = Y, +e,, where the 
subscript o indicates that the time span of these vectors is 
the set of observed time points 1, ...,n. In certain cases y : 
may arise from repeated censuses (as is typically the case 
for national export and import statistics, for example), in 
which case there is no sampling error, /.e., e ae 0. 

The development that follows assumes that both Y, and e, 
follow known time series models. The model for Y, will 
generally involve differencing, as in ARIMA (auto- 
regressive-integrated-moving average) and ARIMA com- 
ponent (structural) models. The model for Y, may be 
extended to include regression terms. (This will be consi- 
dered in section 3.3.) The series e, is assumed to not 
require differencing, but it may nonetheless exhibit certain 
nonstationarities, such as variances that change over time. 
Any such nonstationarities are assumed to be accounted for 
in the model for e,. In practice, the models will be devel- 
oped from observed data, as is discussed by, e.g., Bell and 
Hillmer (1990, submitted), Binder and Dick (1989, 1990), 
and Tiller (1992). 

In applying a symmetric X-11 filter of length 2m + 1 for 
seasonal adjustment with full forecast and backcast 
extension, the vector y, needs to be augmented by m 
backcasts and m forecasts. The vector holding the m values 
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of y, prior to the observed data, and the corresponding 
mx 1 vectors for Y,, and e,, are denoted y,> Y,,ande,. 
The analogous vectors of the m future values of y,, Y,, and e, 
are denoted Yp> Y,, and e Thus, 


ke 
Ub ls WOW) ie a (2.1) 
The full vectors in (2.1), hereafter denoted as y, Y, and e, 
have length n + 2m. 

The backcasts and forecasts used to augment y, are 
assumed to be minimum mean squared error (MMSE) 
linear predictions of y, and y f (using y,) obtained from 
the known time series model. (In practice, the model will 
be fitted to the data y,-) Under normality, the backcasts 
and forecasts are E(y,|y,) and E (y, |y,,). The vector of 
observed data augmented with the backcasts and forecasts 
is denoted y =(¥,,¥,,Y,)', where y, =E(y,|y,) and 
y TeEAY Wolo simplify notation, from now on we will 
take expressions such as (y,,y,,JY p to mean the column 
vector (y;,yY,> ¥;)- 

Let the linear symmetric X-11 seasonal adjustment filter 
be written @(B) =)", a, B J, where B is the backshift 
operator and the @, are the filter weights (@. = @_;)- 
Calculation of the o, is discussed by Young (1968) and 
Wallis (1982). Results of Bell and Monsell (1992) were 
used here. Application of w(B) to the forecast and back- 
cast extended series can be written as Qy, where Q isa 
matrix of dimension nx(n+2m). Each row of @ contains 
the filter weights (@_,,...,@9...,@,,), preceded and 
followed by the appropriate number of zeroes such that the 
center weight of the X-11 filter (@,) multiplies the obser- 
vation being adjusted. Thus, in the first row of Q there are 
no preceding zeroes and n — 1 trailing zeroes, in the second 
row there is one preceding zero and n - 2 trailing zeroes, 
etc. For the default X-11 filter, m = 84. Choice of alter- 
native seasonal or trend moving averages in X-11 changes 
the value of m from a low of 70 to a high of 149. 

The question arises as to what Qy is estimating. As 
noted in the introduction, we define the “target” of the 
seasonal adjustment as the adjusted series that would result 
if there were no sampling error and there were sufficient 
data before and after all time points of interest for the 
symmetric filter to be applied. The target is thus m(B)Y,, 
or in vector notation QY, and the seasonal adjustment error 
vector is v = Q(Y - y). Weare interested in the variance- 
covariance matrix var(v) = Qvar(Y - y)&2’. This can be 
easily computed once var (Y - y) is obtained. From here 
through section 2.3 we discuss the calculation of 
var (Y - y)- 

We start by writing Y - y = (y -e) -y = (b,9,f) -e, 
where b = y, - y b is the mx 1 vector of backcast errors, 
and f=y any. is the mx1 vector of forecast errors. 
Given the models for Y, and e,, we calculate var(Y - y) 
by separately computing var(e), var(b,0,f), and 
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cov[(b, 0, f), e], as discussed in sections 2.1 to 2.3. Then, 
var(Y - y) easily follows as var(b,0,f) + var(e) -cov 
[(b,0,f),e] - cov[(b,0,f),e]’. Thus, 


var(v) =Q{ var(b,0,f) + var(e) -cov[(b,0,f) ,e] - 
cov[(b,0,f), e]’}Q’. 


Example—-U.S. 5+ Unit Housing Starts. As the computa- 
tions for each piece of var(Y -y) are explained, we illus- 
trate the results graphically for an example series: housing 
starts in the U.S. for buildings of five or more units from 
January 1975 through November 1988 (167 observations). 
The original series, seasonally adjusted series, and esti- 
mated trend are shown in Figure 1. In practice, seasonal 
adjustment at the Census Bureau of this series uses a multi- 
plicative decomposition with a 3x9 seasonal moving 
average and a 13-term Henderson trend filter. The 
following model for this series was developed in Bell and 
Hillmer (submitted): 


yn Yee, 
(1-B)(1-B'?)Y, = (1 -0.67B+0.36B?)(1 -.8753B"”)a,, 
o, = 0.0191 
e,=(1 -0.11B -0.10B?)b,,0, =0.00714 (2.2) 
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Figure 1. U.S. Housing Starts with Five or more Units. The top panel gives 
the original series from January 1975 through November 1988. The strong 
seasonality of the series is apparent from the yearly dips that typically occur 
during the winter months. The bottom panel gives the X-11 seasonally 
adjusted series (solid line) and trend estimate (dotted line) for the same period. 
The seasonal adjustment is multiplicative using a 3 x 9 seasonal moving 
average and 13-term Henderson trend filter. 
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Here, y, denotes the logarithms of the original time series (e ye 
so that (2.2) implies a multiplicative decomposition for the 
original series (e?'=e ‘'e“'). 


2.1 Computation of Var(e) 


If oD: follows a stationary ARMA model, then var(e) can 
be computed from standard results, e.g., McLeod (1975, 
1977), Wilson (1979). If var(e,) changes over time, we 
write e,=h,é,, where h, = var(e,), and @, has variance 
one and the same autocorrelation function as e,. (See Bell 
and Hillmer submitted.) Then, writing e = Hé, where H = 
diag (hy _,,5- ty +m)> We have var(e) = Hvar(é)H’. 
Var(€) is the autocorrelation matrix of e, and it can be 
computed as just noted using the model for @,. 

If the sample is independently redrawn at certain times, 
then var (e) will be block diagonal, with blocks correspon- 
ding to the time points when each distinct sample is in 
effect. Each diagonal block of var (e) be computed as just 
discussed. These two types of nonstationarities in e— 
variance changing over time and “covariance breaks” due 
to independent redrawings of the sample — are those that 
arise in the examples of section 4. 


Example—U.S. 5+ Unit Housing Starts (continued). Auto- 
covariances for the MA(2) model for e, given in (2.2) are 
easily computed. The resulting var (e) is a band matrix, with 
var (e,) = 0.007298 on the diagonal, cov(e,,e,_,) = 
-0.000707 on the first sub- and super-diagonals, and 
cov(é,,é,_,) = -0.000714 on the second sub- and super- 
diagonals. The rest of var (e) is zero. Following pre- and 
post multiplication by the seasonal adjustment filter 
matrices Q and @’ the contribution of the sampling error 
to the variance of the seasonally adjusted series is constant 
for each observation (Figure 2). This occurs because the 
result of a time invariant linear filter applied to a stationary 
series (@(B)e,) is a stationary series, which has a constant 
variance. 


2.2 Computation of Var (b, 0, f ) 


The central n rows and n columns of var(b, 0, f ) are all 
zeroes. We require computation of var(b), var(f), and 
cov(b, f) for the corner blocks of var(b, 0, f). Although 
computation of variances of forecast (or backcast) errors for 
given models is standard in time series analysis, it is 
complicated here by the component representation of 
y,as Y,+e,, and by differencing in the model for Y,. 
Although computations for such models are often handled 
by the Kalman filter (Bell and Hillmer submitted; Binder 
and Dick 1989, 1990; Tiller 1992), this is inconvenient here 
since we require covariances of all distinct pairs of random 
variables from among the m forecast and m backcast errors. 
We instead use a direct matrix approach due to Bell and 
Hillmer (1988). 

Assume that the differencing operator required to render Y, 
stationary is 6(B), which is of degree d. Since e, is 
assumed not to require differencing, 5(B) is also the 
differencing operator required by y,- Define 6(B)y, =w,, 


thus w, = 5(B)Y,+6(B)e,. We introduce the matrix A, 
corresponding to 5(B), defined such that Ay = w is the 
vector of differenced y. The vector w =(w pW WwW p» 
which is of length n + 2m - d, is partitioned so that w, and w f 
are mx 1 vectors, and w, is the n -d vector of differ- 
enced observed data. Thus, A _ has’ dimensions 
(n+2m-d)x (n+ 2m). Note that, because d observations 
are lost in differencing, w, and w, start d time points later 
than y, and y,, respectively. That is, y, and y,, start at 
time points 1- mand 1, but w, and w,, start at time points 
Lams acandidi 1: 
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Figure 2. U.S. 5+ Units Housing Starts: Variance Decomposition after X-11 
Seasonal Adjustment. The top panel gives the variance of the seasonally 
adjusted series as the total of the three components. The second panel give the 
contribution of sampling error (e), which is the largest component and 
constant across the series. The third panel gives the contribution of 
back/forecast error (b 0 f), which is zero in the middle of the series, where no 
back/forecasts are needed, but increases towards either end of the series as 
more back/forecasts are used. The bottom panel is the sum of the two 
covariance terms (cov(e, (b 0 f)) + cov( (b 0 f), e)), which tend to offset the 
contribution from back/forecast error. 
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= AY. Thetime series u, 


— / 
Define u = (AS gu) = 


is stationary. ‘Since w =u + Ae, with u and e uncorrelated 
with each other, var(w) = var(u) + Avar(e)A’. We parti- 
tion var (w) as 


ee a 
var(w) =| 2%) 2%) 23], 
ee 


where Z,, is var(w,), 2), is cov(w,,W,,), etc. 

Since y, when differenced to w using 5(B), has lost d 
data values, y cannot be obtained from w without also 
knowing a sequence of d “starting values”. Consider 
obtaining y, from w, and starting values y, = 
(Y,+1-a2"*» ¥,) + Theorem 1 in Bell (1984a) can be used to 
show that 

y,= Ay, + Cw, (2.3) 
for matrices A and C determined by 5(B). The rows of the 


mxm matrix C consist of the coefficients of €(B) = 
1+€, B+, B’+...=5(B)” inthe form 


1 0 ie Oma) 

& l 0 0 
Cer Say Wis Uke 
: Pie V8) 
Cer. acta! 


A is an m xX d matrix which accounts for the effect of the d 
starting values in y, on y,. The exact form of A is given in 
Bell (1984a) and, since it will exactly cancel in our appli- 
cation, it will not be given here. In (2.3) y, is known since 
it is part of y,, the observed data. Thus, from (2. 3) the 
MMSE forecast of y f iS y, = Ay, + Cw p where W f is the 
MMSE forecast of w Therefore, f = y; -y f = Ay, + Cw, 

-(Ay, +Cw p= C(w ,- w ,), and var(f) = ! Cvar(w,- w)C’. 

Under Assumption A oft Bell (1984a), which leads to the 
standard results for forecasting nonstationary series (as i in, 
e.g., Box and Jenkins 1976, Chapter 5), W, =2,,25 3W, 
Note that this uses only the differenced data % in 
forecasting w, Then, from standard results on linear pre- 
diction, var(w,- W,) = Lee Layee pa >. Thus, var(f) = 
C(,, - 2,2, Ce 

To obtain var (b) and cov (b, f) we note that results 
obtained by Bell (1984a, p. 651) imply similar calculations 
hold for the backcast errors b. In fact, it can be shown that 
b = (-1)’C’(w, - W,), where w, is the MMSE backcast 
of w,, and r is the number of times (1 - B) appears in the 
polynomial 5(B). (The appearance of C’ in this expression 
instead of C stems from the indexing of w, and w, forward 
through time although the backcasting process proceeds 
backwards through time.) Thus, var(b) = C’var(w, We) 
C=C’ ae oe mae pees OD LY C: Similarly cov (f, b) = (- iy 
C( x, z JC. In practice, to avoid inverting L,, 
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var(f), var(b), and cov(f, b) can be computed using the 
Cholesky decomposition of Z,,. (See Appendix A.) 


Example—U.S. 5+ Unit Housing Starts (continued). The 
contribution to seasonal adjustment variance from var(b, 0, 
f) is shown in Figure 2. This is zero or essentially zero for 
observations in the middle of the series, where no or few 
fore/backcasts need be made to apply the symmetric 
adjustment filter. Towards the ends of the series, the 
contribution of fore/backcast error becomes more substan- 
tial since an increasing number of observations need to be 
fore/backcast to apply the filter. The jumps in the graph 
occur when an additional fore/backcasted observation is 
multiplied by a weight in the adjustment filter that is a 
multiple of the seasonal period, since these weights have 
the greatest magnitude (Bell and Monsell 1992). Note that 
the contributions from var(b, 0, f) at the very ends of the 
series are smaller than the contributions from var(e), but are 
not negligible. 


2.3. Computation of Cov[(b 0 f), e] 


To compute cov(f, e), we first note from results of me 
preceding section that f= y ae ) W,)= 
(w, -E,,25,W ,)=C[0| -Z,,E5,|L,, Iw =€(0|-2 ain, ] 
ne Since cov(y,e) = cov(¥ +e,e) =O+ Oy. we see 
that cov(f,e) = C[0| -, eal be ]Avar(e). Cov (b, e) is 
computed in an analogous fashion by noting that, 
b=(-1)'C'(w,-w,) =(-1)'C'(w, =2,,.2w,) =C--D'C’ 
[I,, |-2,. LZ. |0] Ay, so that cov(b,e) =(-1)"C’ 
I, | -2 > X57 | 0] Avar(e). 


Example—U.S. 5+ Unit Housing Starts (continued). Figure 
2 shows that the contribution of cov[(b, 0, f), e] is zero or 
near zero in the middle of the series, but it becomes increas- 
ingly negative towards the ends of the series, in a pattern 
similar, though opposite in sign and of smaller magnitude, 
to that of var(b, 0, f). At the very ends of the series, how- 
ever, the pattern reverses and the covariance increases. The 
elements of cov[(b, 0, f) e], are mainly positive, so its 
contribution to the seasonal adjustment variance is negative 
because cov[(b, 9, f), e] and its transpose are subtracted 
from var(e) + var(b, 0, f). The net effect is that subtracting 
Q{cov[ (b,0,f),e] +cov[(b, 0, f), e]’}92’ tends to offset the 
effect of adding Q var(b,0,f)&2’, except near the very ends 
of the series. Thus, the graph of the variances of the season- 
ally adjusted series in Figure 2 is very similar to the graph 
of the contribution of var(e), except near the very ends of 
the series. We observed this type of “cancellation effect” in 
several other examples, including those of section 4. 


2.4 Comparison with the First Approach of Wolter 
and Monsour 


The first approach of Wolter and Monsour (1981) pro- 
posed use of Q| var(e,,)9,/ as the variance-covariance 
matrix of the X-11 seasonal adjustment errors, where 2 | 
is an n +n matrix whose rows contain the X-11 linear filter 
weights, both symmetric and asymmetric. That is, the 
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middle rows (rows t such that m < t<n-m + 1, assuming 
n>2m) of Q | contain the X-11 symmetric filter weights, 
but the first and last m rows of @, contain X-11’s 
asymmetric filter weights. The middle rows of Q, and Q 
thus contain the same filter weights, but the first and last m 
rows do not. This means that our approach will give the 
same results as that of Wolter and Monsour form <t<n- 
m + 1, that is, for time points at which the symmetric filter 
is being used. The results of the two approaches will differ 
for the first and last m time points. Since the most recent 
seasonally adjusted data receive the most attention, this 
difference is potentially important. 

Wolter and Monsour also considered use of a matrix Q* 
instead of Q, where Q" is (n + 12) x (n + 12) to include 
12 additional rows of weights corresponding to year-ahead 
seasonal adjustment filters. Though year-ahead adjustment 
was the common practice through the early 1980s, it has 
now mostly been replaced in the United States by 
concurrent adjustment (McKenzie 1984). 

The differences between our approach and that of Wolter 
and Monsour can be viewed in two ways. One view is that 
since Wolter and Monsour did not consider forecast and 
backcast extension, their approach ignores the contribution 
of forecast and backcast errors to seasonal adjustment error. 
This contribution affects results for the first and last m time 
points, although the examples of section 4 show that this 
contribution is often small. However, in some cases it is not 
small, including those time series not subject to sampling 
error. For such series Wolter and Monsour’s approach 
would assign zero variance to the adjustments, even though 
initial adjustments would be revised as new data became 
available. 

The other way to view the differences between the 
approaches centers on the difference in “targets”. The 
seasonal adjustment error under Wolter and Monsour’s 
approach can be thought of as 2, (Y, -y,) = -2,e.,- 
Since this results in zero error for series with no sampling 
error (Y= y,,), Wolter and Monsour implicitly define the 
seasonal adjustment target tobe 2, Y_. This definition of 
target has the undesirable property that the target value for 
a given time point changes as additional data are acquired, 
since the rows of Q contain different filter weights. Our 
target value for any given time point tis always w(B)Y,. 


Example-U.S. 5+ Unit Housing Starts (continued). We 
compared results using our methodology with that of 
Wolter and Monsour’s using the default X-11 seasonal 
adjustment filter although, as noted earlier, this example 
series is adjusted using the optional 3 x 9 seasonal moving 
average filter. This comparison used the default filter for 
convenience: asymmetric X-11 filter weights are needed to 
obtain results for the Wolter-Monsour approach and we 
were given a computer program by Nash Monsour that 
produced them only for the default filter. Figure 3 gives the 
results for both approaches. The non-constant variances 
over time from the Wolter-Monsour approach result from 
applying different filters at different time points. An 


interesting consequence of this is that, despite the station- 
arity of the sampling error, the Wolter-Monsour seasonal 
adjustment variance is noticeably higher in the middle of 
the series than for many time points toward (but not close 
to) either end of the series. This carries the implausible 
implication that use of less data produces estimators with 
lower variance. Similar behavior can be observed in several 
examples presented by Pfeffermann (1994). 
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Figure 3. U.S. 5+ Units Housing Starts: Comparison with Approach of Wolter 
and Monsour (1981). The panel descriptions are as for Figure 2. The Wolter 
and Monsour approach (dotted lines) uses the asymmetric X-11 filters for the 
ends of the series and accounts only for sampling error. Our approaches agree 
in the middle of the series where there is no contribution from back/forecast 
error. The Wolter and Monsour variances inappropriately decrease near the 
ends of the series, suggesting that use of less data produces estimates with 
lower variances. The results here, in contrast to Figures 1, 2, 4, 5, and 6, use 
default X-11 filters. (See text.) 
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The results from using the default X-11 seasonal adjust- 
ment filter with our approach are also useful for comparing 
with the 3 x 9 seasonal moving average filter, for which 
results are given in Figure 2. Differences between results 
from using the two filters are not great. The contribution of 
the sampling error is somewhat lower and that of the 
fore/backcast error somewhat higher when using the default 
seasonal adjustment filter. 


3. EXTENSIONS TO THE METHODOLOGY 


This section discusses three extensions to the general 
methodology of section 2. The first two extensions are 
straightforward, the third more involved. 


3.1 Variances for Seasonal, Trend, and Irregular 
Estimates; Variances with Time-Varying 
Filters 


The only way the nonseasonal (seasonally adjusted) 
component is distinguished in the derivation of section 2 is 
through the filter weights placed in the matrix Q. There- 
fore, corresponding variances for X-11 estimates of the 
seasonal, trend, and irregular components follow from the 
same expressions simply by changing the matrix 2 to 
contain the desired filter weights. This also changes the 
dimension of Q, since the length of the seasonal adjust- 
ment, trend, and irregular filters (for given options) differs, 
and the filter length determines the size of Q. 

A similar extension handles the case of different 
seasonal moving averages (MAs) selected for different 
months (or quarters), an option allowed by X-11. This 
changes the seasonal adjustment (and seasonal, trend, and 
irregular) filters applied in the different months. The results 
of section 2 also accommodate this extension through a 
simple modification of Q. Since the rows of Q correspond 
to the time points being adjusted, we simply define row t of 
© to contain the weights (along with sufficient zeroes) from 
whatever filter is being applied in month t. Some care must 
be taken to dimension Q appropriately if the longest 
selected MA is not used in the first and last months of the 
series. 


Example-U.S. 5+ Unit Housing Starts (continued). Figure 
4 shows the variance of the X-11 trend estimate, using the 3 x 9 
seasonal MA and 13-term Henderson. The most obvious 
difference from the seasonal adjustment results is the 
substantial effect of fore/backcast error at the very ends of 
the series. This occurs because the largest weights of the 
trend filter (@(B)) are the center weight (”) and the 
adjacent weights (@ ye w,”, 05 ) that are applied to data 
immediately before and after the observation being 
adjusted (Bell and Monsell 1992). At the very ends of the 
series, the weights (o”, of”, 09”) apply to fore/ back- 
casted observations, which results in large increases in the 
contribution of fore/backcast error there. The result is that 
uncertainty about the trend increases sharply at the ends of 
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the series. In the center of the series, however, the trend 
variances of Figure 4 are substantially lower than the 
seasonal adjustment variances of Figure 3, due to the 
smoothing of the sampling error by the trend filter. 
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Figure 4. U.S. 5+ Units Housing Starts: Variance Decomposition of the 
Trend Estimate. The panel descriptions are as for Figure 2. Note the large 
jump in trend estimate variances at the ends of the series due to the 
contribution of back/forecast error (third panel). 


3.2 Variances for Seasonally Adjusted 
Month-to-Month and Year-to-Year Changes 


The variances of the errors of the seasonally adjusted 
estimates of month-to-month change are the quantities 
var(v, — v,_,),t =2,...,. Given var(v), the complete error 
covariance matrix for the seasonally adjusted month-to- 
month changes can be calculated as A, var (v)A,, where 
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is of dimension (n - 1) x n. The error covariance matrix for 
the seasonally adjusted year-to-year changes in a quarterly 
series is calculated similarly as A,var(v) A,, where 
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is of dimension (n - 4) x n. The corresponding (n - 12) xn 
matrix A,, for monthly series follows a similar pattern with 
additional zeroes. 

Variances of month-to-month or year-to-year changes in 
the trend are also easily obtained, as can be seen from this 
discussion and that of section 3.1. 


Example—U.S. 5+ Unit Housing Starts (continued). We 
produced the standard errors for seasonally adjusted month- 
to-month and year-to-year changes for this series (Figure 5). 
Since this time series has been log transformed, standard 
errors can be approximately interpreted as percentages on 
the original (unlogged) scale. Compared to the standard 
errors for the seasonally adjusted series, there are slight 
increases in the standard errors of the month-to-month 
changes near the ends of the series, but the standard errors 
of the year-to-year changes show almost no such increase. 
Thus, for this series and filter, the uncertainty about month- 
to-month and year-to-year percent change in the seasonally 
adjusted data is almost constant across the series. The 
standard errors of the month-to-month and year-to-year 
changes are both about 50 percent higher than those for the 
seasonally adjusted series. 


3.3. Variances of X-11 Seasonal Adjustments with 
Estimated Regression Effects 


Seasonal adjustment often involves the estimation of 
certain regression effects to account for such things as 
calendar variation, known interventions, and outliers 
(Young 1965; Cleveland and Devlin 1982; Hillmer, Bell, 
and Tiao 1983; Findley, Monsell, Bell, Otto, and Chen 
submitted). (Outlier effects are often estimated in the same 
way as known interventions even though inference about 
outliers should ideally take account of the fact that the 
series was searched for the most “significant” outliers.) This 
section shows how the results already obtained can be 
extended to include the contribution to seasonal adjustment 
error of error in estimating regression parameters. We still 
assume the other model parameters, which determine the 
covariance structures of Y and e, are known. In practice 
these other model parameters will also be estimated, but 


accounting for error in estimating them is much more 
difficult. A Bayesian approach for doing so in the context 
of model-based seasonal adjustment is investigated by Bell 
and Otto (submitted). 
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Figure 5. U.S. 5+ Units Housing Starts: Standard Errors. These panels 
contrast the standard errors (not variances, as in previous figures) of the 
seasonally adjusted data (top panel) with the larger standard errors of 
seasonally adjusted month-to-month (middle panel) and year-to-year (bottom 
panel) change estimates. 


We extend the model for Y, to include regression terms 
by writing Y,=x/b+Z, where x, is the vector of 
regression variables at time f, B is the vector of regression 
parameters, and Z, is the series of true population quantities 
with regression effects removed. Extending our matrix- 
vector notation, we write Y=XB+Z,Y =X B+Z_, 
etc. The regression matrix X can be partitioned by its rows 
corresponding to the backcast, observation, and forecast 
periods: X = (X; |X) |X)’. We assume e, has mean zero, 
so its model does not involve any regression effects. We 
then have y = Y +e = (XB + Z) +e, with the usual parti- 
tioning applying. Letting z, denote the series y, with the 
regression effects removed, we have z=y -XB=Z+e. 

An additional partition is needed of the matrix X and 
vector B. This is because some of the regression effects in x; B 
may be assigned to the nonseasonal component while 
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others, such as trading-day or holiday effects, may be 
removed as part of the seasonal adjustment. See Bell 
(1984b) for a discussion. Partition x/ as (x el Xy,) where 
Xy, represents the regression variables assigned to the non- 
seasonal and x,, the variables whose effects are to be 
removed in the seasonal adjustment. Correspondingly par- 
tition B so x/ B=x.B,+x,,By and XB=X,B.+X,B, 
=(X,| X,)(B; | By)’. (x,,B, is assigned to the “com- 
bined” seasonal component.) The matrix X can thus be 
partitioned two ways: by seasonal versus nonseasonal 
regression effects, and by the backcast, observation, and 
forecast periods. Thus we write 


Xs, X vp 
X = Xs, Xo 
X yy X vy 


If B were known we could compute z, =y, - XB =Z, 
+ e ,, forecast and backcast extend this series (call the 
extended series Z), adjust Z by X-11 (QZ), and add back 
the required regression effects X,,B,,,. The target of the 
seasonal adjustment would be Xj, By, + QZ = Xj, By, 
+ Q(Y - XB), and the seasonal adjustment error would 
then be (X,,B,, + QZ) - (X,,B,, + 22) = Q(Z - 2). 
Thus, if the regression parameters were known they would 
not contribute to the seasonal adjustment error, and the 
results already given could be used to compute 
var (Q.(Z - 2)). 

In practice, B will be estimated as part of the model 
fitting, say by maximum likelihood assuming normality. 
Given the estimates of the other model parameters, and 
taking these parameters as if they were known, the maxi- 
mum likelihood estimate of B and its variance are given by 


A / / = ad / / =I 
Bei Ny AD A Xl XA SS Aly (3.1) 


Va) = Px Ay SAW ole (3.2) 
where A, is of dimension (n - d) x n, containing that part of 
the larger matrix A which differences the observed series y,. 
The expressions (3.1) and (3.2) are generalized least 
squares results using the regression equation for the differ- 
enced data, w,=Ay,=(AX,)B+(u,+Ae,), where the 
error term, u, + Ae, , has covariance matrix var (w,) =275 
which is determined by the other model parameters. 
Given the estimated regression parameters B, the 
seasonally adjusted series would be obtained by subtracting 
the estimated regression effects from the data (call the 
resulting series Z,=y, - X,, 6B), extending this series with 
forecasts and backcasts using the model (denote this 
extended series 2 = [2 a ae Z,1); applying X-11 to the 
extended series (QZ), and adding back the estimated 
regression | effects assigned to the nonseasonal component 
ee JB No): Lhe target of the seasonal adjustment is still 


Xo By + 2Z, discussed above. The seasonal adjustment 
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error 1S then v=(X + QZ) -(97+X 


No B No No Bro) 


X vo (Bry ~ By.) + Q(Z - z). 

The oo for v can be simplified by rewriting 2. 
First, let G =[B’|I|F’]', where F is the matrix that 
produces ae y, fromy, and B is the corresponding 
matrix that produces backcasts y, from y,. We will not 
need explicit expressions for F or B. G applied to z, 
produces Z 2 while G applied to 2 , produces Z z. Therefore, 2 = Z - 
(2-2) =%-[G(y, -X,B) -G(y, -X,B)] =2+ GX, 
(B - 8). Note that GX, is obtained by applying the proce- 
dure for forecast and backcast extension (from the model 
for z,) to each column of X,. The approach we used to do 
this is described in Appendix B. Continuing, we have 


vy=X - By) + QUZ - 2) - GX,(B - By] 


- QGX,}(B - B). 


No ( Bro 


= Q(Z -Z) + {[0|X,,,] 


Now, Z-Z=z-e-2Z=[b|0|f] -e. Note that [b|0|f], 
the error vector from projecting z on z, or y,, is orthogonal 
to (uncorrelated with) B - B, since B is a linear function of 
the data y,. Therefore, letting K = [0|X,,,] - QGX,, we 
have the variance-covariance matrix of the seasonal 
adjustment error allowing for error in estimating B: 


var(v) = Qvar(Z - 2)Q' + Kvar(fh)K’ 


+ Qcov(e, B)K’ + Kcov(f, e)Q’ (333) 
where var(B) is given by (3.2). In (3.3) Qvar(Z - z)Q’ is 
computed by the results of section 2, and computation of 
K var(B)K’ is straightforward once GX, has been 
computed. To compute the other two terms requires 


cov( ,e) 


=cov([X /A/j,A XJ 'X/A/EA y,.€) 
=cov([X AUS Ne X JX Ue DUae tity +A.e.],e) 
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Peo! nxn 


axmlvar(e). (3.4) 
Note that [0, |, ,.,,|9,,/var(e) = [cov(e,, e,)|var(e,)| 

cov(e,,e p! is the middle n rows of var(e). Using (3.4) and 
the aforementioned results, (3.3) can be computed. We can 
compare the resulting diagonal elements of var(v) with 
those of the sum of the last three terms in (3.3), to see if 
allowing for the error due to estimating the regression 
parameters is important. 

There is an important qualification to make about the 
results of this section. Since the first term on the right hand 
side of (3.3), Qvar(Z - Z)Q’, is the seasonal adjustment 
variance we would get by ignoring error in estimating the 
regression parameters, it is tempting to interpret the sum of 


|0 
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the last three terms in (3.3) as the contribution to seasonal 
adjustment variance of error due to estimating regression 
parameters. Unfortunately, this sum is not itself a variance 
(it can in fact be written as var (Kp + Qe) — var (Qe)), and 
so it can actually be negative. When this happens the 
seasonal adjustment variances that allow for error due to 
estimating regression parameters are actually lower than 
those that ignore this error. We were in fact able to achieve 
such a result by artificially modifying model parameters in 
the following example with trading-day variables (though, 
as in the results shown, the effects were quite small). This 
situation contrasts with comparable results for model-based 
approaches which express the seasonal adjustment error as 
the sum of two orthogonal terms: the error when all para- 
meters are known, plus the contribution to error from esti- 
mating regression parameters. The seasonal adjustment 
variance in this case is thus the sum of the variances of 
these two terms, and so the “regression contribution” is 
always nonnegative. This result is analogous to 
Qvar(Z - 2)Q' +K_ var(B)K’in (3.3). The problem in 
(3.3) is that the X-11 estimate Qz is not an optimal 
(MMSE) estimator of the target QZ, hence the error 
Q(Z - Z) is correlated with B through the sampling error 
e, leading to the two covariance terms in (3.3). This 
situation results partly from our choice of target 
(XB + QZ) and partly from the fact that X-11 cannot be 
assumed to produce an optimal estimator of anything (note 
comments related to this in the Introduction). 


Example-U.S. 5+ Unit Housing Starts (continued). We use 
the same example to illustrate the contribution to seasonal 
adjustment error of adding trading-day variables (Bell and 
Hillmer 1983), although the corresponding regression coef- 
ficients were not statistically significant when estimated 
with this series. Figure 6a shows the results. In this illus- 
tration, the lowest line is the “contribution” to the seasonal 
adjustment variance from estimating the trading-day effects 
(but see remarks above). When added to the original esti- 
mate of variance (dotted line), we obtain the variance of the 
seasonally and trading-day adjusted series, allowing for 
error in estimating the trading-day coefficients (top solid 
line). We see that, for this example, the increase in variance 
due to including estimated trading-day effects in the model 
is slight. Figure 6b gives results for the trend filter. Here 
the contribution to trend uncertainty due to estimating the 
trading-day coefficients is certainly negligible. 

The contribution to seasonal adjustment variance of 
adding three additive outlier variables and one level shift 
variable is illustrated in Figure 6c. These regression 
variables were identified as potential outlier effects using 
the Regarima program (produced by the Time Series Staff 
at the U.S. Census Bureau) with a critical t-statistic of 2.5. 
Regarima uses an outlier detection methodology similar to 
those discussed in Bell (1983) and Chang, Tiao, and Chen 
(1988). The contributions of the additive outliers appear as 
three spikes while that of the level shift is a single smaller 
hump in the middle of the series. In comparison to the 


trading-day regression variables, the effect of these outlier 
variables is mainly local but much stronger. In particular, 
there is additional uncertainty about seasonal adjustments 
for observations considered additive outliers. 
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Figure 6. U.S. 5+ Units Housing Starts: Including the “Contribution” from 
Regression Effects in the Variance Estimates. The top panel shows both the 
original variances from the first panel of Figure 2 (dotted curve) and the 
variances allowing for additional uncertainty due to estimating trading-day 
regression effects (top solid curve). The regression contribution is also shown 
(bottom solid curve). The second panel shows the corresponding results for 
the variances of the trend estimates. Note that the regression contribution to 
the seasonal adjustment variances is small, and to the trend estimate variances 
it is essentially zero. The third and fourth panels show analogous results when 
the trading-day regression effects are replaced by three additive outliers and 
a level shift. Notice that these have important local effects on the seasonal 
adjustment and trend estimate variances. 
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Results for the trend filter (Figure 6d) differ in that 
uncertainty is much greater around the observation where 
a level shift was detected, which approaches the level of 
uncertainty at the ends of the series. A level shift is 
considered part of the trend, so an estimated level shift 
effect would first be subtracted from the series (in xf ), and 
then added back following application of the X-11 trend 
filter. (This is analogous to the treatment of regression 
effects assigned to the nonseasonal or seasonal components 
in seasonal adjustment as discussed above.) In contrast, 
since both additive outliers and level shifts are considered 
part of the nonseasonal component, all four effects were 
added back as part of the seasonal adjustment when 
producing results for Figures 6a and 6b. 

Actually, these sorts of results for outliers should only be 
regarded as crude approximations, since they treat the time 
of occurrence and types of outliers as known, leaving only 
the magnitude of the effects to be estimated. Ideally, one 
would like to recognize that the series was searched for 
significant outliers, but this is much more difficult. 


4. EXAMPLES 


We illustrate our approach using several additional 
economic time series whose sampling errors follow differ- 
ent models. The models used for these example series are 
taken from previous work as noted. 


4.1 Retail Sales of Department Stores 


Department store sales are estimated in the Census 
Bureau’s monthly retail trade survey. Essentially all sales 
come from department store chains, all of which are 
included in the survey, hence, there is virtually no sampling 
error in the estimates. Thus, the variance of the X-11 
seasonal adjustment comes only from fore/backcast error 
and from error in estimating regression effects. (Note that 
the Wolter-Monsour seasonal adjustment variance would be 
zero for this series.) The model used for this series (Bell 
and Wilcox 1993), for the period August 1972 through 
March 1989 for the logs of the observations, is 
(1 ~B)C - B'*) LY, = BI 0.0.53 B) Gis 0.52B")a, 
with 0, =4.32 x10", where x, includes variables to account 
for trading-day and Easter holiday effects, and Y, = y, is the 
log of the original series divided by length-of-month 
factors. In adjusting the series at the Census Bureau, the 
default X-11 adjustment filter and 13-term Henderson trend 
filter are used. 

Figure 7a shows the standard errors for the seasonally 
adjusted data over time, with and without the contribution 
of regression effects. Unlike the 5+ units housing starts 
series, there are marked increases in the standard errors of 
seasonally adjusted data at the ends of series, due entirely 
to fore/backcast error. The contribution to the standard error 
due to estimating regression effects is also more pro- 
nounced for this series. An interesting feature in Figure 7 
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is the sets of small downward projecting spikes that occur 
one year apart in triplets. These occur at non-leap year 
Februaries, for which there is no trading-day effect (the 
trading-day regression variables are all zero). There is still 
a small regression contribution to seasonal adjustment error 
at these time points since the adjustment averages in these 
contributions from adjacent time points. (Dips at non-leap 
year Februaries are also visible on close inspection of 
Figure 6a.) In addition, for some years, the error in esti- 
mating the Easter effect produces a noticeable upward 
projecting spike involving the two months March and April. 
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Figure 7. U.S. Department Stores, with Trading-Day and Easter Effects. This 
series has no sampling error. The four panels give standard errors with and 
without the contribution from estimating regression effects. For the seasonally 
adjusted data and corresponding month-to-month and year-to-year changes 
(first three panels), the “contribution” from estimating regression effects is 
substantial and erratic in the middle of the series (where it is the sole 
contributor) but, at either end, diminishes for reasons explained in the text. 
The regression contribution to the trend estimate standard errors is small. 
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The regression relative contribution to the seasonal 
adjustment standard errors diminishes towards the ends of 
the series. This results from two factors: (1) the magnitude 
of the regression contribution to var(v,) decreases somewhat 
towards the ends of the series, and, more importantly, (2) 
var(Z, - Z .) increases dramatically towards the ends of the 
series, diminishing the relative contribution to var(v,) due 
to regression (and this is further accentuated when square 
roots are taken). 

The pattern of the standard errors of seasonally adjusted 
month-to-month changes (Figure 7b) is similar to that for 
the standard error of the seasonally adjusted data (Figure 
7a). The regression contribution is slightly larger than it is 
for the seasonally adjusted data. Standard errors of year-to- 
year changes (Figure 7c) follow similar patterns but the 
regression contribution is considerably larger than it is for 
the month-to-month changes, and it remains important at 
the ends of the series. 

A similar set of calculations was performed using the 
default X-11 trend filter, and results for the standard errors 
of the trend estimates, with and without the regression 
contribution, are depicted in Figure 7d. The patterns over 
time of these standard errors are similar to the correspon- 
ding figures for the 5+ units housing starts series, but the 
standard errors are much smaller due to the absence of 
sampling error. The regression contribution is small. 

The standard errors for all plots in Figure 7 are small 
—none exceed 0.8 percent. For this series, the regression 
contribution is small and probably ignorable near the very 
ends of the series, for all but the year-to-year changes. 
However, in the middle of the series, the sole contributor to 
standard errors is that due to the regression effects. 


4.2 Teenage Unemployment 


The Bureau of Labor Statistics (BLS) publishes the 
monthly time series of number of U.S. unemployed teen- 
agers estimated from the Current Population Survey (CPS). 
Data from January 1972 to December 1983 ((n = 144) 
were used by Bell and Hillmer (submitted) to develop a 
model for this series. The sampling error variance h? 
changes over time, so is nonstationary. The sampling error 
model they developed is 

é-= he. where (1-0. 6B)e =(1-03B)De (44) 
with 0; = 0.87671 so that var(é,) = 1. CPS sampling error 
variances can be approximated by generalized variance 
functions (Wolter 1985, Chapter 5; Hanson 1968). The 
generalized variance function Bell and Hillmer used for the 
teenage unemployment series is 

2 Bie pie 

Bie NON Yim (leo XA) ay (4.2) 

where y, is the estimate of the number in thousands of 

unemployed teenagers at time t. The estimated model for 
the signal component Y, is 


(hese 9 lis BMY. (b= O27 BG 0.68B"”)a., (4.3) 
with ce = 4294. There are no regression effects in the 
model and the series is not transformed. BLS uses the 
default X-11 seasonal adjustment filter (so m = 84). 

In applying the methods of this paper to this example, 
problems arise from the fact that the (estimated) sampling 
error variance h? depends on the estimate y, through the 
generalized variance function (4.2). In the backcast and 
forecast periods y, is unknown. To obtain h; in these 
periods we forecast and backcast y, using a simple 
ARIMA(O 1 1)(0 1 1). model for y, (not for Y,, as in 
(4.3)). The resulting 84 forecasts and backcasts were then 
used in (4.2) to produce h; in the forecast and backcast 
periods. More refined treatments are possible, such as using 
the component model given by (4.1) and (4.3) to forecast 
Ye 
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Figure 8. Teenage Unemployment, with Default X-11 Options. The panel 
descriptions are as for Figure 2. The seasonal pattern of the sampling error 
variance contribution (second panel) results from its dependence on the level 
of the series through a generalized variance function (see text). 


The seasonal adjustment variance for this series (Figure 
8a) is dominated at most times t by the sampling error 
contribution (Figure 8b). This is because, while the contri- 
bution of var(b, 0, f) is substantial for this series (Figure 
8c), it tends to be offset by the contribution of cov[(b,0,f), 
e] + cov[(b,0,f), e]’ (Figure 8d), except at the first and last 
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few time points. The patterns of variances of seasonally 
adjusted month-to-month changes and year-to-year changes 
(not shown) are similar to that of Figure 8a. The variances 
of the month-to-month changes are slightly larger than 
those of the adjusted series, those of the year-to-year 
changes are larger still. 


4.3 Retail Sales of Drinking Places 


Retail sales of drinking places are estimated in the 
Census Bureau’s monthly retail trade survey. In this 
survey, (noncertainty) sample cases are independently 
redrawn approximately every 5 years, so the covariance 
matrix of the sampling errors is block diagonal. Bell and 
Hillmer (1990) developed the following model for the 
sampling error of the logged series within a given sample: 


(1 - 0.75B - 0.66B? + 0.50B*)(1 - 0.71B")e, 


Sl 1SB)D (4.4) 
with o, = 9.301 x 10°. For time points t and j in different 
samples, cov(e,,e;) =0. Bell and Hillmer developed a 
model for the signal component of the logged series using 
unbenchmarked estimates from September 1977 to 
December 1986. We shall instead use the following model 
fit by Bell and Wilcox (1993) using additional data through 
October 1989: 


GBB) Xb) == 0:23 B) 
(10.882 )a. 


where X, contains trading-day regression variables, and 
o, = 4.16 x 10%. 

In seasonally adjusting this series, the default X-11 filters 
are used. The contribution of error due to estimating 
regression parameters is small for this series, and so is not 
included in the results to follow. Since the contribution of 
sampling error overwhelms the contributions from fore/ 
backcast error and cov[(b, 0, f),e] + cov[(b, 0, f), e]’, we 
also do not illustrate these separate variance contributions. 
Figure 9a gives the standard error of the seasonally adjusted 
data (shown over 232 observations to better illustrate the 
pattern, with vertical lines indicating sample redraws) and 
Figure 9b the standard error of seasonally adjusted month 
-to-month changes. 

Note the strong pattern in Figure 9a, b due to the 
redrawing of the sample every five years. In particular, this 
produces a large spike in the standard error of seasonally 
adjusted month-to-month changes (Figure 9b) when the 
sample is redrawn. Similar jumps in standard deviations of 
year-to-year changes occur for the first year of a new 
sample. We also found similar patterns for other series from 
the retail trade survey using models from Bell and Wilcox 
(1993). 

The preceding discussion and results ignored certain 
aspects of how estimation for the retail trade survey is 
actually carried out. In fact, to avoid large increases in 
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variances of change estimates around the sample redraw, 
such as those reflected in Figure 9b, simple modifications 
are made to estimates in a newly introduced sample to make 
their level consistent with that from the old sample. The 
simplest version of the modification is as follows. Let 
Zvold)t ( = exp( Yoo a) denote estimates from the old sample, 
and Z,.y), unmodified estimates from the new sample. 
Assume that the old sample provides estimates for t < T, 
and that the new sample is to provide estimates for t >t. 
To provide overlap data for the modification, the new 
sample is begun one month early, so that both Zvold)t and 
Z(new)r are available. The modified new sample estimates 
are defined as Ceaeane = Zewyc old)e I Zencwye) for t>7) This 
modification is carried out each time a new sample is 
introduced. In terms of the corresponding logged estimates 
y, the modification is Deco Vege (Yotaye Pile owe 
Since the modification to y, 1s linear, it is easy to account for 
its effects on the seasonal adjustment variance calculations 
here. The month-to-month change at time t + 1 before the 
modification (and without seasonal adjustment) is 
Veen Soe Note that this change has a large 
variance since YQ.4,,; ad Yo\4), come from different, 
independent samples. After modification, this change is 
Veer eee has a much lower variance due to 
strong positive correlation between y...,.; Ad Wry, 
(arising from the the sampling error model (4.4)). 
Unadjusted month-to-month change estimates for time 
points other than t + 1 are unaltered by the modification. 

Figure 9d shows that modifying new sample estimates 
eliminates the large increases in the standard deviation of 
seasonally adjusted month-to-month changes at the transi- 
tions to new samples. Similar effects were seen for year-to- 
year changes over a one year period. The price paid for this 
improvement is a steadily increasing error in the level 
estimates (Figure 9c) following introduction of new 
samples. This occurs because the modification introduces 
a transient error into the level estimates that persists 
throughout the new sample. Thus, the modification trades 
off worse accuracy of level estimates for improvements in 
change estimates. (Figure 9c shows no increase for the first 
five years because we assume the estimates there are not 
modified to agree with those from a previous sample.) 
Moreover, the strong patterns in Figure 9a occur because 
the sampling errors from unmodified estimates in adjacent 
samples are uncorrelated. On the other hand, sampling 
errors in the modified estimates are fairly strongly 
correlated between adjacent samples. The effect of this, 
after applying the seasonal adjustment filter, is a much 
different pattern (almost no pattern) in the first five years of 
Figure 9c, and slight oscillations around the linear increase 
thereafter. 

The standard errors for the X-11 trend estimates and 
changes (not shown) look like smoothed versions of those 
shown in Figure 9. 

In practice, final estimates from the retail trade survey 
are even more complicated than what was just described 
and illustrated. First, more than one month of overlapping 
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Figure 9. Retail Sales of Drinking Places: Samples Redrawn Every 
Five Years. The top panel shows the standard error of the seasonally 
adjusted data and the second panel the standard error of the 
corresponding month-to-month changes. The strong pattern results 
from independently drawing a new sample every five years (at the 
dotted vertical lines). For month-to-month changes, this produces 
large increases in standard errors at the time of the sample redraw. To 
eliminate this problem, a new sample is drawn to overlap with the 
previous sample for one or more months and the new sample’s 
estimates are modified using data from the overlap to make them 
consistent in level with estimates from the previous sample (see text). 
This eliminates the increases in standard errors of change estimates 
when the sample is redrawn (fourth panel), but introduces a transient 
error into the modified level estimates, whose effects accumulate over 
time (third panel). 


data are collected and may be used to modify level esti- 
mates when a new sample is introduced. More importantly, 
monthly estimates are benchmarked to agree with annual 
totals obtained from the more accurate annual retail trade 
survey or five year economic census. Benchmarking should 


thus alleviate the problem of level variances increasing over 
time seen in Figure 9c. However, since benchmarking 
imposes linear sum constraints on the original (unlogged) 
estimates, its effects on seasonal adjustment variances are 
difficult to investigate under the approach developed here, 
and we have not done so. (We have used a model for 
unbenchmarked data to avoid this problem.) Durbin and 
Quenneville (1995) develop a model-based approach to 
benchmarking that accounts for the nonlinearities that such 
benchmark constraints impose on logged data. 


5. CONCLUSIONS 


This paper presented an approach to the long-standing 
problem of obtaining variances for X-11 seasonal adjust- 
ments. Our goal was the development and application of an 
approach to obtain variances accounting for two sources of 
error. The first error source is sampling error (e,), which 
arises because we do not observe the true series, Y,, but 
instead observe estimates y,=Y,+e, from a repeated 
survey. The second error source results from the need to 
extend the observed series with forecasts and backcasts to 
apply the symmetric X-11 filters. This second error source 
leads to seasonal adjustment revisions. To account for 
these two sources of error, we defined the seasonal 
adjustment variance as the variance of the error in using the 
X-11 adjustment to estimate a specific target. This target, 
o(B)Y,, is what would result from applying the symmetric, 
linear X-11 filter, @(B), to the true series if its values were 
available far enough into the future and past for the 
symmetric filter to be used. (The application to additive 
X-11 with fore/backcast extension is immediate, and 
log-additive X-11 is taken as an approximation to multipli- 
cative X-11.) 

Our approach was also applied to produce variances of 
X-11 trend estimates, and to produce variances of month-to- 
month and year-to-year changes in both the seasonally 
adjusted data and trend estimates. A further extension was 
made to allow for error in estimating regression parameters 
(e.g., to model calendar effects), though this was more 
involved and had some limitations. 

The variances we obtain ignore uncertainty due to time 
series variation in the seasonal and nonseasonal com- 
ponents. We argued in section 2 that this may be 
appropriate for typical users of X-11 seasonally adjusted 
data. If one desires to account for this time series variation, 
however, we suggest that consideration be given to 
model-based approaches to seasonal adjustment, since time 
series models provide a means to explicitly account for 
variation in all the components. Alternatively, Pfeffermann 
(1994) developed an approach to X-11 seasonal adjust- 
ments that attempts to account for irregular variation and 
sampling error. 

Our approach builds on the first approach suggested by 
Wolter and Monsour (1981), by accounting for the contri- 
bution of forecast and backcast error that was ignored by 
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them. An alternative view of the difference between our 
approach and theirs is that we define a consistent seasonal 
adjustment target, whereas, in using X-11’s asymmetric 
filters, Wolter and Monsour implicitly used targets that 
change over time. Because of this, our approach avoids the 
unrealistic feature of seasonal adjustment variances that 
decrease towards the ends of the series, which can be seen 
in results of Wolter and Monsour, and also of Pfeffermann. 

In the empirical results presented, the contribution of 
sampling error often dominated the seasonal adjustment 
variances. This is partly because sampling error was often 
large relative to fore/backcast error, and partly because the 
contribution of fore/backcast error tended to be offset by the 
contribution of the covariance of fore/backcast error with 
the sampling error. On the other hand, empirical results for 
trend estimate variances showed large increases at the ends 
of series due to the effects of fore/backcast error. Since the 
largest contribution of fore/backcast error occurs at the ends 
of the series, and variances for the most recent seasonal 
adjustments and trend estimates are of the most interest, one 
should not ignore the contribution of fore/backcast error. 

The relative contribution to our variances of error in 
estimating trading-day or holiday regression coefficients 
tended to be small, unless the series had no sampling error. 
Error due to estimating additive outlier and level shift 
effects was substantial around the time point of the outlier. 
The effects of AOs were large on seasonal adjustment 
variances; the effects of LSs were large on trend estimate 
variances. 

Nonstationarities in the sampling errors produced inter- 
esting patterns in the seasonal adjustment and trend 
estimate variances. Two types of sampling error nonstation- 
arities were examined. Seasonal patterns in sampling error 
variances produced corresponding seasonal patterns in 
seasonal adjustment variances. Independent redrawings of 
the sample, which yield sampling errors correlated within 
but not across samples, produced erratic patterns in 
seasonal adjustment and trend estimate variances over time 
within a sample. These patterns approximately repeat 
across different samples if the samples remain in force for 
approximately equal time spans. 

Computations for the examples shown (given the fitted 
models, which were obtained from the references cited) 
were done by programming the expressions of Sections 2 
and 3 in the S+ programming statistical language. The 
resulting computer code is available on request. 


ACKNOWLEDGEMENTS 


We thank Nash Monsour for providing the FORTRAN 
program to calculate default X-11 asymmetric filter 
weights. In addition, he patiently explained how estimates 
from the monthly retail trade surveys are modified when 
new samples are drawn. This paper reports the general 
results of research undertaken by Census Bureau staff. The 
views expressed are attributed to the authors and do not 
necessarily reflect those of the Census Bureau. 


27 


APPENDIX A 


Several expressions to be calculated in this paper are of 
the general form 
Ax 'B (A.1) 
where & is a positive definite matrix, and A and B are 
conformable to &. Let & = LL’ be the Cholesky decom- 
position of £. Then AZ”'B = A(L!)’L 'B and (A.1) can 
be computed as follows: 


(1) Solve LQ, =B for Q, 
(2) Solve LQ, =A’ for Q, 
(3) Compute AZ'B = Q,Q.. 


(1) and (2) can be solved efficiently since L is lower 
triangular. 


APPENDIX B 


Two steps are required to obtain GX, used in section 
3.3. The first step produces “forecast” and “backcast” ex 
tension of the differenced regression variables. The second 
step uses these results and the difference equation to 
produce forecast and backcast extension of the original 
(undifferenced) regression variables. 

Let R, = A,X,, where A, is that part of the matrix A 
which differences the observed series y ,. Analogous to the 
computation of w, and Ww, in section 2.2, forecast ex- 
tensions of the differenced regression variables are See 
lated as R,= phy 5X5 SRY and backcast extensions as R, 

x, eRe R, ad R, are of the form (A.1) and can ke 
computed by the omens given above. 

For the second step, let x, denote any one of the 
regression variables in X. Let the Slee forecast 
extensions be denoted £, _, for / = 1, 2, ..., m. Let the 
differencing operator in the model be 6(B) = 12 Oba 
6,B qd’ and let 7 , ., be the forecast extension of 8(B)x, = He, 
at time n+l (F, ., 1S an element of R,). The £ are 
calculated iteratively as 


=6,% ee 


Se By ee Ol b= a 


Oe 

where %, ,,=x,,, fj <0. 

The required backcast extensions of x, are denoted £, _, 
for / = 1, ...,m. These are also obtained recursively from 
the difference equation 6(B)f, = F, by solving for £, _, in 
the expression 

My 1 = Oye giy tt 89% t Paes 

and substituting previously computed backcasts as needed. 
Thus, 


ec Os ore pee 
= O71 ape Ok ae 


Oe 4 ase 


4-12-17 Fae -D> 


where: x, _.=x 


ip sy for j < 0. 
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Item Selection in the Consumer Price Index: 
Cut-off Versus Probability Sampling 


JAN DE HAAN, EDDY OPPERDOES and CECILE M. SCHUT' 


ABSTRACT 


Most statistical offices select the sample of commodities of which prices are collected for their Consumer Price Indexes with 
non-probability techniques. In the Netherlands, and in many other countries as well, those judgemental sampling methods 
come close to some kind of cut-off selection, in which a large part of the population (usually the items with the lowest 
expenditures) is deliberately left unobserved. This method obviously yields biased price index numbers. The question arises 
whether probability sampling would lead to better results in terms of the mean square error. We have considered simple 
random sampling, stratified sampling and systematic sampling proportional to expenditure. Monte Carlo simulations using 
scanner data on coffee, baby’s napkins and toilet paper were carried out to assess the performance of the four sampling 
designs. Surprisingly perhaps, cut-off selection is shown to be a succesful strategy for item sampling in the consumer price 


index. 


KEY WORDS: Laspeyres price index; Monte Carlo simulation; Sampling; Scanner data; Substitution bias. 


1. INTRODUCTION 


Outsiders may think that measuring inflation is an easy 
job: just visit shops, collect a lot of prices and average 
them. However, statisticians engaged in the compilation of 
the Consumer Price Index (CPI), which is the most widely 
used measure of inflation, face many theoretical and 
practical problems. In most countries the CPI is essentially 
a Laspeyres price index. This index weights the partial price 
indexes of the various commodities by expenditure shares 
that are fixed at base period levels. Sampling procedures are 
needed to estimate the population value. Ideally, the mean 
square error of the estimator would be minimized. Even 
though the Laspeyres index formula is extremely simple, 
the estimation procedures applied to the CPI make it a 
rather complex statistic. Described in a stylized way, the 
estimation involves three different kinds of samples. A 
sample of households taking part in an expenditure survey 
is used to estimate the commodity group expenditure 
weights. From each commodity group a sample of 
commodities (items for short) is selected. The prices of 
these items are collected in a sample of outlets. 

In this paper we focus on the sampling of items. Only a 
few statistical agencies, e.g., the U.S. Bureau of Labor 
Statistics, use probability sampling to select items to be 
priced. Most others, for instance Statistics Netherlands, rely 
on the judgements of experts working at the central office 
for determining which items should represent the commo- 
dity group. In the past this method could be defended by 
referring to the lack of appropriate sampling frames. Due to 
the rapidly increasing automation of the retail industry, 
registers of consumer goods become more and more 
available, and probability sampling of items comes in sight. 
Before changing over to a new sampling strategy, however, 
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it seems worthwile to experiment with alternative strategies 
in order to assess their impact on the accuracy of the esti- 
mated price index numbers. The question to be answered is 
whether current non-probabilistic selection practices per- 
form worse, in terms of the mean square error, than proba- 
bility techniques. This is the main topic of the present 
paper. Simulation studies were carried out for three commo- 
dity groups, i.e., coffee, disposable baby’s napkins and 
toilet paper. 

Not so long ago, empirical price index number research 
was hampered by the fact that highly disaggregated expen- 
diture and quantity information at the individual outlet level 
was lacking or at best available for small samples. Now- 
adays, some market research firms have managed to set up 
vast micro data bases on sales of consumer goods, espe- 
cially in the field of fast moving consumer goods. These are 
derived from electronic scanning by bar-code reader or the 
associated bar-code typed in at the cashier’s desk. Bradley, 
Cook, Leaver and Moulton (1997) give an overview of 
potential uses of scanner data in CPI construction. Proces- 
sing large scanner data bases is a rather time-consuming 
task. For CPI compilation as such, this could prevent an 
extensive use in the near future. But scanner data certainly 
provide a rich source of information for empirical analysis. 
In addition to studies into sampling, scanner data also 
enable us to calculate price index numbers according to 
different index formulas. The (fixed weight) Laspeyres 
price index does not take the households’ reactions to 
relative price changes into account. We therefore examined 
to what extent the Laspeyres population price indexes of the 
three commodity groups are biased with respect to the 
Fisher price index, an index that does account for 
commodity substitution. 
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Section 2 gives an overview of the scanner data that we 
used. Section 3 addresses four different commodity 
sampling designs. Three of these (i.e., simple random 
sampling, stratified sampling, and sampling proportional to 
size) are probability techniques, whereas the fourth (cut-off 
sampling) is a judgemental one that mimics official 
practices in the Netherlands. Section 4 describes Monte 
Carlo experiments we performed to determine the accuracy 
of the estimated commodity group price indexes under the 
various sampling designs mentioned. Section 5 deals with 
the use of Fisher indexes at the item level and the item 
group level, respectively. The within-group substitution 
bias of the Laspeyres commodity group price indexes is 
shown. Section 6 summarizes and discusses the findings. 


2. BAR-CODE SCANNING DATA 


2.1 An Overview 


Scannable products are defined in Europe by the 
European Article Number (EAN). Manufacturers should 
assign one and only one EAN to every variety, size, type of 
packaging, etc. of a product. This has two implications. In 
the first place, EANs sometimes change very rapidly, for 
instance because of a new packaging. Clearly, this makes it 
difficult to follow a specific item over time. Secondly, some 
EANs have negligible expenditures. It seems that the 
system of classification is too detailed; what is really one 
item has been classified as a multitude of items. In a test 
study using scanner data on coffee, Reinsdorf (1995) also 
found that “items that are, for all practical purposes, the 
same may occasionally have different UPC’s” (the US 
Universal Product Code). Some aggregation over EANSs is 
required. Fortunately, several product characteristics such 
as brandname and subname are included in the scanner data 
sets. We will treat EANs having the same product charac- 
teristics as identical items. If the number of characteristics 
is insufficient, there will of course be a danger of over- 
aggregation, that is of putting heterogeneous items together. 

From A.C. Nielsen (Nederland) B.V. we received 
scanner data sets containing weekly supermarket sales on 
coffee, disposable baby’s napkins and toilet paper. The 
initial data sets contained 320, 569 and 294 different EANs, 
respectively. For each EAN, the number of packages sold 
and the corresponding value is included, together with 
several product and outlet characteristics. Prices are not 
included; average prices (unit values) must be calculated 
from the values and quantities. The coffee data relate to 
sales over a period of two and a half years, beginning with 
week | of 1994 and ending in week 24 of 1996, in a sample 
of 20 supermarkets located in a Dutch urban area unknown 
to us. The data on the other two item groups refer to a 
sample of 149 shops spread over the whole country, and 
cover a period of two years, beginning with week 1 of 1995 
and ending with week 52 of 1996. 


For reasons of convenience we deleted the minor brands. 
In the case of coffee, only the 15 brands with the highest 
turnover during the entire observation period were selected 
from the 55 brands actually sold. After aggregating over 
EANSs with identical product characteristics, we further 
limited the population to those items that were sold in the 
base year 1994 and every month thereafter in order to have 
a complete data set for each month. We ended up with a 
total of 68 items (excluding coffee beans), among which 40 
items of ground coffee (including decaffeinated coffee) and 
28 items of instant coffee. These account for 94.5% of total 
base year coffee expenditure in the initial data set. For 
napkins and toilet paper (leaving out moist toilet paper), the 
brands with a turnover share of less than 1% were removed. 
Next, only those items were selected that were sold in the 
base year 1995 and at least eight months thereafter. This 
resulted in 58 napkins items and 70 toilet paper items, 
accounting for 90% and 86% of total 1995 expenditure in 
the initial data sets. 


2.2 Descriptive Statistics 


The most striking feature of the item expenditures is the 
skewness of the distribution. Figure 1 shows the inequality 
of the base period expenditures in our adjusted data sets by 
means of so-called Lorenz curves. The vertical axis depicts 
the cumulative expenditure total, the horizontal axis the 
cumulative number of items, both expressed as percentages. 
The items are sorted in increasing order of expenditure. In 
case of equal expenditures, the Lorenz curve would lie on 
the diagonal. The more unequal the distribution becomes, 
the lower its position will be. Coffee item expenditures are 
distributed extremely unequal, with the three largest items 
accounting for over half of total base year (1994) coffee 
expenditure. For baby’s napkins and toilet paper the largest 
six and eight items, respectively, account for nearly half of 
total base year (1995) expenditure. 

Figure 2 shows unit value index numbers, that is the 
change in the value per package, irrespective of quantity, 
brandname, type etc., taken over all outlets. This gives a 
first impression of the change in “prices” during the period 
under study. For coffee, there was a remarkable decrease in 
the second half of 1995 following large price rises in 1994 
due to bad harvests in Brazil. Coffee prices are largely 
determined by world market prices for coffee beans. We did 
not find evidence of significant differences in price changes 
between outlets. Baby’s napkins differ in this respect. A 
heavy competition was going on between the various 
producers (which may have caused the decline of the unit 
values during 1996), while discounts and other kinds of 
special actions were offered frequently. Hence, the unit 
value taken over all items and outlets gives an inaccurate 
picture of the aggregate price change of baby’s napkins. 
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Figure 2. Unit value index numbers (1994=100 for coffee, 1995=100 for baby’s napkins and toilet paper) 


3. ESTIMATING LASPEYRES-TYPE 
PRICE INDEXES 


We start this section by introducing some notation. Let 
commodity group A consist of a finite number, say N, of 
commodities (items); g¢A means that item g belongs to 
group A. We assume that A is fixed during time. In real life 
this is not true: some products disappear from the market, 
while new products enter. In the short run, however, the 
constant item group assumption seems reasonable. Note 
that we adjusted our initial data set accordingly. The reason 
behind this is that we want to concentrate solely on the 
sampling aspect. The Laspeyres (fixed weight) price index 
of commodity group A in period tf is 


Dare, Pe 
P! = eA 


; =D, Pe (1) 
Dose ni 


gcA 


where i denotes the price index of item g, e° the 

; 3 : 0 8 
expenditure on g during base period 0 and w, the corre- 
sponding expenditure share of g within item group A. In the 
base period a sample A with fixed size n is taken from A. 
Because A is supposed to be fixed during time, it seems 
natural to keep A fixed as well. 


3.1 Simple Random Sampling 


Probability sampling refers to situations in which all 
possible samples have a known probability of selection. 
Under simple random sampling (without replacement), all 
possible samples have equal o. Hs The 
Horvitz-Thompson estimator =(N/n)y Wet Wydea eis 
unbiased for P‘, that is E (P', )= ay where the expectation 
E(.) denotes the mean over all possible samples under a 
given sampling design, in this particular case simple 
random sampling. Despite its unbiasedness, P’, will not be 
used in practice because of two Weel properties. 
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Firstly, if the price indexes of all sampled items are equal, 
the estimated item group index differs from that value, 
unless the population and sample means of expenditures 
coincide. Price index makers probably dislike this feature. 
Secondly, and more importantly, Pe is bound to exhibit 
extraordinary large sampling variance. To overcome both 
difficulties, P' is estimated by taking unbiased estimators 
of the numerator and denominator: 


(N/n)>° e, Re 
oe SS (2) 
(Nin) e, 8A 
geA 


where Ww, is the expenditure share of item g in the sample. 
Using a first- order Taylor linearization (Sarndal, Swensson 
and Wretman 1992, pp. 172-176), the variance of jae can 
be written as 


VPs) = VP 4) - (PY Qp'pf - 10°, 

where o° denotes the coefficient of variation or relative 
standard error of the sample mean of base period expendi- 
tures, uw’ is the ratio of the relative standard errors of the 
average base pees expenditures expressed in prices of 
period t and 0, and p’ is the correlation coefficient between 
the average base period expenditures in prices of ¢ and 0 
(which is expected to have a positive sign). The choice for P, 
instead of Pi can thus be elucidated by the fact that ie 
former Sais the panel character of the sample; with 
p’ > 1/(2u'), a substantial reduction in variance is expected. 
An alternative expression for the variance of P} p iS: 


VP) = LEY ow} 
ge. 


which can be estimated using sample data provided that the 
sampling fraction f =n/N is known. This formula, earlier 
mentioned by Balk (1989), shows that the variance depends 
on the within-group dispersion of the item price indexes. 
Hence, the variance could be lowered either by constructing 
item groups made up of items having similar price changes 
or by enlarging the sample. Sarndal et al., (1992, p. 176) 
caution that “the Taylor linearization method has a 
tendency to lead to underestimated variances in not so large 
samples”. The CPI item samples are generally quite small. 
For some item groups there may even be only one or two 
representative items. Thus, besides being unstable (having 
a large variance itself), the variance will probably also be 
underestimated when based_ on (3). 

We note that estimator P* p> being a ratio, suffers from 
small sample bias of approximately o(1/n). It can easily s 
verified that its absolute value |B(P 2 <o’v VP Aya lic. 
is small, say less than 0.1, the bias of P, may safely be 
regarded as negligible in relation to its setae error. 
However, with a small item sample and a large variability 
of base period expenditures, o° could easily exceed 0.1 by 
far. We add that the all items CPI is unlikely to be biased to 


PoP ea kM) 


a large extent on this account, since the bias is a (weighted) 
average of positive and negative biases of the various item 
group indexes. 


3.2 Sampling Proportional to Size 


Sampling proportional to size has the advantage that the 
most important items have a big chance of being sampled. 
We will restrict ourselves to fixed size sampling without 
replacement, since this seems most likely to be chosen in 
case of item sampling proportional to size (see for example 
the Swedish case described by Dalén and Ohlsson 1995). 
Base period expenditure acts as our measure of size, and the 
required first-order inclusion probability for item g is 
Te = Neg >/e° =nwg, where e° = me Oe It follows that 
os <4 P,/7 is an unbiased estimator of Pi. 

Sampling proportional to size without replacement, 
combined with the Horvitz-Thompson or 7 estimator, is 
sometimes called mps sampling. Most existing schemes for 
fixed-size mps sampling are draw-sequential and rather 
complicated. We will therefore use systematic mps selection 
instead. This scheme can be described by imagining the 
expenditures e, °(geA) as cumulatively laid out On a 
horizontal axis, “starting at the origin and ending at e°. A 
real number is randomly chosen in the interval (0, e9/, nj, 
and we proceed systematically by taking the items g 
identified by points at the constant distance e°/n apart. 
This method yields exactly the desired sample size. For 
commodity groups with large variation in base period 
expenditures, it may not always be possible to select an item 
ei strictly proportional to expenditure. Obviously, 

< 1 must be satisfied for all g. If n>1 and some e. 
vies are SU Goh large, it may be true for some items 
that ne, eo contradicting the requirement 7, < 1. The 
conflict will be dealt with as follows. The N items are 
Uperes according to descending Pai First, if 
e, Sein we set 1, = 1. Next, if e) >(e? ej 1 (n - 1), 
we also set 1, = 1. The procedure is repeated until the 
requirement for sampling proportional to base period 
expenditure is met for all remaining items. Our recursive 
approach differs somewhat from the method proposed by 
Sarndal et al., (1992, p. 90). They suggest to set 2, = 1 for 
all g with e, > e°/n. In our data sets this would lead to 
unnecessary “large numbers of items with m,=1. The 
subgroup A,, of items with the highest base period 
expenditures which is selected with certainty will be called 
the self-selecting part of the sample. From the remaining 
low-expenditure subgroup A, a sample A With size n, is 
drawn strictly proportional to expenditure. The resulting 
unbiased estimator is an expenditure weighted average of 
P'(H), the population Laspeyres price index of A,,, and 
ee nee ‘/n,, the estimated price index of A,. 


3.3 Stratified Sampling 


The obvious advantage of simple random sampling as 
opposed to sampling proportional to expenditure is that, 
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apart from d register of items serving as a sampling frame, 
no other data are required. See also Balk (1994). With very 
unequally distributed item expenditures chances are big that 
the market leaders fall outside the sample, a situation that 
seems intuitively unappealing. We will argue that it would 
indeed be preferable if they were selected. Recall that the 
variance of the item group price index under simple random 
sampling depends on the within-group dispersion of the 
item price indexes. A variance reduction could be achieved 
if it were possible to stratify the item group into homoge- 
neous subgroups according to their price changes. How- 
ever, a priori knowledge of item price changes is not avail- 
able. Another way to lower the variance might be to stratify 
the item group into two subgroups, one (A,,) with high 
base period expenditures which is observed entirely and the 
other one (A,) with low expenditures from which a ran- 
dom sample A, is taken. The new item group price index 
estimator is an vexpenditure weighted average of P' p(L), 

the Laspeyres index of the low- a Pens Sipe esti- 
mated in accordance with (2), and P'(#). Its sampling 
variance is (1 - a V[P aC L)], where t,, is the expendi- 
ture share of A,, within A. This method docs not necessarily 
reduce the eenance of the estimated price index, but it is 
likely to do so under certain conditions. The variance of the 
new estimator will be smaller than the variance of P}, when 


Pt 
agiieet ca (4) 
se[P,(L)] 


where se(.) denotes standard error. Inequality (4) is 
expected to hold if the item expenditures are distributed 
extremely unequal, since 1 -t,, will then become much 
smaller than |. Stratification may be especially productive 
as the overall sample size n increases. 

The choice of t,, and thus of the size N,, of the “take- 
all” stratum A,, is a bit of a problem. Preferably we would 
have some optimality criterion in order to minimize the 
variance. But since a priori knowledge of item price 
changes is lacking and past trends do not forecast future 
price changes very accurately, the optimal size of A,, can 
hardly be computed in practice. In the empirical analysis we 
will try two different relative sample sizes 1, = N,,/n of 
A,,, namely i,, = 1/3 and i,, = 2/3. These values suffice 
to give a clear indication of the performance. 


3.4 Cut-off Sampling 


When the sample size is very small it seems rather likely 
that stratification with A,, = 2/3 leads to a larger standard 
error of the estimated price index than with A,, = 1/3. But 
what happens if A, is not observed at all, so that A,, = 1 
and thus n = N,,? We would then be using (a special type 
of) cut-off sampling. The item group price index is 
estimated simply by Pe = P'(H). All g€A,, now have an 
inclusion probability Be 1, whereas all geA, have zero 
inclusion probability (Sarndal et al., 1992, pp. 531-533). 
Since we know exactly which items will be selected there 
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is no randomness involved and the sampling variance of the 
P(_ is zero by definition. The bias equals the actual error, 
i.e., the difference between the estimated value and the true 
population index 


Pi,- P'=(1 -1,)[P‘(H) -P'()). () 


With an extremely unequal distribution of item expen- 
ditures, even a small sample size would cause a large value 
for t,,. In that case cut-off estimation may outperform 
stratification, in terms of the mean square error. We may 
either fix the cut-off rate t,,, so that the sample size n is 
determined by T,,, or fix the sample size, in which case pe 
depends on the choice of n. The latter option was chosen by 
us since fixed size sampling designs are common practice 
in selecting CPI items, and because this allows a suitable 
comparison with other fixed size designs. 

The use of cut-off procedures can be justified on the 
grounds that i) the costs prohibit the construction of a 
reliable sampling frame for the whole population, and ii) 
the bias is deemed negligible. Assumption ii) cannot be 
verified in general, of course. The deliberate exclusion of 
part of the target population from sample selection may 
nevertheless give satisfactory results when appropriate 
corrections are made. Statistics Netherlands makes use of 
cut-off sampling in various other business surveys, for 
instance in production and foreign trade statistics where 
very small enterprises are left unobserved. In the Dutch 
National Accounts, that use production and foreign trade 
data as important inputs, explicit estimates are being made 
for small firms. The cut-off method for CPI item selection, 
on the other hand, does not correct for the excluded items. 
In addition to cost-considerations, this method is sometimes 
defended by the belief that, at least in the longer run, the 
price changes of less important items will not differ much 
from those of the market leaders within the same product 
category because of similar production cost structures. 


4. EMPIRICAL ESTIMATION 


4.1 Monte Carlo Simulation 


With the exception of cut-off selection it is difficult to 
find reliable measures of the sampling distributions based 
on a single sample. Under simple random sampling the 
estimator in has an unknown bias whereas variance esti- 
mation peed on Taylor linearization techniques gives 
inaccurate results because CPI item samples are generally 
very small. Systematic mps sampling raises the question of 
how to estimate the variance of the estimator since the 
second-order inclusion probabilities are unknown. To 
obtain the exact sampling distribution we would have to 
consider all samples A that are possible under a certain 
sampling design. For every A the probability of drawing A 
and the estimated value of the commodity group price index 
must be known in order to calculate the exact values of the 
expected value, the bias and the variance of the estimator. 
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This is virtually impossible because of the extremely large 
number of possible samples. To describe the sampling 
distribution, we will therefore carry out Monte Carlo simu- 
lations. A large number of samples, say K, is drawn from 
the (same) population A according to the given design and 
for each sample the estimate is calculated. If K is large 
enough, the distribution of the K estimates will closely 
approximate the exact sampling distribution. Let Pp, denote 
the result for the k-th sample under a certain sampling 
design. Then 


is an unbiased estimate of the expected value E(P'). We 
will calculate 

Pp! » P t 
which is an unbiased estimate of the bias B(P‘); 


K 
1 Pie BS 
ge eS UE Weed 
Pera p= k 
which is an unbiased estimate of the variance VP‘): and 


(Pt - P*)? + Sp, 


which is an approximately unbiased estimate of the root 
mean square error (rmse) of P'. Sarndal et al. (19972. 
p. 280), remark that “the imperfection caused by the finite 
number of repetitions is more keenly felt in the case of a 
variance measure ... than in the case of measures calculated 
as means”. 
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4.2 Results 


Monte Carlo simulations were carried out with three 
different sample sizes: n=3, n=6 and n=12. The number of 
repetitions (K) per experiment was set to 500,000. Table 1 
shows the results for coffee in January 1995 (1994=100), 
tables 2 and 3 those for baby’s napkins and toilet paper, 
respectively, in January 1996 (1995=100). The choice of 
the formula with which individual price observations are 
aggregated into a single item price index is discussed in the 
Appendix. Throughout this section all item price indexes 
are calculated as unit value indexes over all outlets. Simple 
random sampling performs particularly bad. For example, 
with n=3 the true (Laspeyres) coffee price increase of 
17.2% is understated by 1.4%-points. Together with a 
standard error of 5.1%-points, the rmse amounts to 
5.3%-points, that is almost one third of the true price 
increase. Even with n=12, so that the sampling fraction is 
0.18 (which would be unusually large in practical 
situations), the rmse still remains considerably high. Notice 
that, as expected, the small sample bias is halved when the 
sample size is doubled. Stratification works reasonably well 
with larger sample sizes but gives disappointing results with 
n=3. In the latter case, stratification increases the rmse 
compared to simple random sampling for baby’s napkins 
and toilet paper when N,, = 2 (that is, when A,, = 2/3). Our 
favourite probabilistic design would be systematic sampling 
proportional to expenditure because the estimates are 
unbiased and their standard errors relatively low. The most 
surprising finding perhaps is the good performance of 
cut-off selection. Except for n=3 and n=6 in case of baby's 
napkins, this method produces the best results. 


Table 1 
Estimated Laspeyres Price Index Numbers for Coffee (1994=100), January 1995 (N=68) 

Sampling n=3 n=6 n=12 

scheme exp. value se bias rmse exp. value _— se bias rmse exp. value se bias rmse 
SIRa) Sey Shall -1.4 5.3 116.4 3.4 -0.7 3.5 116.7 Bo -0.4 BS; 
ps NEDA, © 32,02 0 DG) eZ 13) 0 1.3 WGA? 0.7 0 0.7 
Stratified 

Ay = 1/3 1164-3195) 7-07 4.0 116.6 DS -0.5 D8 117.0 lp -0.1 I2 
Ay = 2/3 NIG ohy RS) ile) 4.7 116.4 Des) -0.7 2.6 117.0 si -0.2 est 
Cut-off HIG -0.2 0.2 NAD 0 0.0 0.0 es 0 0.3 0.3 

*) Simple random 
Table 2 
Estimated Laspeyres Price Index Numbers for Baby’s Napkins (1995=100), January 1996 (N=58) 

Sampling n=3 n=6 n=12 

scheme exp. value se bias  rmse Expy valucuamerse bias rmse exp. value se bias rmse 
SR. O94 .0 23 555) 98.7 3.9 IES 4.2 97.9 29) 0.8 3.0 
Tps Qifph Baebes 0 2.8 97.2 1.6 0 1.6 O72 1S) 0 1) 
Stratified 

d,, = 1/3 98.9 5.0 1.8 3.8) 98.1 358) 1.0 3.4 97.4 7 0.2 Nea 
Ay = 2/3 98.3 5.8 ill 5.9 97.4 3.3 0.3 oy) 97.0 1.6 -0.2 1.6 
Cut-off Op.) —C -5.1 5.1 93.4 0) -3.8 3.8 95.5 0 -1.6 1.6 
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Table 3 
Estimated Laspeyres Price Index Numbers for Toilet Paper (1995=100), January 1996 (N=70) 

Sampling n=3 n=6 n=12 

scheme exp. value se bias rmse exp.value se bias rmse exp. value se bias rmse 
S.R. 1039) > 44:5 0.1 4.5 103.9 on -0.1 85) 103.9 2.6 0.1 2.6 
mps 103.9 3.4 0 3.4 103.9 1.8 0 1.8 103.9 eZ 0 ee 
Stratified 

de, = 1/3 103.5 43 -0.3 4.3 103.7 3 -0.1 322 104.0 Dal 0.1 2.1 
A, = 2/3 103.7 46 -0.2 4.6 104.2 3.4 0.4 3.4 103.9 1.6 0.0 1.6 
Cut-off 105.0 0O if el 104.0 0 0.1 0.1 104.0 0 0.1 0.1 


For coffee we also tried another form of stratified 
sampling. The entire population of items was subdivided 
into ground coffee and instant coffee, and we took random 
samples from each stratum. Although the price changes of 
instant coffee are smoothed and lag behind as compared to 
ground coffee, Monte Carlo results using stratified 
sampling were similar to those using unstratified sampling 
for all four sampling methods. This contradicts earlier 
findings (see De Haan and Opperdoes 1997a). The reason 
is that we deleted some instant coffee items for this study to 
have a complete data set for each month, and ended up with 
a minor fraction (8%) of instant coffee in total base year 
coffee expenditures. 

It would be hazardous to draw conclusions about the 
performance of the various sampling designs based on 
simulations for one particular month since it is likely that 
the outcomes depend on the frequency distribution of the 
item price indexes. Figure 3 shows these distributions for 
coffee and baby’s napkins in two months. Both distribu- 
tions move to the left, indicating that the unweighted mean 
has declined. Apart from that, the frequency distribution for 
coffee remains quite stable. The shape of the curve for 
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napkins, on the other hand, changes dramatically; the 
variance of the item indexes has grown. 

Monte Carlo experiments were run for each month of the 
period under study. Figure 4 shows the rmse with n = 3. 
The pattern that emerges for coffee and toilet paper is 
surprisingly robust: cut-off selection always comes out as 
best. Apparently, if sample sizes are small, the exclusion of 
the smaller items does not seem to matter much. This is 
what many statistical offices have been appreciating for a 
long time, without being able to test it empirically before. 
The reason why cut-off selection performs better than 
sampling proportional to expenditure is in case of toilet 
paper partly caused by the fact that there is no self-selecting 
part under the latter sampling scheme. With larger samples 
the results under cut-off selection and sampling propor- 
tional to size are very much alike. For baby’s napkins the 
outcomes differ somewhat. Because of the high volatility of 
the item indexes, the rmse under cut-off selection varies 
considerably; it seems to meander around the rmse resulting 
from systematic sampling proportional to expenditure. The 
high variability of the error can be considered a drawback 
of cut-off selection. 


Baby’s napkins (1995=100) 


Figure 3. Frequency distribution of item price index numbers 
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Figure 4. Rmse of estimated Laspeyres price indexes (n=3) 


5. THE USE OF FISHER INDEXES 


5.1 Unit Value Versus Fisher Item Indexes 


In section 4 the item price indexes were calculated as 
unit value indexes over all outlets. To assess the impact of 
the choice of the item index formula on the outcomes of the 
simulation study, Table 4 compares Monte Carlo results 
with n=3 based on unit value item index numbers (as in 
tables 1-3) and Fisher item price index numbers; see the 
Appendix for details. For coffee, we notice hardly any 
differences. For napkins and toilet paper, on the other hand, 


the rmse decreases when Fisher index numbers are used 
instead, especially in case of simple random sampling. This 
is caused by the fact that unit value indexes tend to show a 
more erratic pattern. If physically identical types of napkins 
or toilet paper are deemed heterogeneous across outlets, so 
that the Fisher formula would be more appropriate, the use 
of unit value indexes overstates the price variability of 
particularly small items and exaggerates the poor perfor- 
mance of simple random sampling. Nevertheless, we would 
still have to conclude that simple random sampling does not 
work very well. 
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5.2 Within-group Substitution Bias 


Many statistical agencies and users are of the opinion 
that the CPI should be an approximation to the true cost of 
living index. This theoretical concept is derived from 
microeconomics and measures the change in the minimum 
costs for a representative consumer, or household, neces- 
sary to retain the same standard of living or utility. Since 
utility cannot be measured, a feasible index formula should 
be chosen that closely approximates the concept. Diewert 
(1976) showed that (what he calls) superlative indexes 
provide second order approximations to the cost of living 
index. The most important feature of superlative price 
indexes is that they take account of consumers’ substitution 
towards goods and services exhibiting relatively small price 
increases. These index formulas make use of expenditure 
data relating to both the base period O and the current 
period t. In practice it takes some time before expenditure 
data are known, so that superlative indexes cannot be 
compiled in real time. For the sake of timeliness most 
national statistical offices adopt the Laspeyres (fixed 
weight) formula for constructing their CPIs. 
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The Fisher index is one of the best-known superlative 
indexes. When applied to the item group level, the diffe- 
rence between the population price indexes calculated 
according to the Laspeyres and the Fisher formula can be 
interpreted as within-group item substitution bias 
(Figure 5). For coffee it is less than 1%-point per year. For 
toilet paper and particularly for napkins the biases are very 
large, about 1.5-3%-points per year. Within-group substi- 
tution bias is generally positive and increases over time. 
Notice, however, that for baby’s napkins in a few months of 
the first half of 1996 the Laspeyres index numbers are lower 
than the Fisher index numbers. This unexpected effect, and 
possibly also the large magnitude of the positive bias in 
other months, may be due to a deficiency of the data set 
which only contains supermarkets. It is well-known that 
baby’s napkins are bought in the Netherlands also in other 
kinds of shops such as drugstores that do not make use of 
bar-code scanning. Substitution between the included and 
excluded outlets in the data base may damage our popu- 
lation index numbers as accurate approximations of the true 
values. We are convinced though that it does not seriously 
affect the assessment of the sampling methods presented in 
section 4. 


Estimated Laspeyres Price Index Numbers Using Alternative Item Indexes (n=3) 


Napkins, January 1996 (1995=100) 


Toilet paper, January 1996 (1995=100) 


(2) () (2) 


Table 4 

Sampling Coffee, January 1995 (1994=100) 
scheme (1) (2) (1) 

exp. rmse exp. rmse exp. rmse 

value value value 
SeRes) MSI 7 5.3 115.8 She) 99.4 De) 
ps aD DD ieee DD 97.2 2.8 
Stratified 
dy = 1/3 116.4 4.0 116.5 4.0 98.9 S)3} 

ee) 115.6 4.7 115.6 4.8 98.3 5.9 

Cut-off 117.0 0.2 117.0 0.2 SY) 5.1 


(1) Based on unit value item index numbers 
(2) Based on Fisher item index numbers 


exp. rmse exp. rmse exp. rmse 

value value value 

100.4 4.2 103.9 4.5 104.0 35) 
98.6 Dal 103.9 3.4 104.3 3.6 
100.1 4.1 103.5 4.3 103.3 3.6 
99.5 4.6 103.7 4.6 103.2 3.9 
94.8 3.8 105.5 ell 104.7 1.0 


—o— Toilet 
paper 
—t— Baby’s 


napkins 


—t— Coffee 


Figure 5. Difference between Laspeyres and Fisher population price index numbers 
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6. DISCUSSION 


Although bar-code scanning data have some defi- 
ciencies, they provide an excellent opportunity to undertake 
empirical research into various sampling issues concerning 
CPIs. Our simulations show that, for coffee, disposable 
baby’s napkins and toilet paper at least, simple random 
sampling of items should be advised against. We believe 
that this recommendation can be extended to all item groups 
where the distribution of expenditures is very skewed. If 
statistical offices want to apply probability sampling, they 
would do a better job using sampling proportional to 
expenditure. However, cut-off selection might be a good or 
even better alternative for those item groups where the 
various item price changes are not too volatile. As a matter 
of fact, as far as we are aware this is the first study to supply 
empirical evidence in support of cut-off CPI item selection 
methods. Aggregated scanner data — that is, scanner data 
aggregated over outlets — should give a clear indication of 
the required cut-off rate. Statistics Netherlands already 
made use of aggregated Nielsen data on a range of 
commodity groups in the past in order to select items for the 
CPI sample. 

Cut-off methods are applied extensively in the 
Netherlands and many other European countries (Boon 
1997). In the Netherlands the actual item selection is a little 
more complex than the situation described above. First, a 
number of item subgroups instead of specific items are 
chosen using the cut-off method. Next, a number of specific 
items are selected from each subgroup through so-called 
judgemental sampling. The selection of these representative 
items is based on the judgement of experts working at the 
central office who should have a firm knowledge of the 
consumer market in question. Usually the most frequently 
bought items or those with the highest turnover will be 
selected, so that the entire sampling scheme is a two-stage 
cut-off procedure. It is unlikely that such a two-stage 
method would yield results much different from the 
single-stage procedure we have used in this paper. 

In some other European countries, e.g., the United 
Kingdom, cut-off selection does not take place at the central 
office but by field staff at the outlets where prices are 
measured. To illustrate this method, we choose one item per 
outlet, namely the item with the highest base period sales in 
the outlet. For coffee, baby’s napkins and toilet paper this 
yields 2, 12 and 24 different items, respectively. The 
Laspeyres item group index is estimated in accordance with 
expression (2), where the item price indexes are calculated 
as outlet-specific unit value indexes and weighted by 
outlet-specific weights. Figure 6 shows the rmse resulting 
from this method. If we compare this with Figure 4 (cut-off 
selection done at the central office for n=3), the accuracy of 
both cut-off selection methods seems “on average” to be of 
the same order of magnitude, although the pattern is slightly 
more erratic under selection at the outlets. But such a 
comparison is quite arbitrary. Why not compare cut-off 


selection at the outlets with cut-off selection at the central 
office for n=6, or n=12, or indeed for any other sample 
size? Another problem is that we treated the item price 
indexes as if they were known with certainty. In reality they 
will be based on a sample of outlets, so that our results are 
conditional on this sample. For a proper assessment of both 
cut-off selection procedures we need to take both the 
sampling of items and the sampling of outlets into account. 
However, that is beyond the scope of this paper. 

Scanner data not only offer challenging perspectives for 
statistical research in the field of CPI sampling issues, they 
also enable us to compile all sorts of index numbers, 
including superlative indexes, using real and highly disag- 
gregated data at the individual outlet level. We demon- 
strated that the Laspeyres item group price indexes used by 
Statistical agencies can be biased by more than +1%-point 
on a yearly basis with respect to the (superlative) Fisher 
price index that accounts for item substitution. A related 
type of bias, caused by neglecting products that are intro- 
duced after the base period (see e.g., Boskin, Dulberger, 
Gordon, Griliches and Jorgenson 1996), was not addressed 
by us. Scanner data do provide a good opportunity to 
investigate this new goods bias. 
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Figure 6. Rmse resulting from cut-off selection at the outlets 
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APPENDIX: THE CHOICE OF THE 
ITEM INDEX FORMULA 


To perform sampling simulations we need item index 
numbers. What index formula should be chosen? Statistical 
offices are generally forced to calculate indexes at the 
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lowest level of aggregation based on price data alone 
because quantity or expenditure data is lacking. See Szulc 
(1987), Dalén (1991), Balk (1994), and Diewert (1995) for 
a comprehensive treatment of this subject. With scanner 
microdata at hand, we are in the unique position to 
construct genuine price indexes (Silver 1995, Hawkes 
1997). Consider a set of outlets B,, assumed fixed during 
time, where item g can be bought; b€B, means that g can 
be bought in outlet b. The price of g at outlet b in period s 
(s = 0,4) and the corresponding quantity sold are denoted 
P,, and x,,, respectively. The item will be taken as the 
lowest aggregation level where price indexes are 
constructed. As a start we restrict ourselves to item indexes 
that can be written as ratios of weighted arithmetic mean 
prices in period ¢ and period 0: 


ay t 
DS Wop Pee 
t beB, 


re u On 
Pa Wine 
beB, 


(6) 


where w,, =X,» /) yep Xe» denotes the share of outlet b in 
the total quantity sold“of item g in period z(z=s,u). If 
u =O and s =t, the prices in period O and period ¢ are 
weighted by the corresponding relative quantities. The ave- 
rage prices are called unit values, and P! is a unit value 
index. De Haan and Opperdoes (1997b) and Balk (1998) 
discuss its merits. Adding up quantities makes sense only if 
item g can be conceived of as being homogeneous, that is 
identical across all beB. Unit values then yield the appro- 
priate average transaction prices and the unit value index is 
the appropriate item price index. 

The problem, of course, is to define homogeneity. It can 
be argued that physically identical products sold in different 
outlets are not identical items because of different services 
that accompany the transactions, so that homogeneity 
across outlets never occurs. Another index formula should 
then be chosen. If u = s in expression (6), ee can be called 
a fixed quantity price index with u acting as the quantity 
reference period. For u=s=0, P i turns into the Laspeyres 
price index, and for uv =s = 7, De is the Paasche price 
index. On theoretical grounds we cannot favour either one. 
For reasons of symmetry it seems natural to take the 
(unweighted) geometric average of the Paasche and the 
Laspeyres index, which is the Fisher (ideal) price index. 
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Robust Calibration Estimators 


PIERRE DUCHESNE’ 


ABSTRACT 


We consider the use of calibration estimators when outliers occur. An extension is obtained for the class of Deville and 
Sarmdal (1992) calibration estimators based on Wright (1983) QR estimators. It is also obtained by minimizing a general 
metric subject to constraints on the calibration variables and weights. As an application, this class of estimators helps us 
consider robust calibration estimators by choosing parameters carefully. This makes it possible, e.g., for cosmetic reasons, 
to limit robust weights to a predetermined interval. The use of robust estimators with a high breakdown point is also 
considered. In the specific case of the mean square metric, the estimator proposed by the author is a generalization of a Lee 
(1991) proposition. The new methodology is illustrated by means of a short simulation study. 


KEY WORDS: Calibration estimator; Regression estimator; Range restrictions; Robustness. 


1. INTRODUCTION 


The problem of outliers is an important one in all 
branches of statistics. In sampling theory, the background 
is different from that of parametric statistics since the 
objective is often to estimate the total of a variable of 
interest y. An outlier may have its full weight within the 
population total. Moreover, methodologists may assume, 
at the estimation stage, that the values of units are recorded 
without error, since the gathered units are often processed 
within an editing system (Sarndal, Swensson and Wretman 
1992, section 1.7). This step is part of the sampling proce- 
dure in large statistical agencies such as Statistics Canada. 
Lee (1995) has provided an overview of robustness 
developments within sampling theory. 

Nevertheless, since populations for economic surveys are 
often asymmetric, some units might be extreme as compared 
to others, as was discussed by Kish (1965). The complete 
elimination of such units would lead to biased estimates, 
while maintaining them with their full weight might make an 
estimator such as the generalized regression (GREG) 
estimator highly variable. This would suggest a compromise 
between bias and variance. When outliers occur, the 
challenge is to propose robust estimators of the total that are 
little affected by certain units that deviate sharply from 
others. Such estimators should have little bias and a small 
mean square error. Traditionally, sampling theory has been 
deeply involved in the development of unbiased or 
asymptotically design unbiased (ADU) estimators. See for 
example Sarndal et al., (1992, Section 7.12). However, this 
ADU property is perhaps undesirable within the context of 
outliers. This was discussed by Chambers and Kokic (1993), 
who showed the conflict between the ADU property and the 
robustness of an estimator. 

We consider the Horvitz-Thompson (HT) estimator 
defined by Toma) dys where d, =n, , , being the 
inclusion probability (If A is a set of units, A c U, then )’, 


is a notation signifying )’,.,). Let us assume a positive 
variable of interest y and an asymmetric population. As the 
HT estimator is a mean weighted by the d Ap it is vulnerable 
to large values of y. A unit with a high weight d, may also 
have a considerable impact on the estimation step by 
including variable estimates. Lee (1995) defined these units 
as influential. An extreme unit is not necessarily influential 
if its weight d, is sufficiently small. Traditionally, metho- 
dologists have sought to limit the impact of influential units 
when they are known prior to sampling, by assigning for 
example sampling weights close to 1 to extreme units. 
Gambino (1987) and Lee (1995) have nevertheless 
discussed situations in which this cannot be done. In a 
major article, Hidiroglou and Srinath (1981) considered 
changing the sampling weights when outliers occur. Their 
approach gave much legitimacy to weight modification 
within sampling procedures. 

Many of the first robust alternatives to the total were 
based on M estimators and GM-estimators. Nevertheless, 
much interest has been shown recently for estimators that 
also provide good overall robustness, as measured by the 
breakdown point of an estimator. These concepts are 
discussed for example in Donoho and Huber (1983), 
Hampel, Ronchetti, Rousseeuw and Stahel (1986) and 
Rousseeuw and Leroy (1987). The breakdown point mea- 
sures the percentage of outliers within the sample that the 
estimator can tolerate while providing nonetheless a good 
estimate of a given characteristic of the population. Lee, 
Ghangurde, Mach and Yung (1992) required estimators of 
the total that were based on robust estimators with a high 
breakdown point. 

We will be considering calibration estimators of the total 
T, written as )’ w,y,. These estimators were developed 
for example in Deville and Sarndal (1992). We are looking 
for weights w, that are as close as possible to sampling 
weights d, = 7, ' while meeting benchmark constraints, 
denoted CE (also known as calibration constraints), 


' Pierre Duchesne, Département de Mathématiques et de Statistique, Université de Montréal, C.P. 6128, succursale centre-ville, Montréal, Québec, H3C 37. 
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Weta De (1.1) 


where x, is a vector of dimension m that corresponds to the 
available auxiliary information of known total T, = )',, x,. 
These estimators are popular as they are easily interpreted, 
since methodologists are used to assigning weights w, to 
units y,. Several metrics are studied to measure the proxi- 
mity between d, and w, The GREG estimator is an 
important example with w, =d,(1 + (T,-Ty;,)'M, x,/c,), 
where M =)" d,x,xj/c,. Itis obtained by minimizing the 
mean square metric ye, = a hee Constants c, are 
weighting factors which can take into account problems of 
heteroscedasticity (for example). Sarndal (1996) discussed 
the selection of these constants. However, since the g- 
weights g, = w,/d, of the GREG estimator are not gene- 
rally restricted, other metrics are proposed as a means of 
limiting them so that they might meet certain constraints 
applicable to the range of values (CARV). Specifically, 
this makes it possible to avoid undesirable negative weights 
w,. See Deville and Sarndal (1992), Singh and Mohl 
(1996) and Stukel, Hidiroglou and Sarndal (1996). 

As was noted by Fuller, Loughin and Baker (1994, 
p. 81), there is a link between calibration estimators and 
robust methods. However, it is wrong to assume that 
calibration estimators necessarily have good properties of 
robustness, given that all the calibration estimators 
considered by Deville and Sarndal (1992) were asympto- 
tically equivalent to the GREG estimator, which, being 
ADU, is not robust. Moreover, a traditional calibration 
estimator is not robust as it depends linearly on w,,and w, 
and does not take into account y,. 

The purpose of this paper is to build estimators in the 
form of )’ w,y, where the weights w, provide robustness 
while meeting constraints on the calibration variables and 
the weights w,. The starting point of our approach is the 
class of Wright (1983) estimators QR. Let us assume we 
have available constants {(q,,7,),9,>0,7r, 20, VkEU}, 
such that )’,,2,q,x,x, >0 and )’ ¢,x,x,>0, Vs. (If A is 
a symmetric matrix, A>Omeans that A is definite as 
positive.) The QR estimators are defined on the basis of q, 
and r, by the relation 


eee TB eer er (1.2) 
where B, assumes a form weighted by the q 
oe = py Gee Dy, DX K> (133) 
and 
e =, XB, (1.4) 


It will be shown in section 2 that the QR estimators are 
calibration estimators, and a new class of estimators, 
denoted RQR, will be introduced, also based on the choice 
of constants q, and r,. It generalizes to a certain extent 
the QR estimators as well as the class of Deville and 
Sarndal (1992) estimators. The RQR class is interesting in 
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that it makes it possible to obtain weights w, that are 
limited to a given interval, say [L, U]. Some of the 
properties of classes QR and RQR are provided in 
section 2. 

Section 3 describes applications of the RQR class in the 
building of robust calibration estimators. The main goal is 
to modify robust default weights so that they meet 
calibration constraints. Section 3.1 discusses the choice of 
constants q, and r, using arguments suited to calibration 
estimators. This is a new and unifying approach, and in 
section 3.2 it guides our choice of q, and r, when there is 
auxiliary information. One important element is the use of 
a robust estimator allowing for the weighted form (1.3), 
providing the q,. Note that this is the case for GM- 
estimators. Usually, estimators with a high breakdown 
point do not have a weighted form. Consideration is given 
to reweighting these estimators, allowing the breakdown 
point to be kept under control and making it possible to 
have estimators written in the form (1.3). See Rousseeuw 
and Leroy (1987) and Simpson and Chang (1997). We then 
discuss the choice of q, and r,, so as to calculate an RQR 
estimator and obtain a robust calibration estimator with 
restricted weights. Various robust estimators, including the 
Lee (1991) estimator and the Chambers (1986) estimator, 
are compared in section 4 with RQR estimators as well as 
with the GREG estimator and one calibration estimator 
considered in Deville and Sarndal (1992) whose weights 
are limited. The Lee (1991) estimator can be considered a 
specific case of our approach. It allows us to also consider 
a new estimator with restricted weights. Four populations 
that have already been studied in the literature are 
considered. It will be noted that estimators free of weight 
constraints are subject to negative weighting problems. 
With the RQR class of estimators, robust estimators having 
positive weights can be obtained, and they compare well 
with estimators free of weight constraints. Finally, 
conclusions are drawn in section 5. Appendix B contains 
a list of abbreviations, and Appendix C contains a list of the 
various constants found in this paper, with definitions. 


2. RQR CLASS ESTIMATORS 


Consider a finite population U = {1, 2, ...,N} of size N 
whose total 7), = ys y ¥;, We wish to estimate for a variable of 
interest y that is positive. A sample s of size n, is drawn 
following a sampling design p(s). The inclusion probability 
of a unit k is denoted 7,, and the second-order inclusion 
probabilities are denoted 1,,. We assume that the auxiliary 
information x, is of unit value, i.e., x, is known from a 
reliable source Vke U. 

Wright (1983) introduced a class of QR estimators 
written in the form (1.2) with the primary objective of 
unifying a large number of common estimators. We find 
the best linear unbiased prediction (BLUP) estimator of 
Royall (1970) derived from the model-based theory, 
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obtained by assuming (q,,7,) = (1/c,, 1), and the GREG 
estimator of Cassel, Sarndal and Wretman (1976) by 
considering the choice (q,,7r,) = (d,/c,,d,). Alternately, 
(1.2) can be written as 


Tyor * pas 18 Vps 


where d, g, satisfies 


CP Pa GMs Fy (2; UX) Xe (2.1) 
with Un =)).7,%, Assuming r,=d,, g, corresponds to 
the g-weight of the GREG estimator. 

The QR estimators are calibration estimators, obtained 
by minimizing the mean square metric subject to the CEs 


acl 
min— >, (w, -7,)°/4,, as of Mas Weta n 7(.2) 


The weights w, are chosen as close as possible to the r, 
and the q, are weighting factors. In other words, the 
starting weights r, are transformed into calibration weights w, . 
The solution to problem (2.2) is w, = d,g,, where d,g, is 
given by the formula (2.1). 

Nothing, however, guarantees that the weights w, of the 
QR estimator are positive, which might be undesirable in 
practice. See Brewer (1994), who formalized the interpre- 
tation of weights. To limit the weights w, in [L, U], we 
wish to resolve 


min), GWidgT)> 


as of )). w,x,=T, and w,€[L,U]. (2.3) 
The calibration estimator of the total is 
T RoR a se Wie (2.4) 


where the w, are obtained by resolving problem (2.3). It is 
assumed that function G(w; q, r) is strictly convex and can 
be derived in w for fixed r and g. We denote g(u;q,r) = 
G'(u;q,r) and h(u; q,r) =g\(u;q,r). Moreover, it is 
assumed that h(0;q,r)=r and h’'(0;q,r) =q.The 
resulting estimators are called QR (RQR) restricted calibra- 
tion estimators. 

Fuller et al., (1994) favoured regression estimators 
having reasonable invariance properties. It can be shown 
that RQR estimators are regression equivariant and to scale 
when constants q, and r, are transformation invariant. 
Useful definitions may be found in Bolfarine and Zacks 
C1992). 

There is no guarantee that there is a solution to problem 
(2.3). We refer to the simulation study in Stukel et al., 
(1996). There may, for example, be realizations of the 
sample for which even the CEs cannot be satisfied (1.1). 
Thus, the sample is so imbalanced that it is impossible for 
the weighted sum of the components for each dimension to 
provide the corresponding population total. The only 
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recourse for the practitioner, then, is to relax the constraints 
by reducing the dimension of the number of auxiliary 
variables. See also the discussion in Fuller et al., (1994). 
As for the calibration estimators considered in Deville and 
Sarndal (1992), it was shown, in result 1, that there is a 
solution with a probability approaching one. Under certain 
conditions, this result can be adapted to class RQR 
estimators. 

The metric on which we will focus our attention so that 
the weights may satisfy the CARVs is a slight modification 
of case No. 7 in Deville and Sarndal (1992). We call it the 
restricted mean square metric. The G-function that corres- 
ponds to the choice of this metric is 


1 ; 
me: = a HIGE if w,e[L, U], 


00 otherwise, 


GW dp 7%) = 


whereas the /-function is 


L Pucats pe Bu cS 
AM Qt) =) EAU et OX MELL, UI, 
U TA ene Cs 


Given this modification, it is the weight w, that is con- 
strained and not only w,/d, as for case No. 7 in Deville and 
Sarndal (1992). In our situation, w, can “correct” an initial 
weight that is an outlier. It will be noted that, as it is 
formulated, the Deville and Sarndal metric (1992) subtly 
inserts the constraints on the w, in the G-function. In order 
to calculate the estimator (2.4) according to this metric, it is 
sufficient to follow the same approach as Deville and 
Sarndal (1992), which leads us to a solution, using 
Newton’s method, for the following equation in A 

DI aT itp ot ,. (2.5) 
The final estimator is leon =) h(x 3 p>) Y,> Where 1, 
is the solution to equation (2.5). 

It is interesting to know whether the weight constraint 
changes the properties of the estimator as compared to a QR 
estimator that is free of weight constraints. The following 
result (as proven in the Appendix) shows that, under certain 
conditions, the two estimators are asymptotically equi- 
valent. In practice, using the restricted mean square metric, 
we have not observed any significant deviations. 


Proposition 1. According to hypotheses C, and C, given 
in the Appendix, 
(2.6) 


NUT 


7 = -1/2 
ORL l=o,(n i 


yRQR 

This result can possibly be obtained using the approach 
leading to result No. 5 in Deville and Sarndal (1992) 
dealing with the asymptotic equivalence between the 
GREG and calibration estimators considered by the authors. 
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However, proposition | is of some use to understand the 
type of conditions needed to reach the result described in 
our situation. 

Since (1.2) shows the same asymptotic behaviour as 
quantity T/B, + x, w,E,, where E, =y,-x,B, and B, = 


(Lut Sqex, 2h). IV" yn iS ne Mould suggest “as 
variance siimator 


= DY, Aum.) 0%), (2.7) 
where A 10, My Ay, = =A li; and e, are given by 
(1.4). See Sarndal et al. (1989) and Sarndal et al., (1992, 
p. 234). It can be shown that the asymptotic bias of aQR 
estimator is given under general conditions by 


OCD eee alt) ony ee (Tegra sale 


Then, a possible bias estimator is b =) d,(m,r, - 1)e,, 
which can be used in conjunction with formula (2.7) to 
build an estimator of the mean square error for a QR and 
RQR estimator, using proposition 1. 

RQR estimators make it possible to obtain calibration 
estimators with constrained weights. Given set q, and r,, 
it is sufficient to resolve problem (2.3). In the sections 
which follow, the RQR class is applied within a context of 
robustness. We will show how to direct the selection of 
constants q, and r,, chosen in practice using sample s. 


3. BUILDING ROBUST AND CALIBRATED 
ESTIMATORS 


3.1 Methods Based on Weight Reduction and Value 
Modification 


Lee (1995) discussed various propositions based on the 
weight reduction method for simple random sampling. 
Once outlier observations have been detected, these 
methods consist in reducing the weight of extreme obser- 
vations. These methods are to be preferred to those which 
eliminate doubtful observations entirely, since all the 
observations in the sample are legitimate, as was discussed 
by Lee et al., (1992). 

With respect to calibration estimators, we begin by 
considering the situation in which there is no auxiliary 
information available and the only constraint is )’ w, = N. 
This case will guide our path. Consider the QR estimator 
with q,=r,. For the sake of our discussion, we consider 
constants r,, known and fixed. The weights minimizing 
Q2) ane to )iw,=N are w,=C,(r)r,, where 
CG@on= NI) 73.80 that (ie p becomes 


Ty or IC) TNE 


Whenever an observation is extreme, it might represent few 
units like itself within the population, and its weight should 


(3.1) 
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perhaps be reduced. In order to satisfy the CEs, this means 
finding weights w, that come closest to the sampling 
weights d, for units which are not outliers but come as 
close as possible to a reduction factor r for outlier units, 
where r is chosen by the statistician. Specifically, we denote 
s =5,US,, where s, of cardinality n, represents those 
units that are not reported as outliers, whereas s, = 5 - s, of 
cardinality n, =n -n, represents the outlier units of s. The 
reduction factor r will typically satisfy r< d,, Vk es,. For 
example, eae, the estimator (3.1) with q,=r,= 
B,=4,1,, +rQ -1,,), where I,, is the variable indicating 
ainitation to 's,- in "his way, coneiaat q, and r, are 
reduced for init of s, so as to reflect the fact that units of s, 


are extreme. The Sihidin (3.1) becomes 


r. QR c CLES dV, : pe y,): 


In the case of simple random sampling, d, = N/n and we 
obtain 


A 


Prog = C(B)t 


yB? 

where iB =N/n¥ 1 y¥, +1 Loy, is the Bershad (1960) 
estimator discussed in Lee (1995). Other methods based on 
weight reduction have been discussed in Lee (1995), who 
also discussed the choice of r. 

One disadvantage of methods based on weight reduction 
is that the analyst must identify the outlier units. Methods 
based on value modification avoid this difficulty by 
providing gradual weight reduction for units that are more 
extreme. We consider a case of simple random sampling. 
We assume 

m(y,,1, a,b) =b #(a —b) min (177/y, ). (3.2) 
Thus, this function assigns a starting weight of value a for 
the y, <t, and gradually reduces this to a final weight D, as y, 
becomes extreme. Value f¢ is called the threshold. The 
constants a, b and t are chosen by the statistician. Several 
values for a and b have been considered in the literature. 
Thus, instead of assigning a fixed reduction factor to the 
units of S5, we select q, =r, = Ww, =m(y,;t, N/n,fN/n), 
where fis a constant between 0 and 1. The estimator (3.1) 
becomes 


T QR z CAW) Ye. WY, 
= GOW) is, 


The estimator tee has been discussed in Gross, Taylor and 
Lloyd-Smith (1986) as well as in Chambers and Kokic 
(1993), who called it the winsorized estimator. This is a 
special case of the approach used by Chambers (1982, 
1986). When f = 0, the estimator (3.1) becomes 
Ton = CCW) Ty, with q, = 7, = W,,=m(y,5 6 N/n, 0), 
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where Ty, = N/n(¥,¥, + Nyt), denoting the part of s 
containing units that satisfy y, <t. The estimator E w, has 
been discussed in Lee (1995), as well as in Gross et al., 
(1986), who called it the type I winsorized estimator. When 
f =n/N, Gross et al., (1986) called it the type II winsorized 
estimator. It has also been discussed in Bruce (1991). 

In a design aps, raves (1987) inserted the design by 
assuming D, = =m(y,5 t,t, d,, 1). Thus, if k and / are two 
extreme Bbhectvations such that y hoe) ie then the observation 
whose sampling weight is largest will have a higher weight 
D,. Selecting r,= 4, =D, makes it possible to obtain 
essentially the Dalén ane ihe =C,(D))¥., Dr 
The estimator Pies =), D,y, has been studied for example 
in Tambay (1988). 


Table 3.1 
Estimator (3.1) Based on Weight Reduction and 
Value Modification 


Estimator Value of g, = 1, 
Bershad bead Ltr) 
Winsorised W,=m(y,t, N/n, f N/n) 


Winsorised, type I W, =m, t, N/n, 0) 
Wi =m, t, N/n, 1) 
D101 1,4, .) 


Note: m(,; t, a,b) =b +(a-b) min(t, t/y,). 


Winsorised, type II 
Dalén 


The approach used in this section suggests that we may 
occasionally seek estimators whose weights are close to r, 
rather than the sampling weights d,. The constants r, will 
themselves be chosen close to d, for the proper units, but 
will be reduced once a unit is declared extreme. The QR 
estimators allow the weight reduction and value modifi- 
cation methods to be unified. Methods based on value 
modification help us choose weights that are adapted to the 
specific sample s chosen. As was noted in Chambers and 
Kokic (1993), this is not surprising since the problem of 
outliers occurs after the selection of sample s. We must use 
the sample at our disposal to overcome the problem. These 
methods are generalized in the following section using 
auxiliary information. 


3.2 Estimators of the Total Based on Robust 
Statistics 


One of the first attempts to obtain robust alternatives to 
population totals using auxiliary information can be found 
in Chambers (1982, 1986), who proposed a robust ratio 
estimator based on BLUP estimator decomposition. One 
recent extension of the work carried out by Chambers can 
be found in Welsh and Ronchetti (1998). Gwet and Rivest 
(1992) also proposed a robust version of the ratio estimator 
using an approach based on the design in simple random 
sampling. Rivest and Rouillard (1991) carried out a compa- 
rative study of several robust estimators, and examined 
several estimators of the mean square error. For designs 
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with unequal probabilities, Hulliger (1995) considered 
robustifying the HT estimator when inclusion probabilities 
are obtained using auxiliary information. Gwet and Rivest 
(1992) and Hulliger (1995) considered a version of the 
influence function for finite populations, emphasizing the 
need for procedures having good properties of local robust- 
ness and the use of estimators having limited influence 
functions. Influence functions were discussed generally in 
Hampel et al., (1986). 

The following sections will deal with building robust 
estimators having constrained weights. The building of 
such estimators is based on the following steps: 


— Identifying the constants q, and r,; this provides a QR 
estimator. 


— Resolving the problem (2.3) so as to provide an RQR 
estimator. 


In terms of robustness, the coefficients q, are selected such 
that B i is a robust estimator. Thus, the first part of the QR 
estimator, T’ Be provides a good predicted value for the 
entire population. The second part of the QR estimator, 
¥ 7,2,» corrects the first part for the y, observed in the 
sample. The constants r, ensure that with this correction, 
the outliers in the sample will not return with full weight. 


3.2.1. Choice of q, Based on a GM-Estimator 


Consider the estimator (1.2) in which B, is replaced by 

a robust estimator of a regression coefficient. Such esti- 

mators have been discussed for example in Huber (1981) 
and Hampel et al., (1986). We thus obtain 

inate Bed ar, (eo; B a). (3.3) 

The estimator (3.3) does not have the form of QR 


estimators unless B , assumes a weighted form. This is the 
case if B, is a GM-estimator defined by the equation 


Yd, 4.h,2,v((, -*/B)/longe)) = G4) 
since the solution to (3.4) can be expressed as 
B, i by. d,hy eu ece sd = dy hy TUX Yl Cy 


where 
_w(o,- 48) /on ye) 
(y, -x{B,)/ (oh fe,) 


The properties of GM-estimators have been discussed in 
Simpson and Chang (1997). To simplify our discussion, 6 
is assumed to be known, and the role of c, is the same as in 
the case of the GREG estimator. The function y is 
determined by the analyst. A current example would be the 


Huber function 
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QM Se, 
WO) = x ot ble 
—Comlteu<c Ge 


(3.5) 


A value of c around 2 is often used in calculating GM- 
estimators. See for example Hampel et al., (1986), Gwet 
and Rivest (1992) and Hulliger (1995). 

The choice of h, makes it possible to limit the influence 
of auxiliary information that is too extreme. The constant a = 0 
leads to the choice of Mallows whereas a = 1 makes it 
possible to obtain the Schweppe version. The Schweppe 
version is sometimes preferred. See Coakley and 
Hettmansperger (1993) and Hampel et al., (1986, p. 322). 
When there is minimal auxiliary information, i.e., when we 
only have available a real variable x,, VkeU, a possible 
choice for function h, is 


(ee mi (3.6) 


t 
ae 


For a design mps, a modification of h, following Dalén 
(1987) so as to take various sampling weights into 
consideration would perhaps be desirable. The constant t 
must be specified by the statistician. A value of t around 
1.5 is found in the applications. See for example Rivest and 
Rouillard (1991), who also provide other choices for 
functions h,. 

Writing B as a weighted estimator makes it possible to 
write estimator (3.3) as a QR estimator with 


(9,,7,) = (d,h, baer gah 


The choice of constants Rs is discussed in section 3.2.3. 


3.2.2 Choice of q, Based on a High-Breaking-Point 
Estimator 


The choice of a GM-estimator is only a first step towards 
obtaining a very robust estimator of the total. In fact, 
although the influence function of GM-estimators is 
restricted, the fact remains that such estimators do not have 
a high breakdown point, which usually diminishes 
according to the dimension of the auxiliary information 
(Rousseeuw and Leroy 1987, p. 13). This section will 
explain how to build robust calibration estimators based on 
high breakdown point estimators. As such estimators do 
not usually assume a weighted form, we will consider 
reweighting them. This will allow us to obtain, as in the 
previous section, the constants g, needed to compute the 
RQR estimator metric. Specifically, the following weights a, 
are considered: 


| MO B)/ Cont ye.) 
k 


: (3.7) 
(9, - %{ By) / Cohg fe) 
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where By is an equivariant estimator with a high break- 
down point meeting certain regularity conditions. The 
reweighted estimator is 


B, = OS d, hy “a xxiley) x 


ye d,hy "8 XY! Cy: 
The asymptotic properties of this type of estimator have 
been studied in Simpson and Chang (1997). 

The estimator B, that is considered is the one-step GM- 
estimator of Coakley and Hettmansperger (1993). This 
estimator has a high breakdown point. It is obtained as the 
first iteration of the Newton formula in equation (3.4), 
where the Schweppe version is used, assuming a = 1. 
Other robust estimators could have been chosen. However, 
the efficiency and robust properties of the Coakley and 
Hettmansperger (1993) estimator make it a good choice. 
Thus, the proposed constant q, is 


(3.8) 


i d, hy, Saye 


Withe eb tab aoe. denoting the 
Hettmansperger (1993) estimator. 


Coakley and 


3.2.3 Choice of r;- 


Once the constants q,, have been determined, the 
constants r, must be selected. If d, = r, then under general 
conditions, the QR estimator is an ADU estimator. How- 
ever, such a choice of i yields an estimator that is sensitive 
to outliers. Alternately, choosing r, = 0 provides a robust 
estimator that might be very biased as was emphasized in 
Gwet and Rivest (1992, p. 1180). Lee (1991) suggested 
choosing r, = Od,, where 9€[0, 1]. The asymptotic bias 
becomes under general conditions (0 - 1 ) bate E veh where E 
represents the residuals obtained by adjusting a robust 
estimator for the entire population. Choosing 8 makes it 
possible to control estimator bias. The discussion in 
section 3 leads us to suggest constants r, that are close to 
the d, for good units, and reduced gradually for doubtful 


observations. We suggest choosing 
(3.9) 


ce =, Uy 


where 

._ v'(0, -(8,)/ (ong ye,)) 

Uu, tart Witt Oe nn ee 
(, 18) / (one fey) 


The function yw" which we will be considering is a 
modification of the Huber function 


BG ibe [ball ale 
a sign(x) if Ixl>a and ll<a/b, 
bx if Ixl>a/b. 


we (x) = 
(3.10) 
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We choose a = 9, b= 1/4. The reason for this modification 
is that we do not want the outliers comprising large 
residuals or extreme auxiliary information to have weights 
that are too reduced. In this way, the sampling weight is 
fully maintained when the argument for Uy is between -9 
and 9, and reduced gradually to one quarter. If the weight 
of large residuals is reduced too much, then the bias 
becomes too great, leading to the choice of y*. The choice 
of constants r, has been done empirically, and seems to 
work well in practice. 

Thus, we will consider the choice of constants q, and r, 
following 

Gera he aed ae). (3.11) 
We suggest a generalization of the Lee proposition (1991), 
since instead of considering Vite d,9 where @ is fixed, 
iad, Uy will adapt automatically (or adaptively) to the 
sample. Having this choice of constants q, and r, at our 
disposal, and with the usual mean square metric, we obtain 
a QR estimator, but it is subject to negative weighting 
problems. However, with the constants (3.11), we can 
consider the restricted mean square metric, solve the 
problem (2.3) and obtain a robust estimator meeting the 
CEs and the CARVs. 

There are in proposition | possible solutions for the 
asymptotic behaviour of the resulting RQR estimator as 
compared to the QR estimator free of weight constraints. 
However, since the constants (3.11) depend on s in a 
complex way, there can be no automatic conclusion about 
asymptotic equivalence. Nevertheless, the simulation study 
in section 4 seems to suggest a very comparable behaviour 
for the estimator with and without constraint on the 
weights, with respect to the Monte Carlo mean square error. 
Thus, empirical evidence shows that if the qd, and r, are 
chosen in such a way that the estimator without constraint 
on the weights is robust, then the version with constraints 
on the weights will also be robust. 

Finally, the following is a summary of the steps in the 
proposed method used to obtain a robust RQR estimator. 


1. Choice of constants q, and r,. We suggest the 
constants found in equation (3.11). For this step, it is 
necessary to compute By,. 


2. Choice of metric. If need be, choice of constants L and 
OL, These constants are chosen such _ that 
EV ges U, Vkes. 


3. Solution using Newton’s method for equation (2.5). 
. Assume w, =h(x,'A.34,,7,) for X, solution to step 3. 
5. Assume fie = se W,y,, which is the proposed RQR 
estimator. 


The procedure requires a certain number of constants. 
The constants a, t and c are found in the calculation of q, 
and r,. The choice of these values is nevertheless justified 
using robustness theory, which helps guide the practitioner. 
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Thus, the value for c in the Huber function can be obtained 
by taking into account efficiency concerns under normal 
errors. See Hampel et al., (1986, p. 333) and Gwet and 
Rivest (1992). Constants a and b are also found; they are 
more directly linked to the proposed estimators. Constant 
b represents the maximum weight reduction that can be 
allowed when specifying the default weights r,, and for 
this reason there is a link with the suggestion made by Lee 
(1991). The constant which it is most important to specify 
is possibly the value of a. We suggest here a =9. However, 
in our simulations, a value of a between 6 and 12 yielded 
relatively comparable results. The choice of limits L and U 
rests on cosmetic considerations, so that the weights may be 
limited to one interval. This last consideration is perhaps 
secondary for the practitioner. As a result, it would seem 
that the most important aspect is to choose a value of r, that 
is close to d, for the proper values, then reduced as an 
observation is deemed extreme, and that is the goal which 
has guided our choice of i in this section. Nevertheless, 
it would be useful to make a choice of r, that satisfies a 
certain optimality criterion. 


3.3. Chambers Model-Assisted Estimator 


Another approach is based on a decomposition proposed 
by Chambers (1982, 1986) which we now apply to QR 
estimators. Note that a QR estimator can always be written 
in the form 


eye a7 Hale) BEY, 24 0, -%,B), 


where z, =(T, - JE Oberon ican (ES beans 
and B are arbitrary. Chambers (1986) had considered the 
specific case (q,,7r,) =(1/ oO, 1) for the ratio estimator. In 
order to limit the influence of outlier units, Chambers 
proposed 


A 


TcHAM a ves VY k + Ce 7 sees as 


Y, 2.¥ pV 1 -*/B))- 


The function y, helps limit the influence of large residuals. 
The choice for B is a robust estimator, e.g., B,. One 
function Vp considered in Chambers (1986) was 


W,(t) =¢ exp(-0.25 (ltl - 6): 


(3.12) 


(313) 


It is interesting to note that (3.12) can be written as 
tie ee ies pS (7%, + (4,8, — TA) e,(B), 


where e,(B) =y, - x, B,g, is defined in formula (2.1) 
calculated using q, and r,, and 


vali -0)) 


k (3.14) 
VIO —x,B) 
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Thus, the residuals e,(B) are weighted using a relation 
referring to formula (3.2). If A, = 1, then d,g, is applied to 
residuals e,(B) and it is easy to verify that we have the 
estimator he p: Alternately, if Me =0, we obtain (3.3) if we 
assume B= B ,. If in (3.12) we assume (q,, r,) =(1/c,, 1) 
and Bobs, then the Chambers estimator represents a 
compromise between the BLUP and a robust estimator 
based on a GM-estimator. Note that formally (3.12) is a 
QR estimator with 


Che m)= (d,h; Sunicy Pere JN). 


However, since re is not necessarily positive, it is not 
always possible to undertake a change of metric in this case. 


4. EMPIRICAL STUDY 


To study the performance of robust calibration 
estimators, we carried out a Monte Carlo simulation study. 
We considered four populations comprising data from 
readily available works on sampling theory. For each 
population, K=2000 samples were drawn using simple 
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random sampling for various sample sizes. Our main objec- 
tive was to determine whether it is possible to obtain esti- 
mators having good empirical properties (bias, mean square 
error) while satisfying the CEs and the CARVs. Note that 
all the programs were written in S-PLUS (Statistical 
Sciences 1991) and are available from the author. 


4.1 Populations Under Study 


The population graphs can be found in Figure (4.1). The 
first population, comprising 51 units, can be found in 
Mosteller and Tukey (1977, p. 560). It consists of the 
U.S. population in 1960 and in 1970 for each of the 
50 states and the federal district of Columbia. It is called 
POPUSA. Looking at the scattergram of the 1970 popu- 
lation in terms of the 1960 population, we notice that all 
units seem to be on the same straight line, with some good 
leverage points. An example of a good leverage point is the 
point surrounded in this population. The second population, 
with 34 units, can be found in Singh and Chaudhary (1986, 
p. 177). It deals with the area of fields sown in 1971 and in 
1974. This population is called AREA. There is a bad 
leverage point (see the surrounded point) in this population 
since the point (4170.99) does not respect the linear trend 
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Figure 4.1. The four populations under study 
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of the majority of units. Samples of size 10 and 15 are 
drawn from POPUSA and AREA. The third population, 
i.e. the MU284 in Sarndal et al., (1992), comprises the 284 
municipalities of Sweden. We considered variables x = $82 
concerning the total number of seats in the municipal 
council, and y = P85 representing the population of Sweden 
in 1985. There are vertical outliers (e.g., the surrounded 
point) and one bad leverage point. Finally, we considered 
population made up of MU281 made up of MU284 from 
which the three largest municipalities were excluded. The 
variables considered were x = REV84 representing the 
values of landed property based on the 1984 assessment, 
and y = RMT85 representing municipal tax revenues in 
1985. The unit of measurement was one million kronor for 
both variables. It seems this population has several bad 
leverage points. Samples of size n = 30 and n = 60 were 
drawn from MU284 and MU281. Table (4.1) contains 
totals for various populations. 


Table 4.1 
Totals for Various Populations and Totals Known From 
Auxiliary Information 


Population Im hs N 
POPUSA MDS? 203,923 Sil 
AREA 29,118 6,781 34 
MU284 13,500 8,339 284 
MU281 757,246 53,124 281 


4.2 Description of the Estimators 


The two basic estimators were the GREG estimator and 
the estimator obtained by considering case No. 7 in Deville 
and Sarndal (1992), i.e., a GREG estimator with restricted 
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GREGIR respectively. We selected c, = 1 for populations 
POPUSA and AREA, and chose c, = x, for populations 
MU284 and MU281. Our choice for the c, was motivated 
by the relationship between these constants and the hete- 
roscedasticity of the superpopulation model. Of the robust 
estimators, we studied the Chambers (1986) estimator by 
considering 


pe i) a (Gia (Bay) Ce Pe (are, a 1)A,(B,)), 
where in the formula (2.1) ((q,,7,) = (/c,, 1), denoted 
CHAM, based on B,. The constants a ,(B cH were 
obtained from formula (3.7). Selection a = 1 was used 
throughout the simulation. Huber’s function y was used 
with the constant c = 1.345 for B,. The functions A, are 
those given by formula (3.6), where we selected t = 1.46. 
The function A, is defined by equation (3.14). The function 
V, considered was that given by equation (3.13). The scale 
was estimated as in Coakley and Hettmansperger (1993). 
We also considered the model-assisted BLUP estimator in 
which the generalized least squares estimator was replaced 
by estimator B, which we called MODEL. Moreover, we 
considered the Lee (1991) estimator on the basis of B, 
where r, = 0,25d,, using the mean square metric. We also 
studied an extension of the Lee (1991) estimator by consi- 
dering the limited mean square metric. These estimators 
were denoted by LEE25/U and LEE25/R respectively. 
Finally, we considered the new method in section 3.2.3, 
selecting (q,,7,) as given by equation (3.11) in accordance 
with the mean square metric and the limited mean square 
metric. They were denoted by QRROB/U and QRROB/R 
respectively. The choice of function y* was given by 
formula (3.10). 


weights. These estimators were denoted GREG/U and 


Table 4.2 
Monte Carlo Results for Sampling From the POPUSA Population 
Estimators VAR wy MSE y CV BR MIN MAX CARV ' CONV 
n=10 
GREG/U 34.90 34.92 2.90 -0.07 -6.24 26.75 86.7 
GREG/R 35.29 35.30 2.91 -0.04 0.20 32.00 100.0 98.4 
CHAM 32.43 33.15 2.85 -0.56 -19.61 40.96 84.0 
MODEL 27.66 30.69 Dae -0.85 -19.71 40.86 82.8 
LEE25/U 27.48 30.07 2.69 -0.79 -19.38 39.64 83.2 
LEE25/R 28.67 30.90 27/33 -0.73 0.20 32.00 100.0 98.4 
QRROB/U 27.40 28.40 2.61 -0.49 -15.68 40.10 83.2 
QRROB/R 28.33 29.18 2.65 -0.45 0.20 32.00 100.0 98.4 
n=5 
GREG/U 21.90 DA295 2.30 -0.10 -3.13 15:32 94.7 
GREG/R 2.02 225 PHI -0.09 0.20 16.00 100.0 99.5 
CHAM 18.11 20.14 2.20 -0.70 -5.79 16.44 92.4 
MODEL 15.43 19.03 2.14 -0.93 -6.09 16.92 91.0 
LEE25/U 15.44 19.54 Dele] -0.99 -6.19 17.06 90.8 
LEE25/R {53.972 19.68 2.18 -0.98 0.20 16.00 100.0 99.5 
QRROB/U 14.68 16.44 1.99 -0.65 -4.48 16.41 90.9 
QRROB/R 14.85 16.56 2.00 -0.64 0.20 16.00 100.0 99.5 


' The limits for the CARVs are [0.20, 32] for n = 10 and [0.20, 16] forn = 15. 
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4.3 Frequency Measurements 


The eight estimators in Section (4.2) were calculated for 
each sample. The results can be found in Tables 4.2, 4.3, 
4.4 and 4.5. Since one asset of the new methods is the 
CARVs, statistics were calculated on these weights. 
Columns MIN and MAX in the tables of results contain the 
minimum and maximum values of weights calculated 
during the simulation for each estimator. Also shown is the 
percentage of samples for which the weights are within the 
CARVs in the CARV column in the tables of results. We 
also considered the percentage of samples for which there 
were convergent limited estimators in the CONV column. 
The intervals used [L, U] for the limited intervals are 
specified in the different tables. In all cases, the various 
Statistics were calculated using samples for which all 
estimators were convergent. 

Another significant feature is related to the bias and 
efficiency of the proposed methods. Let T denote an 
estimator of the total 7,. Assume T, is the estimator of the 
total calculated using sample i,i=1,...,K. The relative 
Monte Carlo bias BR,,, the mean value E,, and the 
variance V,, are given by the usual formulas, i.e., 

BR,, =(E,(T) - T,)/T, x 100, E,,(T) = 

1 uk «@ luk (4 a 
= ey Landaa = = ly ee 

Our main criterion for efficiency will be the Monte Carlo 
mean square error defined by MSE,, = 1/K)-, (7,-T,). 
The coefficients of variation CV,, are calculated in 
accordance with ,/MSE,,/ (es The variance and mean 
square error are expressed in millions. The coefficient of 
variation, the relative bias, the CARVs and the convergence 
of limited versions are expressed as percentages. 


4.4 Discussion 


The POPUSA population had no outliers that did not 
satisfy the linear model. During sampling, the coefficients 
of variation of the estimators were small, which could be 
expected given the trend of the population. Columns MSE 
and VAR are very similar, indicating that bias is not a 
problem for this population. All relative bias was less than 
1%. The QRROB/U estimator provided a reduction in 
variance as compared to GREG/U that exceeded 21% for 
n= 10 and 30% forn = 15. 

The size of the AREA population was small. This 
population had a bad leverage point leading to very high 
empirical relative bias for all the estimators. The GREG/U 
estimator had a relative bias of more than 7% in spite of a 
44% sampling for this population. The robust estimators 
had the most significant bias, though it was relatively 
comparable to the bias of the GREG/U estimator. The most 
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significant reduction in variance was achieved for the. 
QRROB/U estimator, but at the cost of a relative bias of 
about 10%. 

Population MU284 had a vertical outlier and bad 
leverage points. Robust estimators reduced the variance 
radically, since they were not affected by the three extreme 
units in y which were clearly moving away from the linear 
trend. The CHAM, QRROB/R and QRROB/U estimators 
were more than four times less variable than the GREG/U 
estimator. However, this led to a much higher negative 
bias. All the robust estimators were severely biased. The 
MODEL estimator showed a negative bias of more than 
13%, whereas QRROB/U had a negative bias of the order 
of 11%. As for QRROB, a better choice of constants in 
function y* might help reduce a larger part of the bias at 
the cost of a lower variance reduction. Increasing the 
sample size to n = 60 made it possible to reduce the bias 
below the 10% of the CHAM and QRROB estimators, but 
the other robust estimators remained more biased. 

Population MU281 contained a fairly large number of 
bad leverage points. The variance dominated the MSE 
share of this population. The LEE25 estimator was the least 
variable, with a reduction of more than 35% as compared to 
GREG/U. However, although @ = 0.25 functions well for 
this population, our study shows that it is not always the 
best choice. 

Note that all the robust estimators were more efficient 
than the GREG or its limited version. As was confirmed by 
the results of Deville and Sarndal (1992), the limited 
version of the GREG estimator showed essentially the same 
behaviour as the GREG in terms of both bias and Monte 
Carlo variance for each population. Of all the estimators 
that were considered, GREG/U and GREG/R were the least 
biased. The robust versions all exhibited greater bias. 
However, this is more than offset by the reduction in 
variance so that the efficiency of robust estimators is always 
greater than that of GREG/U or of GREG/R estimators. 

Concerning the constraints on the weights, it will be 
noted that the GREG/U, CHAM, MODEL, LEE25 and 
QRROB/U estimators are all subject to problems of 
negative weighting, as can be seen in column MIN. This 
problem is avoided with limited estimators. The CARV 
column shows that the constraints were not met relatively 
frequently, depending on population and sample size, 
varying between 5% and 60%. The general behaviour of 
the two limited robust estimators was comparable to that of 
their non-limited versions. Moreover, QRROB/R, in 
addition to meeting the CARVs, provided interesting 
properties of efficiency, as compared to other robust 
estimators. Limited versions were not as prone to 
convergence problems when sample sizes were greater. 
Note that we had to use wider bands in the case of 
POPUSA in order to obtain satisfactory convergence rates. 
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Table 4.3 
Monte Carlo Results for Sampling From the AREA Population 
Estimators VAR wy MSE y CVag BRy MIN MAX CARV ! CONV 
n=10 
GREG/U 1.334 1.700 1923 8.92 -3.35 14.94 86.6 
GREG/R 1295 1.629 18.82 8.53 0.20 14.00 100.0 99.0 
CHAM 1.187 1.541 18.30 8.77 -4.09 14.90 87.2 
MODEL e201 1.580 18.54 e935 -5.23 16.75 86.8 
LEE25/U PAT) 1593 18.61 8.26 -5.28 16.89 86.6 
LEE25/R 1.284 1.596 18.63 8.24 0.20 14.00 100.0 99.0 
QRROB/U 1.026 1.440 17.70 9.50 -4.74 15.38 87.6 
QRROB/R 1.028 1.437 17.68 9.43 0.20 14.00 100.0 99.0 
n=w'5 
GREG/U 0.940 1.178 16.00 7.18 -1.40 7.03 93.0 
GREG/R 0.928 1.154 15.85 7.01 0.20 6.00 100.0 99.8 
CHAM 0.708 0.989 14.67 7.82 -1.52 VSP 28.7) 
MODEL 0.757 0.997 14.73 Use -1.66 8.39 O3rl 
LEE25/U 0.672 1.059 15.18 9.18 -1.68 9.40 92.0 
LEE25/R 0.671 1.056 NS}. 315) O15 0.20 6.00 100.0 99.8 
QRROB/U 0.485 0.990 14.68 10.48 -1.59 8.90 32) 
QRROB/R 0,485 0.986 14.64 10.44 0.20 6.00 100.0 99.8 
' The limits for the CARVs are [0.20, 14] for n = 10 and [0.20, 6] forn = 15. 
Table 4.4 
Monte Carlo Results for Sampling From the MU284 Population 
Estimators VAR y MSE y CVE BR y MIN MAX CARV! CONV 
n= 30 
GREG/U 2.833 DSTS 20.51 -3.64 -6.83 23.90 89.8 
GREG/R 2.813 2.910 20.46 -3.73 0.20 16.00 100.0 99.2 
CHAM 0.645 1.639 15:35 -11.95 -11.80 31.26 77.0 
MODEL 0.709 2.037 17.11 -13.82 -12.06 SHI 68.40 
LEE25/U 0.887 1.877 16.43 -11.93 -11.06 30.93 Wks 
LEE25/R 0.871 1.847 16.30 -11.85 0.20 26.00 100.0 SH 
QRROB/U 0.719 sey? 14.84 -10.81 -9.46 25.84 86.5 
QRROB/R 0.720 1.525 14.81 -10.76 0.20 16.00 100.0 O97. 
n= 60 
GREG/U 1.473 1.489 14.63 -1.49 -1.19 10.03 90.1 
GREG/R 1.467 1.484 14.61 -1.57 0.20 7.00 100.0 OOF) 
CHAM 0.357 0.990 11.93 -9.54 -2.53 15.59 69.8 
MODEL 0.380 1255 13.43 -11.22 -4.93 14.52 58.1 
LEE25/U 0.403 1.201 13.14 -10.72 -4.80 14.20 60.3 
LEE25/R 0.396 1.203 13.16 -10.78 0.20 7.00 100.0 99.7 
QRROB/U 0.308 0.976 11.85 -9.80 -2.36 10.99 86.1 
QRROB/R 0.308 0.979 11.87 -9.82 0.20 7.00 100.0 SNF) 


' The limits for the CARVs are [0.20, 16] for n = 30 and [0.20, 7] for n = 60. 
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Table 4.5 
Monte Carlo Results for Sampling From the MU281 Population 
Estimators VAR wy MSE y CVn; BR yx MIN MAX CARV! CONV 
n=30 
GREG/U W733 N73) 7,84 -0,26 -38,97 34,56 86,0 
GREG/R 17,40 17,41 7,86 -0,24 0,20 25,00 100,0 99,8 
CHAM 13223 13,26 6,86 -0,33 -47,09 39,08 56,9 
MODEL 11,30 11,91 6,50 1,47 -66,22 41,43 47,9 
LEE25/U ui 11,60 6,41 Neal -59,75 37,03 Dane 
LEE25/R 11,26 Ls 6,45 129 0,20 25,00 100,0 99,8 
QRROB/U 12492, 3329 6,86 iS -54,14 SOS) 70,8 
QRROB/R 12,94 13,34 6,88 1,20 0,20 25,00 100,0 99,8 
n=60 
GREG/U TST! eau 5,18 -0,10 -12,77 15,34 86,4 
GREG/R 7,58 Wepre: 5,18 -0,09 0,20 9,00 100,0 99%9 
CHAM 5,85 5,90 4,57 -0,43 -22,97 11,49 51,4 
MODEL 4,53 23: 4,30 iL5y7/ -24,02 14,58 38,7 
LEE25/U 4,55 5,18 4,28 1,49 -23,74 14,41 41,2 
LEE25/R 4,50 D521 4,30 1,58 0,20 9,00 100,0 99:9 
QRROB/U 5,40 6,16 4,67 1,64 -21,08 21,07 68,6 
QRROB/R 3559) 6,17 4,67 1,66 0,20 9,00 100,0 099 


' The limits for the CARVs are [0.20, 25] for n = 30 and [0.20, 9] for n = 60. 


5. CONCLUSION 


The goal of this paper has been to introduce calibration 
estimators having good properties of robustness. Tradi- 
tional calibration estimators are easy to use, since it is 
sufficient to have a set of starting weights, usually the 
sampling weights d,, which are transformed into calibrated 
weights. The steps used in this paper have been the same, 
i.é., the robust default weights r, have been transformed 
into calibrated weights, and the constants qg, have been 
chosen such that B_ is a robust estimator. The proposed 
choice of r, is given by the formula (3.9), with a = 9, 
b = 1/4. There remains to develop a theory for the optimal 
choice of r,. The suggestion is made for applications to 
vary constant a, between say 6 and 12, in order to determine 
the influence of the constant on the estimation. The limits 
Land U can be used to limit the weights, e.g., to make them 
all positive. We suggest the general use of L = 0.2, 
U=kWN/n, where k is about 3. 

Note that robust calibration estimators are not meant to 
replace the GREG estimator, but to be used in conjunction 
with it. Thus, if the robust estimator and the GREG esti- 
mator are very different, a more in-depth analysis might 
help determine the reason. The proposed estimators could 
be useful as diagnostic tools. 

It would be interesting to pursue the empirical studies of 
section 4, by examining for example the effect of sampling 
design on the proposed procedures. Another important area 


of development is the estimation of variance. Multipurpose 
surveys are yet another area of interest. In fact, for appli- 
cations, there is rarely a single variable of interest, and 
methodologists would like to use a single set of weights for 
all the variables of interest. In terms of robustness, a 
solution has been proposed in the conclusion of a paper by 
Gwet and Rivest (1992), where robust weights were 
calculated for each variable of interest y“, i = 1, ..., J. For 
one unit, the final weight corresponds to the minimum 
weight among the weights obtained. Alternately, to obtain 
robust and calibrated estimators, we could calculate robust 
default weights for each variable of interest, providing a set 
of r,(y), and assume r, = minr,(y“), where the 
minimum is on i = 1,...,/. These weights could then be 
transformed into calibrated weights. This procedure should 
be assessed in greater detail. 
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APPENDIX A 
PROOF OF PROPOSITION 1 


Let A, (u;q,r) =r +qu -h(u;q,r) and z, bea variable 
of interest. We assume the following conditions 


Cee yea, 0-11): 


CaN Ds AG, nape az o8ur) =); 
hee dA, isa sonntien to equation (2. >): 


Note that )'.(7,+4,x,4,)%,=T,, where 4, = 
ACC aN AWE -T,), and also that ) h(x, 1 
Get, yx; = T.. Thus, in using C,, we find that 


Nye Gx, x, , -2_) =0,(n ae), 


h, -4, =0,(n “l/?), and therefore using C,, with 
Pa tpoke re Tt is also easily shown that 
Nilo tron) 


me Gp Ay IV) Lay Megir yy, 


=N1)". 4%, ¥, (a, -d.) Nea ye NORE GS Tp)Y) 


2) (tess): 
APPENDIX B 
LIST OF ABBREVIATIONS 
ADU: Asymptotically Design Unbiased. 


BLUP: Best Linear Unbiased Predictor (Royall 1970). 


CARV: Constraints applicable to the range of values for 
the weights w,, by requiring for example that all 
the w,€[L, U]. 


CE: Calibration constraints, 
Tyee Xe: 

CH: Robust estimator proposed by Coakley and 
Hettmansperger (1993), a _ single-step GM- 
estimator that is robust and efficient. 

CHAM: Robust Chambers (1982, 1986) estimator. 


GM: Generalized M estimators, derived from robustness 
theory (see for example Hampel et al., 1986). 


Me w,x, =T,, where 


GREG: Generalized regression estimator proposed by 
Cassel et al., (1976). 


HT: Horvitz- Thompson estimator )' d,y,, where 


d, = . 
QR: Wright (1983) estimators, in the form 
TBs aT ey- 


RQR: Generalization of the Wright (1983) estimators, 
obtained using a general metric as well as 


constraints on the weights. 


oh) 
APPENDIX C 
LIST OF THE PRINCIPAL CONSTANTS 
Cy Factor capable of accounting for heteroscedasticity 
problems. 
ap Sampling weights. 
ee g-weight defined by w,/d,. 
h,: Quantity used to reduce the influence of outlier 


auxiliary information in B 7 


7,,7,,: Inclusion probabilities of first and second order, 
respectively. 

q,>7,: Quantities defining an estimator QR. The q, are 
used to build the regression coefficients involved 
in the first part, 7,’ Be the r, are used for the 
second part, )’ r,e,. 

Re u ,. Weights used to build B , in a robust way. 

u,: Weights used to consider a robust correction factor 
bas ry ex 

W,: Calibrated weight attributed to y, to form 
LM: 
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Estimation in Surveys Using Conditional Inclusion Probabilities: 
Complex Design 


YVES TILLE! 


ABSTRACT 


This paper investigates a repeated sampling approach to take into account auxiliary information in order to improve the 
precision of estimators. The objective is to build an estimator with a small conditional bias by weighting the observed 
values by the inverses of the conditional inclusion probabilities. A general approximation is proposed in cases when the 
auxiliary statistic is a vector of Horvitz-Thompson estimators. This approximation is quite close to the optimal estimator 
discussed by Fuller and Isaki (1981), Montanari (1987, 1997), Deville (1992) and Rao (1994, 1997). Next, the optimal 
estimator is applied to a stratified sampling design and it is shown that the optimal estimator can be viewed as an generalised 
regression estimator for which the stratification indicator variables are also used at the estimation stage. Finally, the 
application field of this estimator is discussed in the general context of the use of auxiliary information. 


KEY WORDS: Conditional estimation; Weighted observation; Generalised regression estimator; Complex survey. 


1. INTRODUCTION 


At the estimation stage, practitioners of survey sampling 
often have auxiliary information available. This infor- 
mation can be the knowledge of a set of population means 
or totals. Sometimes, the available information is detailed, 
for instance when the values taken by a variable on all the 
units of the population are known. This information can be 
used to improve the precision of the estimators. 

Our aim is to dealt with the use of auxiliary information 
based on a conditional principle. Conditional inference has 
been largely studied in the survey sampling literature. 
Indeed, the optimal estimator was discussed by Fuller and 
Isaki (1981), Montanari (1987, 1997), Deville (1992) and 
Rao (1994, 1997). The conditional properties of the post- 
stratified estimators has been studied by Casady and 
Valliant (1993). In an earlier paper (Tillé 1998), a general 
technique that allows to build a mean or total estimator that 
has a small conditional bias has been proposed for simple 
random sampling. This technique is based on the use of 
conditional inclusion probabilities and allows one to take 
into account auxiliary information without any reference to 
a superpopulation model. 

In this paper the use of conditional inclusion probabi- 
lities is generalised to any sampling design. It is shown that 
this technique allows to construct an estimator very similar 
to the optimal estimator discussed by Montanari (1987), 
Deville (1992) and Rao (1994). This family of estimators 
provides a valid conditional inference and can also be 
viewed as the optimal linear estimator. Next, these esti- 
mators are applied in the stratification case and are 
compared to the GREG-estimator. The GREG-estimator is 
generally conditionally biased. Nevertheless, it is shown 
that, in regression, the optimal estimator is a particularly 
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case of the GREG-estimator. Indeed, when the stratification 
variables are re-used as auxiliary variables in the GREG- 
estimator, it is equal to the optimal estimator. Next, a set 
of simulations is given that shows the interest of the optimal 
estimator in stratification. The gain of precision can be very 
important when the stratification variables are very corre- 
lated to the interest variable. Finally we discuss the general 
estimation problem in survey sampling that can be viewed 
as a third-order problem where three sets of variables 
interact: the planning variables, the calibration variables 
and the interest variables. 

The paper is organised as follows. In section 2 the nota- 
tion is defined. In section 3, the problem of conditional 
inference is presented. In section 4, an approximation of the 
SCW-estimator is given for complex designs under 
technical hypotheses. These hypotheses are discussed in 
section 5. In section 6 the optimal estimator and the SCW- 
estimator are compared to the generalised regression 
(GREG) estimator in the stratification framework. It is 
shown that the optimal estimator can be viewed as a 
GREG-estimator for which the stratification indicator 
variables are also used a posteriori. Next a set of 
simulations is presented in section 7 in order to compare the 
discussed estimators. Finally, the problem of interaction 
between the design and the auxiliary variables is discussed 
in section 8. 


2. PROBLEM AND NOTATION 


Consider a finite population U = {1,...,k,...,.N} and 
suppose that a random sample S is drawn without replace- 
ment from this population following a sampling design p(.). 
The probability of selecting the sample s is Pr(S =s) =p(s), 
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for all s c U. The indicator variables J, take the value 1 if 
unit k is in the sample and 0 otherwise, for all k €¢ U. The 
inclusion probability of unit kis x, = E(/,), where symbol 
E(.) is the expectation with respect to the sampling design. 
The joint inclusion probability for unit k and / is 7,, = 
E(I,J,). Let y, denote the value of the variable y for the 
k-th unit of the population. The aim is to estimate the 
population mean of y: 


If m1, >0, for all ke U the Horvitz-Thompson estimator 
(1952) given by 


provides an unbiased estimator of y. 

Let T be a statistic. The objective is to estimate y with 
a conditional bias as small as possible with respect to 
statistic T. Define the first-order conditional inclusion 
probabilities to be m,,,= E(I,|T) for all ke U and the 
conditional joint icieson probabilities to be 2,)7 NT 
E(I,1,|T) for all ke U, le U,k #1. The simple Merete 
neeued estimator (SCW) is defined by 


A 1 y 
Yre—D as. 


Dal 
N kes Myr ae 
This estimator is not exactly conditionally unbiased. Indeed, 
a conditionally unbiased estimator exists if and only if 
Ty ip> 0 for all ke U. For this reason, it is useful to enlarge 
the definition of conditional unbiasedness: an estimator is 
said to be virtually conditionally unbiased (VCU) if the 
conditional bias only depends on the units having null 
conditional inclusion probabilities. The SCW-estimator is 
VCU, indeed: 


BO IT)=EO_|T)-F=-L Yo 
k|nyj7=0 

This estimator generalises some classic results (see Tillé 
1998) like post-stratification. Moreover, it allows us to 
build an original estimator for a contingency table when the 
population marginal totals are known. Unfortunately, the 
computation of the Tyr becomes very difficult in complex 
sampling designs. A general approximation for the SCW- 
estimator will however be given when using a vector of 
Horvitz-Thompson estimators as auxiliary statistic. 


3. USE OF A COMPLEX AUXILIARY 
STATISTIC 


Suppose that the auxiliary information is represented by 
the vector x, = (x, +> Xpiy s1+9X,,)' Of values taken by the J 
auxiliary variables on the k-th unit of U. Ina first step, it is 


supposed that the x, are known for each unit of the 
population. Later, it will be considered the more restrictive 
case where only one function of the x, such as 


is known. Consider also the Horvitz-Thompson estimator of 
x given by 
a yy 
N keS Tl, 


If x,>0, for all ke U, xe is an unbiased estimator of x 


E(x,) =x. (3.2) 
The variance of x is given by 
a = Var (x, a: Fea he m,) + 
leU Tl, 
Oy oe yee ie <n Cy, ~ 1) T,,) + 
2 teU me Lm (3.3) 


Suppose now that vector (y E x ,) has a multinormal 
distribution. Under this hypothesis, it can be derived a 
conditional unbiased estimator (see for instance, Deville 
1992). First the conditional bias is computed: 


B(y,|X,) = Ely ,|X,)-¥ = (X,-X) Var(x,) | Cov(x,,J,). 


If an estimator of By, |x,) is available, the Horvitz- 
Thompson estimator can be corrected in the following way: 


A 


=5, + (& -¥,) Var (x,)! Cov(x,, 3,): 


This estimator is related to the optimal linear estimator 
discussed by Fuller and Isaki (1981), Montanari (1987) and 
Rao (1994). Indeed, Montanari showed that the best 
estimator in the sense of the smallest mean square error 
(MSE) of the form 

Yp= Yq +(X ~X,)'B 
occurs when f takes the value: 
Bor 2s Covi xaiys): 


The optimal linear estimator presented by Montanari 
leads thus to a very similar result to the conditional 
approach, although Montanari did not start with a condi- 
tional point of view. In Montanari’s approach, the optimal 
estimator is found in a class of linear estimators defined by 
(3.4) without any reference to conditional properties. 
Nevertheless, Rao (1994) has pointed out that this estimator 
leads to valid conditional inference. The general problem 


(3.4) 
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of the optimal estimator is that Bp, is not known and must 
thus be estimated. By estimating B,,,, the optimal 
properties of the estimator are lost... 

In order to estimate B,,,, (or B(y,|x,)) two cases can 
be distinguished. In the first one, the values taken by the 
auxiliary variable on all the units of the population are 
known. In this case, )’ is thus known and 


Cov(x, eS Mek (l=) + 


IN? kev OK, 
1 7, 
ae =! Gg, - 1.) 
N? keu lev TL, 1, 
1 z 
a x) 
N kev a a 
can be unbiasedly estimated by 
rae XK ex 
Cov, (#,,5,)- 1 Su 3.5) 
Nixes TL, 
where 
1 eae Ss 
x keS)=— >> 
= (x,ke S) 3.6 
Nips. 1,0, tN (3.6) 


By using (3.5), a first asymptotically optimal estimator can 
be constructed 


A 


Sp A 1 X), — X 
Toe +(x- Pee, . as 
k 


(3.7) 


In the second case, only the population mean x is 
known, & must thus be estimated and Cov(x,, y,) can not 
be estimated using (3.5). Montanari proposes to estimate Z 
and Cov (x,,y,) by the classic Horvitz-Thompson 
estimator: 


Pap ok Kok 
x=—)) (ham) * 
N2 keS Tl 
k 
/ 
1 > XX) TM, ~— WT, 
N° keS jes ™™ = My 
l#k 
and 
_ kok 
Cov2(x,,¥,)=— ; (1-7,) + 
N° kes Ti, 
1 X,Y, My ~— 1,1, 
N2 keS a 1,1, Tl, 
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Bopr is thus estimated by (Z is supposed non singular) 


Boer ay Cov, (Xs ¥,): 


By estimating B>,,, another asymptotically optimal 
(AOPT) estimator can be given: 


Y sopra =n * (Xe ~*)’ Bopr- (3.8) 
The difference between the AOPT1 and AOPT2 estimator 
is the way we estimate Cov (xe y,) and X. However, the 
AOPTI1-estimator needs more complete auxiliary 
information. 

The generalised regression (GREG) estimator defined by 
Cassel, Sarndal and Wretman (1976), Wright (1983), 
Sarndal, Swensson and Wretman (1992, p. 225) is also an 
estimator of the linear class given by expression (3.4). For 
the GREG-estimator B is defined by 


-1 
/ 

Rey 3 | 
GREG 

keU Cy keU Cy 

and can be estimated by 

6 -ip> XX, Xi Nx 
GREG ey. 

keS TC, | keS TC, 


where quantities c x >0,ke U, are weights defined for all the 
population units. The GREG-estimator does not have good 
conditional properties. It is generally conditionally biased 
(Rao 1994). 


4. APPROXIMATION OF THE 
SCW-ESTIMATOR 


Another way to construct a conditionally unbiased 
estimator is to find an approximation of the SCW-estimator 
given in (2.1). Indeed this estimator has good unbiasedness 
properties because it is VCU. If x, is used as an auxiliary 
Statistic, we shall seek an approximation of 


Ui e= E(I, | X,)- 
If the random vector x, takes for instance the value z, we 
get by Bayes’s theorem that 


Pr(x, =z |keS) 


E(1,|X, =2) = Pr(keS|x Bear 


7 =Z)—%, 


In order to compute the conditional inclusion probabi- 
lities, it is thus necessary to know the probability distri- 
bution of x, unconditionally and conditionally on the 
presence of each unit in the sample. Except for some 
particular case, this probability distribution is very complex; 
for this reason an approximation will be constructed. 
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It is possible to derive the means and variances of < 
unconditionally and conditionally on the presence of each 
unit in the sample. Indeed E(x,) is given in (3.2 ), 
Var (x, Nett (ess). EXE |keS) in (3.6), and 


z, = Var(x, | keS) 


eal XX, TMm| (4.9) 
klm 
2 
N* tey meu TIM, TU, 
lek mel 
m#k 


where 7,,,, is the third-order inclusion probability. Matrixes 
x and Z, are assumed to be non singular. 

As the probability distribution of x, is generally 
unknown, the following three assumptions will be used to 
construct an approximation of conditional inclusion 
probabilities. 


(i) If the sample size n is large, <n has a multivariate 
normal distribution unconditionally and conditionally 
on the presence of each unit in the sample. 


(ii) Rj'-R7!= O,,;(2-') for all keU where R=V"'” 
pve wy {V2 .V '”,V denotes a J x J diagonal 
matrix having the elements of the diagonal of 2 on its 
diagonal and O,, ,(n “) denotes a matrix of quantities 
that when multiplied by n° remains bounded as n - ~. 


(iii) y,=V™ a6 4p -x)=O,(n -“”) where O, (n“) denotes 
a vector af Tene that when multiplied by n“ 
remains bounded as n > ~. 


These three hypotheses are made on the sample size. It 
is thus supposed that when n increases, N increases at least 
as quickly as n. Nevertheless, no hypothesis are made on 
f=n/N. Assuming that the hypotheses given in section 3 
are verified, the following result gives an approximation of 
the SCW-estimator: 


Result 1: Assuming (i), (ii) and (iii), and if the auxiliary 
statistic used is x_, then 


+O,n-')=Yaorn- (4.10) 


where nx O,(n~') is a quantity bounded in probability. 
Proof of Result 1 is given in the appendix. 


5. DISCUSSION ABOUT THE HYPOTHESES 


These three hypotheses are verified for simple random 
sampling without replacement when only one auxiliary 
variable is available. Indeed, in this case, we have J = 1, 
xX, =x,. We get 


re eo ie NE 
n iitel bw Oye 
Ui ee 1 Ss and PP Foes , 
N NN- NN-1N-2 


Crlt) 


(5.12) 


NW -nn-1) f a) (6.13) 


Var (x, |kES) = 
(N - 2)(N -1)n? 


where 


o 


eG, -x). 
keU 


oe 
Nk 


Now, consider the three hypotheses for this particular 
case. 
— Hypothesis (i) was proved by Madow (1948) under 
some conditions. 
Hypothesis (11) becomes 


Var(x, kes) 


-1 
Var(x,) Bee 


By (5.12) and (5.13), we get 


Var(x, JkeS) _ Naas Cpa) 
Var(x,) (Nein (N - l)o. 

_, LJ N-2n | Mn-1) 7%) 
n|(N-2) (N-2) (N-1)e 


-1+o{4), 


— Hypothesis (i111) becomes 


Var(x,) 


=O) 
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By (5.11) (5.12), we get 
a pee 6 
yVar(x_) rele 


In simple random sampling, these hypotheses can better 
be interpreted. Hypothesis (i) is the classic assumption of 
normality that was also needed for the construction of the 
optimal estimator. In simple random sampling, it is easy to 
verify that Hypothesis (iii) implies hypothesis (ii). Both 
technical hypotheses simply imply that a particular unit 
cannot take a |x, - x | value much more important than the 
other ones. 

The three hypotheses are thus valid under simple random 
sampling when only one variable is available. This result 
can also be extended to stratified sampling when the 
number of strata is fixed and the sample size within each 
stratum is large. In cluster sampling, when the number of 
clusters is large and the clusters are selected with a simple 
random sampling design, these hypotheses are still 
applicable. Hypothesis (i) was also partially showed by 
Rosén (1972) for sampling with unequal probabilities. 
Actually, the proof of Rosén is restricted to a rejective 
sampling design. 

The proposed hypotheses, are generally less restrictive 
than a superpopulation model. Indeed, a superpopulation 
model is a set of hypotheses on the interest variables while 
the three hypotheses presented only affect the auxiliary 
variables. In a superpopulation model, the relation between 
the interest variable and the auxiliary variables are the most 
extensive contribution of the model. In the conditional 
approach, no hypothesis is made on the interest variable. If 
the hypotheses presented are debatable, it is thus clear that 
a superpopulation model is a set of hypotheses much more 
restrictive than those used in the conditional approach. 


Vee 


6. APPLICATION TO STRATIFIED SAMPLING 


6.1 The Problem 


In stratification, auxiliary information is used it a priori 
to improve the estimation. In this case, three sets of 
variables interact: the stratification variables, the auxiliary 
variables used a posteriori and the interest variable. 
Suppose that the population is partitioned into H strata 
C= len OL site NS = y.s7 4 = The population 
means of the strata are denoted ¥, = N, eye u, Ye and 
x, =N, DY u, Xk . A simple random ane S, of fixed 


size n, (Yp-1%, = a is selected without replacement inde- 
pendently in each stratum. From the general theory of strati- 
fication (see for instance Sarndal, Swensson and Wretman 
1992, p. 100), we get 
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where 


Moreover, we have that 


Cov (xs y,) = 


Lona J iged | = a 
— N S54 = : 
We » Perv ealpar ae WO. Yn) 
and 

eel N, 

N? h=l 

Dein Ke 

» (x, —X,)(K, -X,) 
oe = lieu, 


where f, = n,/N,,h NN coos dale 


6.2 AOPT1-estimator 
If keU,, by extending expression (3.6) to stratified 
sampling, we get 
Ny Nf 2 
N41) 


XK), = E(x, |keS) =x + 


1 - v 
Ih as DS (xX, —X,)Y,- 


2 n 
Nia, Sul eat NEA, eresk 


From (3.7) the AOPT1-estimator of can be derived as 


y 


Yaorti = Yn * (K ~ X,) 


HONS (fg - 
xy : a MS (xX, —X,)Y,- 
h 


The use of this estimator requires the knowledge of very 
substantial auxiliary information. The population means x , 
of the auxiliary variables must be known for each stratum as 
well as the stratum sizes NV, . Moreover, the values taken by 
the auxiliary variables must be known for each unit of U. 
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However y aopr, as in stratification an important 
drawback: it is not calibrated on the strata size N, i.e 
when the objective consists in estimating the strata sizes 
N,, generally N AOPT1 * N pL his drawback can easily be 
overcome by centring the interest variable. We thus get: 


A 


Vaorric. = Ye 1 Sy) 


H 
>S, Ny yy (x, — X,)(K, - X,)' 
hel NON a lereys 
N; l my 1 = 
xe —» (x, —X,)O, 7 
h=\ N, os ny, nN, keS, 


6.3 AOPT2-Estimator 


The AOPT?2-estimator can also be used in stratification. 
In this case, from (3.8) we get 


A 


Yaorr2 =n * & -X,)’ 


H 
i N, ae (x, - x) ~x,)' 


h=l Ue Uae es 


1 - 
ro Nea 


h=1 n), 


xO Y,) 


aay aE 


The AOPT2-estimator only needs the knowledge of the 
population mean vector x and of the stratum sizes N, . It 
has however a drawback, the x , are estimated and thus 
J x H degrees of freedom are lost. If the number of strata is 
large, this loss of degrees of freedom could increase the 


instability of this estimator when J x H is large. 


6.4 GREG-Estimator 


The GREG-estimator does not take into account the joint 
inclusion probabilities. It is given by 


=y,+-x,)) j)> —~ YS 


Y GREG 


Although this estimator is more stable, it is conditionally 
biased. Moreover, if we want to estimate the stratum sizes N, 
by the GREG-estimator, we do not find exactly N,. 
Indeed, if y,= 1 when keU, and y,=O when k€U,, 


then 


Nerec = N Yorec 


H 
=N,, + N(& -X,)’ y~->d 


h=1 nN, keS, Cy 


SOD bene 


h=1 ny, keS, Cy 


Since, in stratified sampling, NV, = N,, we get 


A & 4 A h 
Nerec = N, + N& -x,)' De yam ye 
Kel IU, ceess 1Ce 


Ni, 


Xx; 


h=1 Ny, keS, Cy, (6.14) 

Expression (6.14) shows that generally Nees NS 
Thus, the GREG-estimator destroys the stratification effect 
because it does not take the stratification into account. 
Indeed, the stratification is represented by the joint 
inclusion probabilities. In the GREG-estimator, only the 
first-order inclusion probabilities are used. On the other 
hand, it is easy to verify that the AOPT1 and AOPT2- 
estimator of N, are exactly equal to N,. The AOPT- 
estimators is thus calibrated on the N, . 

We propose to use the GREG-estimator in the following 
cases: when the sample size is small or if the number of 
strata is large and when the stratification gives poor 
auxiliary information on the interest variable. Indeed, in 
this case, the loss of precision due to the loss of degrees of 
freedom, will be more important than the precision benefit 
due to the optimality of the estimator. An interesting 
analysis of the benefit due to the optimal estimator is also 
given in Montanari (1998). 


6.5 GREG-Estimator With use of the Stratification 
Variables 


A variant of use of the GREG-estimator consists in 
re-using the stratification variables at the estimation stage. 
Consider the column vector 


= \7 
Wi, iz vey Zener ZeH) X,) 


where z,,=1 ifkeU, and 0 if not. This vector is thus 
composed of the values taken by the indicator variables of 
the presence of unit k in the H strata and of the values taken 
by the x-auxiliary variables. 

Now if w denotes the population mean of vectors w, 
and w, its Horvitz-Thompson estimator, the GREG- 
estimator using the auxiliary information w, is given by 
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h=1 Ny keS, Cy (6.15) 


pale 
iG 


The presentation of expression (6.15) can be simplified. 
Indeed, the following result was proved by Tillé (1994) and 
generalised by Sarndal (1996): 


Result 2: 


When the stratification variables are re-used at the 
estimation stage, and if the c, are equal into the strata 
(c, =c,,keU,) the GREG-estimator can be written 


-1 

a a A N a = \, 

58h - de mfp, -8y 
h=1 1),C, keS, 

EN, 

x h 


> (%,-X,)0,-¥,)- (6.16) 


h=1 nN,C), keS, 


A proof of Result 2 is given in the Appendix. Note that 
expression (6.16) is equal to the AOPT2-estimator when 


Reels I/n, 


ress 

for h = 1,...,H, where C>0 is aconstant. When the f, are 
small and the n, are large and proportional to the N, both 
estimators are equivalent. This result shows that with the 
conditional approach, the fact that the sampling design is 
stratified is automatically taken into account in the esti- 
mation method. The GREG-estimator does not take into 
account the stratification effect and thus it is necessary to 
reintroduce the stratification variables at the estimation 
stage so as not to lose the stratification effect. 


7. SIMULATIONS 


A set of simulations was carried out in order to compare 
the four following estimators: y,,Yaopric Yaorr, 
Yorrc: Lhe population is made up of 4 strata of 250 units 
(N=1,000). A stratified sampling design is applied with 
proportional allocation. For each simulation, 10,000 
samples of size n =100 are selected and the following ratios 
has been estimated: 


M, = MSE (y,)/MSE (y,) =1, 
M, = MSE (j’¢pec)/MSE (y,); 
M, = MSE (\popric)/MSE (y,); 
M, = MSE () ,opp)/ MSE (y,)- 
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The populations are generated by means of the following 
models: P,:x, =a,,y, =€,,kEU, (total independence), 
Jen Ape aay e= oxy rey ke U, (dependence between x and 
y), Py: x, =a,,y, =x, + 2h(k) +e,,kEU, (dependence be- 
tween x, y and the strata), P,: x, =a,,y, = exp(10 + 2x, 
(+ 10h(k) + e,),k € U,non-linearity and dependence between 
x, y and the strata), P5: x, = a,,y, = exp(e, +3x,) + 3h(k), 
ke U, (non-linearity and dependence between x,y and the 
Strata), P.:x,=a,,y, =3h(k)+e,,keU, (strong de- 
pendence between y and the strata), Pe: pap.) a= 
SOh(k) + e,, KE U, (very strong dependence between y and 
the strata), where a, and e, are independent normal 
variable with mean equal to 0 and variance equal to 1, and 
h(k) is the number of the stratum of unit k. Results of the 
simulations is given in Table 1. 


Table 1 
Results of 10,000 Simulations 


Allie igs 2) Oa Fn ain ee) 


1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 


M, 
M, 1.0070 0.0906 0.5180 0.9261 0.9263 1.1047 38.5104 
M, 1.0069 0.0906 0.4835 0.9277 0.9269 1.0015 1.0123 
M 


> 


1.0060 0.0936 0.4850 0.9257 0.9239 1.0006 1.0111 


Table 1 shows that the GREG-estimator provides a good 
estimation when the stratification variables are not 
correlated to the interest variable. Nevertheless, the more is 
the dependence between the stratification variable and the 
interest variable, the more is the gain of precision of 
Y aortic 29d Yaopr2: The loss of degrees of freedom of the 
optimal estimator does not seem to affect the precision for 
this sample size. Moreover, the gain obtained by the 
knowledge of the population stratum is not significant for 
this sample size. For all these cases, the optimal estimator 
is thus clearly preferable to the GREG-estimator. 


8. A THIRD - ORDER PROBLEM 


The complexity of determining the conditional weights 
is not a specific problem of the SCW-estimator. It is due to 
the general problem of estimation with auxiliary infor- 
mation used a posteriori when an auxiliary variable is 
already used a priori in the sampling design. This problem 
can be presented as a third-order interaction problem among 


— the interest variables; 


— the sampling design and thus the auxiliary variables 
used a priori; 


— the auxiliary variables used a posteriori. 
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Indeed, the use of auxiliary information at the estimation 
stage leads to the following problem: how do these 
auxiliary variables used a posteriori interact with the 
interest variable through a given sampling design? The 
problem being complex, we have to take into account the 
relationships between each set of variables above as well as 
the third-order interactions among these three sets of 
variables. 

It is very difficult to find a really operational estimator 
which uses the three second-order interactions and the 
third-order interaction. For this reason, one can attempt to 
simplify the problem. The neutralisation of one of the 
aspects of this problem significantly simplifies the research 
of an estimator. Most of the possible simplifications have 
already been studied. We can cite some of these: 


— If no auxiliary information is used a posteriori (except 
the population size N ) we can only construct the 
Horvitz-Thompson estimator or Hajek’s ratio (1971). 


— Searching general solutions using auxiliary information 
for simple random sampling does not pose major 
problems. In this case, no auxiliary information is used 
a priori. 

— Using a superpopulation model allows one to fix a 
relation existing between the interest variable and the 
auxiliary variables used a posteriori. In this case, it is 
possible to determine the optimal estimator (under the 
model). 


— For the GREG-estimator and also for the calibration 
methods see Deville and Sarndal 1992), in the design- 
based inference framework, only the first-order probabi- 
lities are retained from the sampling design. A simple 
random sampling is thus treated in the same way as a 
stratified design for which the first-order inclusion 
probabilities are all equal. For this reason, a regression 
estimator applied to a stratified design generally 
destroys the calibration on the stratum frequencies 
given by the a priori stratification. In this case, the 
simplification arises because all the contributions of the 
auxiliary variables used a priori to the sampling design 
can be described only by the first-order probabilities. 


— Finally, for the optimal linear estimator, it is implicitly 
supposed that the dependence between  Horvitz- 
Thompson estimators of the variables x and y is linear. 
Obviously, these estimators neglect the non-linear 
dependence between the estimators. Nevertheless, it 
takes into account the joint inclusion probabilities. 
When the sampling design is stratified, the estimator 
remains calibrated on the population stratum 
frequencies. 


The CW-estimator takes into account this third-order 
interaction. Moreover, in this case, auxiliary information 
does not necessarily intervene in a linear way. The weights 
depend on both the sampling design and the auxiliary 
statistic. These weights applied to the values taken by the 


interest variable take into account all the interactions 
between the three variable groups. 

The methods using conditional inclusion probabilities 
are interesting for different reasons: they give a general 
frameallowing to search and conceive estimators using 
auxiliary information without reference to a superpopu- 
lation model and lead to valid conditional inference. They 
bring into prominence all the complexity of the estimation 
problem with auxiliary nformation. According to the known 
auxiliary information, we can find either known results (as 
for example post-stratification) or very complex and not 
really operational estimators. However, a first approxi- 
mation leads to a known result, i.e. the optimal linear 
estimator. 
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APPENDIX: PROOF OF RESULT 1 AND 2 


Lemma | will be used in the proof of Result 1. 
Lemma 1 If R,;' -R!=0,,,(n71), then |R,|"|R| = 
1 + O(n '), where Rand R , are defined as in hypothesis 
(ii). 
Proof 
[R,; -R R= 0,,,(2°)R 
and thus 
|R, R| =|1+0,,,(@2)R| = 
[1 +O )f + OM) =1+0("7) 

where I isa JxJ identity matrix. Thus, 

|R,| u 1 

IRI 1+0@% 


Note that lemma 1 is a consequence of hypothesis (ii) . 


= linOGr ye 


Proof of Result 1 
If we define 


j= tonal kee 
Nn, 


by hypothesis (i), we get: 


Be a nPr(x,) : f(x,) 
rT | yp ioNit, Pex Wess 4 f Gc 
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where f (resp. f,) is the density function of a multivariate 
normal variable with mean x (resp. x | ,) and variance- 
covariance matrix & (resp. & Phe Thus, 


] 


exp -—(X,-x)'E""(X, -X) 


p 
A ” p} 
a, &,)=4—=! (8.17) 
a = \wescilje = 
= Pa ey) Pe (x, -X),) 
k 
If we also note 
Rave ere 
REV LV @, 
Xo =.Vc (xix), 
Tea Vax Xk): 
and 
Ry be x 
eed. a exp ; ce fr, - R") x°, (8.18) 
we get 
|R| “exp - —x, R™ x, 
a,(X,) = d, 


Vs 1 Ac Pty pee 
IR,| exp ae BS = yp) R, (x, ny) 
1 = 6 
; cepa Ri (y, - 2x). (8.19) 
By using a Taylor development for the vector y, of (8.19), 
we get 


a, (X,) 1G WRi Xn) +ROY.). (8.20) 


where 


1 = -¢ 
Ry) = enti R (yO - 2x¢ ] 


x {IRE O® - 5 ]RY @® - x9) - Ry. 


and yo is a vector whose elements are included between 
the correspondent elements of y, and 0. By hypothesis (iii), 
we directly get 


Ry) = O,(n*). 


On the other hand, we have by hypothesis (ii), lemma 1 and 
(8.18) that 
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ee d,|1 + O(n *)]exp| SO ai} 


=4,{1 +0,(n)} (8.21) 


By (8.20) and (8.21), we get 
a(x,) =4,]1+0,'(n| 
{1-y(R7+0,,,@))x¢ + 0,(n} 
=d,{1-y{RIXS +0,(n-} 
=a 40 3G xe) xg x) OG) 


Finally, we get 


Proof of Result 2 


In Sandal (1980), we see that the GREG-estimator 
presented in (6.15) can also be written: 
Yortow “Ix *N Ay Wy - USMS Wes)’ 

(W'C, I, W,) WiC, Oy, 
where 1,,(resp.1,) is a column vector composed of NV 
(resp. n) ones, II, (resp. If, ) is a diagonal matrix having 
the inclusion probabilities of the population (resp. sample) 
units on its diagonal, C, is a diagonal matrix having the c, 
of the sample units on its diagonal, y é is a column vector 
composed of the values taken by the interest variable y in 
the sample, 


and W, isa nx (H + J) matrix composed of the n rows of 
W , corresponding to the units selected in the sample. 


The matrix to invert can be partitioned into four parts: 
Pret _|A D 
(W;5C; I; W,) = D’B | 
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where A is an Hx H matrix having N,/c,,h =1,..., H, on 
its diagonal, 


and 


By using the technique of matrix inversion by partition, we 
get 


As DB'D’)! -A'DQ 
-QD’A! Q 
where Q =(B -D’A'!D)". Since 


(WiC, I, W,)! 


GewWe tTWeiel e 

where 0 y 1S a column vector composed of H zeros, we get 
(1,W, -10, W,)/ (WiC, H, W,)! 

=(X, - ¥)'Q(-D’A™ 1.5) 


where I, ,) isa Jx J identity matrix. Since 


H aA 


N z a 
Oe » - ME (x, ~X,)(K&,-X,)'¢ 


h=1 nN), Cy keS, 


=i A A 
[DAT Tay yl etx Xe Sux] 
and 
NAY, 
Cc 
/ ut =I N y 
WC; Ws y.= HY H ; 
Cy 
N, 


art se XV 
h=1 nC) keS), 


(8.23) 


we get Result 2 by multiplication of (8.22) and (8.23). 
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On Robust Small Area Estimation Using a Simple 
Random Effects Model 


N.G.N. PRASAD and J.N.K. RAO’ 


ABSTRACT 


Robust small area estimation is studied under a simple random effects model consisting of a basic (or fixed effects) model 
and a linking model that treats the fixed effects as realizations of a random variable. Under this model a model-assisted 
estimator of a small area mean is obtained. This estimator depends on the survey weights and remains design-consistent. 
A model-based estimator of its mean squared error (MSE) is also obtained. Simulation results suggest that the proposed 
estimator and Kott’s (1989) model-assisted estimator are equally efficient, and that the proposed MSE estimator is often 
much more stable than Kott’s MSE estimator, even under moderate deviations of the linking model. The method is also 


extended to nested error regression models. 


KEY WORDS: Design consistent; Linking model; Mean squared error; Survey weights. 


1. INTRODUCTION 


Unit-level random effects models are often used in small 
area estimation to obtain efficient model-based estimators 
of small area means. Such estimators typically do not make 
use of the survey weights (e.g., Ghosh and Meeden 1986; 
Battese, Harter and Fuller 1988; Prasad and Rao 1990). As 
a result , the estimators are not design consistent unless the 
sampling design is self-weighting within areas. We refer the 
reader to Ghosh and Rao (1994) for an appraisal of small 
area estimation methods. 

Kott (1989) advocated the use of design-consistent 
model-based estimators (i.e., model assisted estimators) 
because such estimators provide protection against model 
failure as the small area sample size increases. He derived 
a design-consistent estimator of a small area mean under a 
simple random effects model. This model has two compo- 
nents: the basic (or fixed effects) model and the linking 
model. The basic model is given by 


Vy = 6, + €y>J Seer Vt lal tlt (1) 


where the yj are the population values and the ey are 
uncorrelated random errors with mean zero and variance o; 
for each small area i(=1,2,...,m). For simplicity, we 
take 0. as the small area mean 7 = 1s y,,/N;, where N; is 
the number of population units in the i I- th area. Note that 
Y,=0,+E, and E, = yey /N; = 0 if N, is large. 

The linking model assumes that 9, is a realization of a 
random variable satisfying the model 


8 =H +y; (2) 


where the v. are uncorrelated random variables with mean 
i 2 

zero and variance o,. Further, {v,} and {e,} are assumed 

to be uncorrelated. 


1 


Statistics, Carleton University, Ottawa, Ontario, K1S 5B6. 


Assuming yi the model (1) also holds for the sample 
{ Vij» J=1,2,...,n51=1, 2, ...,m} and combining the sample 
model with the cite oath Kott (1989) obtained the 
familiar unit-level random effects model 


ia Mees | ee 


Wet = 


Deg mY Fe ey uae F 


/m, (3) 
also called the components- OE model. It is custom- 
ary to assume equal variances o, = 6’, although the case of 
random error variances has also been studied (Kleffe and 
Rao 1992; Arora ae Lahiri 1997). 

Assuming o, =o6°, Kott (1989) derived an efficient 
estimator the of 0, which is both model-unbiased under (3) 
and design- omerienn He also proposed an estimator of its 
mean squared error (MSE) which is model unbiased under 
the basic model (1) as well as design-consistent. But this 
MSE estimator can be quite unstable and can even take 
negative values, as noted by Kott (1989) in his empirical 
example. Kott (1989) used his MSE estimators mainly to 
compare the overall reduction in MSE from using 9,, in 
place of a direct design-based estimator y,, given by (4) 
below. He remarked that more stable MSE estimators are 
needed. 

The main purpose of this paper is to obtain a pseudo 
empirical best linear unbiased prediction (EBLUP) estimator 
of 8, which depends on the survey weights and is design- 
consistent (section 2). A stable model-based MSE estimator 
is also obtained (section 3). Results of a simulation study in 
section 4 show that the proposed MSE estimator is often 
much more stable than the MSE estimator of Kott, as 
measured by their coefficient of variation, even under 
moderate deviations of the linking model (2). Results under 
the simple model (3) are also extended to a nested error 
regression model (section 5). 


N.G.N. Prasad, Department of Mathematical Sciences, University of Alberta, Edmonton, Alberta, T6G 2G1; J.N.K. Rao, Department of Mathematics and 
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2. PSEUDO EBLUP ESTIMATOR 


Suppose wW ,, denotes the basic design weight attached to 
the j-th sample unit (j =1,2,...,n,) in the i-th area 
(i=1,2,...,m). A direct design-based estimator of 0, is 
then given by the ratio estimator 


Fw = Dy yy / Dy y= Dy w (4) 


where Wi = Wi, i a The direct estimator y ,, is design- 
consistent but fails to borrow strength from the other areas. 

To get a more efficient estimator, we consider the 
following reduced puoi. obtained from the combined 
model (3) with o, = 07: 


Was = S, wh ay; e;) 


= ora ene (5) 


where the e ,, are uncorrelated, random variables with mean 
zero and variance 0. = GC). w, The reduced model (5) is 
an area-level model similar to the well-known Fay-Herriot 
model (Fay and Herriot 1979). It now follows from the 
standard best linear unbiased prediction (BLUP) theory 
(e.g., Prasad and Rao 1990) that the BLUP estimator of 
9, = +v, for the reduced model (5) is given by 


6,=f1, +4, (6) 
where 

V ie Oe 7 H,,) 
Within eye V4) (eye sandy y, 0 Fie +6,). Note 


that 6, is different from the BLUP estimator under the full 
model (3). We therefore denote 0, as a pseudo-BLUPF esti- 
mator. The estimator (6) may also be written as a convex 
combination of the direct estimator y,, and [1 ,: 


OF =a Clay a ue 7) 
The estimator 0. depends on the parameters oO and o” 
which are generally unknown in practice. We therefore 
ee o and o? in(7) by model-consistent estimators om 


and 6? under the original unit-level model (3) to obtain the 
estimator 


8,=F Viv t (1 -Fy) By (8) 


where 


and 


The estimator 6, will be referred to as peence, seer 
estimator. We use standard estimators of oe and o*, based 
on the within-area sums of squares 


OV a G2 VE) 
pe) 
and the between-area sums of squares 


OF= nig) 


i 


where y = )’.n,y ,/ )\,n, is the overall sample mean. We have 


eae 


Py) ae 
and 6), = max(o |, 0) where 


6. =[Q, -(m-1)@]/n* 


with 


=a, oe) eaDe. he 


It may be noted that o and o? are either not estimable or 
poorly estimated from the reduced model (5) due to identi- 
fiability problems. Following Kackar and Harville (1984), 
it can be shown that the pseudo-EBLUP estimator 0. is 
model-unbiased for 0. under the original model (3) for 
symmetrically distributed errors {v,} and { ex}, not neces- 
sarily normal. It is also design consistent, assuming that 
n. ey w, is bounded as n, increases, because y,, converges 
in probability to | as ip +00 oa of the validity of the 
model (3), assuming So and 6? converge in probability to 
some values, say, oe and o”. 

Kott’s (1989) model-based estimator of 0; is obtained by 
taking a weighted combination of y,, and eran y ,» that 
is, 


ie 
05 Cro i 


Ii 


Frc Seale oye, 


and then minimizing the model mean squared error (MSE) 
of f,(a,,c“) with respect to a, and c(’) subject to model- 
unbiasedness condition: )’,,,c/ = 1. This leads to 


6 hac) (9) 
with 


Cr -|(616 +m | D [Gre +m,'] 


h#t 
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The estimator 6 ix 18 also model-unbiased and design- 
consistent. In a previous version of this paper, we proposed 
an estimator similar to (9). It uses the best estimators of u 
under the unit-level model, based on the unweighted means y ,, 
rather than fi, the best estimator of 1 under the reduced 
model (4), based on the survey-weighted means y , 


3. ESTIMATORS OF MSE 


It is straightforward to derive the MSE of the pseudo- 
BLUP estimator @ , under the unit level model (3). We 
have 


MSE (6 ,) =E(6 ,-9,)° =8,,(05, 07) +8);(05,07) (10) 


with 


£,;(0 6”) = (1 - ¥,,)5, 


and 
8y;(0,,07) = 06(1 ~ Y,)° / Dy Yow: 

The leading term, Si (9), 0”) is of order O(1) , while the 
second term, g,; (02, 6), due to estimation of u is of order 
O(m~') for large m. 
 Anaive MSE estimator of the pseudo-EBLUP estimator 
§, is obtained by estimating MSE(0 ,) given by (10): 

mse, (6,) = g,,(6,, 6?) + g,,(6,, 6). (11) 
But (11) could lead to significant underestimation of 


MSE ( 6 i, because it ignores the uncertainty associated with 
& and 6”. Note that 


MSE(6,) = MSE(6,) + E(6, - 6,) (12) 
under normality of the errors {vj} and {ej} so that 
MSE(6. ;) 1s always smaller than MSE(6, ); see Kackar and 
Harville (1984). 

To get a “correct” estimator of MSE(6, ), we first 
approximate the second order term EF (6, =6 Ji in (12) for 
large m, assuming that {v,} and {e;} are normally distri- 
buted. Following Prasad and Rao (1990), we have 


E(6, - 6; = 83,0, me) . 
where the neglected terms are of lower order than m~!, and 
83 (Gy O°) = Yay ~ Yay) Sy 
{V(6~) -2(03/07) Cov(6~, 67) + 
(05/07)? Var(6")}; (14) 
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oe: Appendix 1. The variances and covariances of & and 
or are also given in ue Appendix 1. It can be shown that 
81 (6,, 6° i+ gGy 6’) is approximately unbiased for 
Blo , 0”) in the sense that its bias is of lower Ge than 
{see Appendix 2). Similarly, g,,(6;, 6&6 2 ne 
ej(68) ne approximately unbiased for g,,(o,,6 2) 
and Pe tx 6”), respectively. It now follows that an approxi- 
mately model-unbiased estimator of MSE(6, ) is given by 
mse(6,,) = g,,(6,, 67) + 8,;(6), 6) + 285,(6,,67). (15) 
For the estimator 0. given by (9), Kott (1989) proposed an 
estimator of MSE as 


mse (6...) =(1 -24,)v “(y, +4 (5 


oe: ca , (16) 


ia 

where v “(y,,,) 1s both a design-consistent estimator of the 
design-MSE of y,, and a model-unbiased estimator of the 
model-variance of y ,, under the basic model (1). Since a, 

converges in probability to zero as n,-~, it follows from 
(16) that mse (6, x) 18 also both design- -consistent and model 
unbiased assuming only the basic model (1). However, 
mse (0 ix) is unstable and can even take negative values 
when G,, exceeds 0.5, as noted by Kott (1989). 

Note that our MSE estimator, mse ( 6. ;) is based on the full 
model (3) obtained by combining the basic model (1) with 
the linking model (2). However, our simulation results in 
section 4 show that it may perform well even under moderate 
deviations from the linking model. 


4. SIMULATION STUDY 


We conducted a limited simulation study to evaluate the 
performances of the proposed estimator oe given by (8), and 
its estimator of MSE, given by (15), relative to Kott’s 
estimator 0 ,, given by (9), and its estimator of MSE, given 
by (16). We studied the performances under two different 
approaches: (i) For each simulation run, a finite population 
of m = 30 small areas with N. = 200 population units in each 
area is generated from the assumed unit-level model and then 
a PPS (probability proportional to size) sample within each 
small area is drawn independently, using n,=20. (ii) A 
fixed finite population is first generated from the assumed 
unit-level model and then for each simulation run a PPS 
sample within each small area is drawn independently, 
employing the fixed finite population. Approach (i) refers 
to both the design and the linking model whereas approach 
(ii) is design-based in the sense that it refers only to the 
design. The errors {v.} and {é;, } are assumed to be 
normally distributed in generating the finite populations 
{yj> i=1,2,...,30;7 = 1,2, ...,200}. We considered two 
cases: (1) The linking model (2); is true with p = 50. (2) The 
linking model is violated by letting u vary across areas: 
OOM be 2 Or aod, 7 = lll 2,0, 205) = 100, 
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i=21,22,...,30. To implement PPS sampling within 
each area, Size measures ZL =i 2 OO; pas oo LOO 
were generated from an exponential distribution with mean 
200. Using these z-values, we computed selection 
probabilities pj = z,/ oD; zj for each area i and then used 
them to select PPS with replacement samples of sizes 
n, ite by taking n= 20, and the associated sample values 
ty } were observed. 

the basic design weights are given by W =n- Die so 
that w,, = =Pi vk yy a Using these weights. ‘and the asso- 
ciated sample values y,, we computed estimates 6, and Oe 
and associated estimates of MSE, and also the ratio ihe 
y ,, for each simulation run; the formula for v *(y ,,) under 
PPS sampling is given in Appendix 3. This process was 
repeated R=10,000 times to get from each run 
PCNA ceded) 6. ;(r) and 6, x (7) and associated MSE esti- 
mates mse. (6, (r)) and es x) ix(7)) and also the direct 
estimate y ,_ (r). Using these values, empirical relative 
efficiencies (RE) of 6, and Oe over y ,,, were computed as 


RE(6,) = MSE, (y,,)/ MSE, (6,) 
and 


RE(6,,) = MSE, (y,,.) /MSE, (6,,), 
where MSE, denotes the MSE over R = 10,000 runs. For 
example, MSE,(6,) =), [6,(r)-Y¥,(r)?/R, where 
Y (r) is the i-th area population mean for the r-th run. 
Note that Y ,(7) remains the same over the runs r under the 
design-based approach because the finite population is 
fixed over the simulation runs. 

Similarly, the relative biases of the MSE estimators were 
computed as 


RB[mse (6,)] = [MSE, (6,) - E,mse(6,)]/ MSE, (6,) 
and 
RB[mse (6 ,,)] = [MSE, (6 x) - E,mse (6 ,x)]/ 


MSE. (6 


where E, denotes the expectation over R = 10,000 runs. 
For example, E mse (6, )= ee mse(6, (r))/R. Finally, the 
empirical coefficient of variation (CV) of the MSE 
estimators were computed as 


ix)» 


CV[mse 6;)] = [MSE, {mse (6,)}]’?/ MSE, (6,) 
and 


CV|mse (6 ;,)| = [MSE, {mse (6 ;,)}]'/ MSE, (6 x). 


Note that MSE, [mse (8,)] =Y,, [mse (6, (r)) - MSE, (6,)°/R 
and a similar expression for MSE,[mse(8,,)]. 


Table 1 reports summary measures of the values of 
percent RE, IRBI and CV for cases (1) and (2) under 
approach (i). Summary measures under approach (ii) are 
reported in Table 2. Summary measures considered are the 
mean and the median (med) over the small areas 
ba 1230s 


Table 1 
Relative Efficiency (RE) of Estimators, Absolute Relative Bias 
(IRBI) and Coefficient of Variation (CV) of MSE 
estimators (6 =5.0, n=20): Approach (i) 


fo} RE% IRBI% CV% 


A 


OF 6, mse (6,,.) mse (6 ,) mse (6,,,) mse (6,) 


Case 1 
1 Mean 190177 15.3 3.5 148 DS 
Med 190182 14.8 2.6 148 25 
2 Mean 126123 Sel BZ 48 8 
Med 127 124 5.6 2.9 48 8 
3) Mean eisai l 3.5 | 35 6 
Med (i Thi 3D 3.0 35 6 
Case 2 
1 Mean 108103 10.4 7.9 39 6 
Med 108104 11.1 Us 38 5 
2 Mean 108104 13.3 8.9 39 6 
Med 108104 §=13.6 719 339) 6 
3, Mean 104103 11-5 UP 3M =) 
Med LOSBLOS eee lSal 8.0 36 6 
Case 1: H,=50, (=12 ee OC aser: M,=50, (=e 10; 
W=55, i=11,12,...,20; W;=60, =21,22,...,30. 


It is clear from Tables 1 and 2 that 6x and 6, perform 
similarly with respect to RE which decreases as 6,/6 
increases. Under approach (ii), RE is large for both cases 1 
and 2 when o, /o <0.4, whereas it decreases significantly 
under approach (i) if the linking model is violated (case 2); 
the direct estimator y , is quite unstable under approach (ii). 

Turning to the performance of MSE estimators under 
approach (i), Table 1 shows that IRBI of mse (6, ) is neglig- 
ible (<4%) when the linking model holds (Case 1) and that 
it is small (<10%) even when the linking model is violated, 
although it increases. The estimator mse (6 ix) has a larger 
IRB! but it is less than 15%. The CV of mse (6, ) is much 
smaller than the CV of mse (6 ix) for both Cases 1 and 2. FOr 
example, when the model holds (Case 1) the median CV is 
25% for mse (6, ) compared to 148% for mse (6 ix) When 
o,= 1; the median CV decreases to 8% for mse (6, ) 
compared to 48% for mse (6 ix) When o, = 2. This pattern 
is retained when the model is violated (Case 2). It may be 
noted that the probability of mse (6 ix) taking a negative 
value is quite large (>0.3) when o,/6 < 0.4. 

Under approach (ii), Table 2 shows that IRBI of mse (6, ) 
is larger than the value under approach (i) and ranges from 
15% to 25%. On the other hand, IRB! of mse (6 ix) 18 smaller 
and ranges from 4% to 15%. The CV of mse(6,,), how- 


Survey Methodology, June 1999 


ever, is much larger than under approach (i). For example, 
the median CV for Case | is 295% compared to 38% for 
mse(0,) when o,=1 which decreases to 122% compared 
to 23% when o,=2. A similar pattern holds for case 2 
where the fixed finite population is generated from the 
model with varying means. 


Table 2 
Relative Efficiency (RE) of Estimators, Absolute Relative Bias 
(IRB) and Coefficient of Variation (CV) of MSE 
estimators (o=5.0, n=20): Approach (ii) 


0, RE% IRBI% CV% 


6x 6, mse (6) mse (6,) mse (6 ,,) mse (6) 


Case 1 
Ie Meaney 2832815 7 14°2 25.4 289 39 
Meda 275 279 15.0) 24.7 295 38 
2 Mean 180182 U8 19.2 115 24 
Med 177 181 6.9 18.7 i2 23 
3 Mean 129129 4.8 14.8 68 24 
Med = 129 128 4.2 13.9 65 24 
Case 2 
1 Mean 278276 15.7 26.8 291 4] 
Med 271275 16.6 26.2 297 40 
2 Mean 175177 8.8 20.7 117 26 
Median liGaliai7) 8.5 20.3 124 DS) 
3 Mean 124124 6.3 16.2 70 25 
Medi 1255124 6.8 15.5 67 26 


Case 1: MW, =50, J= ee SU ae@asee: HW ,=50, Al oot calle 
M,=55, =11,12,...,20; UW, =60, =21,22,...,30. 


To reduce IRBI of mse (6,) under approach (ii), one 
could combine it with mse(@,,) by taking a weighted 
average, but it appears difficult to chose the appropriate 
weights. The weighted average will be more stable than 
mse (0 ,,). 


5. NESTED ERROR REGRESSION MODEL 


The results in sections 2 and 3 can be extended to nested 
error regression models 


ae / oi coe Re 
Yj = x;,B +V, +e, J =i lS 2, cer 12e nm 


(17) 


using the results of Prasad and Rao (1990), where xij isa 
p-vector of auxiliary variables with known population mean 
X , and related to y,,, and B is the p-vector of regression 
coefficients. The reduced model is given by 


Vig hig POV Cty (18) 
with x ;,, = )),w,x,,. Model-consistent estimates 6. and &? 
are obtained from the unit-level model (17), employing 
either the method of fitting constants (Prasad and Rao 
1990) or REML (restricted maximum likelihood) estimation 
(Datta and Lahiri 1997). 


Ta 


The pseudo-EBLUP of 6, = X/ B + v, is given by 
Ca wet a Ya) % Pigs (19) 
where 


B, 7 OS: (pecs DS. ‘Pesos 


An approximate model-unbiased estimator of MSE (6,) is 
given by (15) with 


g,,(6,, 67) =(1 -7,,) 5 


as before, 


6 (X; Se gor OS eee Okan Rees 
and g,( é, 6”), obtained from (14), involves the estimated 
variances and covariances of 6‘, and 6”. The latter can be 
obtained from Prasad and Rao (1990) for the method of 
fitting constants and from Datta and Lahiri (1997) for 
REML. 


6. CONCLUSION 


We have proposed a model-assisted estimator of a small 
area mean under a simple unit-level random effects model. 
This estimator depends on the survey weights and is design- 
consistent. We have also obtained a model-based MSE 
estimator. Results of our simulation study have shown that 
the proposed MSE estimator performs well, even under 
moderate deviations of the linking model. The proposed 
approach is also extended to a nested error regression model. 
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APPENDIX 1 
Proof of (13): 


From general results (Prasad and Rao 1990) we have 
E(6,-6 ,)° = tr A,(o,, 0”) B.(o,, 0°), 


2 ; oS) 
where B.(o, » 6”) is the 2 x 2 covariance matrix of 6‘, and 
6’, and A,(o,, 6”) is the 2 x 2 covariance matrix of 
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Now, noting that 


00; & N iv y Yin (1 Yn) = 
do. do. © o. ot 
30; = ee. y we Yiw) y 
CGF VOG7hn, o ae 
and V(y,,) = o +0.= o/Y,,5 we get 
1 -o, / 0? 


Dae S55) D7) 
A (OMO ) = vet = 68) 0, ’ 
= Oo) Gam ey 


Vv 


and hence the result (14). 
Covariance matrix of ¢% and 67: 


Under normality, we have 


VG) =20°/()), n,m), 

V(6_) =2n,” 

lot - Lids he A>) Re m) +2n.0?o, +n, ,o. 
and 


Cov(6?, 6) = -(m - 1)n,'V(6?), 


where 
na= Don =2)) np / Yin mf (af: 


see Searle, Casella and McCulloch (1992, p. 428). 


APPENDIX 2 


Proof of Elg,,(6;, 67) +g, ,(6,567)] & 8,;(6,, 07): 


By a Taylor expansion of £,,(6,5 6?) around (07, 0”) to 
second order and noting that E(6*-0*)=0 and 
E(6, - 0) = 0, we get 


Eee, 6°) -2,,(6,, 0°)| 
: = 1r[D,(0; 0° B,(6, .0*)} 
where Di(o,, 0”) is the 2 x 2 matrix of second order deriv- 


atives of £ (0. o”) with respect to oO and 67. It is easy 
to verify that 


i Do, 0°)B,(02, 0°)| = BIG Ga), 


Now, noting that E [g,,(6,, Gayhe PGs o”) we get the 
desired result. 


APPENDIX 3 


The design-based estimator of variance of y ,, under PPS 
sampling is given by 


Vy) = —— Wg Og Dwg) 
m— | j 
Kott (1989) model-assisted variance estimator is 
eat OS Ne {VF iy) EVF iy YT iy) 


(= i| Wij (Vy Pin) 


J 


nm 2 avs 
» w( te 2w = ys 5) 
J J 

where E and V denote expectation and variance with respect 


to the basic model (1). 
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Small Area Estimation Using Multilevel Models 


FERNANDO A.S. MOURA and DAVID HOLT’ 


ABSTRACT 


In this paper a general multilevel model framework is used to provide estimates for small areas using survey data. This class 
of models allows for variation between areas because of: (i) differences in the distributions of unit level variables between 
areas, (ii) differences in the distribution of area level variables between areas and (iii) area specific components of variance 
which make provision for additional local variation which cannot be explained by unit-level or area-level covariates. Small 
area estimators are derived for this multilevel model formulation and an approximation to the mean square error (MSE) of 
each small area estimate for this general class of mixed models is provided together with an estimator of this MSE. Both 
the approximations to the MSE and the estimator of MSE take into account three sources of variation: (i) the prediction 
MSE assuming that both the fixed and components of variance terms in the multilevel model are known, (ii) the additional 
component due to the fact that the fixed coefficients must be estimated, and (iii) the further component due to the fact that 
the components of variance in the model must be estimated. The proposed methods are estimated using a large data set as 
a basis for numerical investigation. The results confirm that the extra components of variance contained in multilevel models 
as well as small area covariates can improve small area estimates and that the MSE approximation and estimator are 


satisfactory. 


KEY WORDS: Small area estimation; Mixed models; Multilevel models; EBLUE. 


1. INTRODUCTION 


The need for small area (and small domain) estimates 
from survey data has long been recognized. The difficulty 
with the production of such estimates is that for most, if not 
all, small areas, the sample size achieved by a survey 
designed for national purposes is too small for direct esti- 
mates to be made with acceptable precision. Early attempts 
to tackle this problem using methods such as synthetic 
estimation (Gonzalez 1973) involved the use of auxiliary 
information and the pooling of information across small 
areas. An excellent review and bibliography are given by 
Ghosh and Rao (1994). 

Empirical studies show that such methods made too little 
provision for local variation and consequently the resulting 
small area estimates were shrunk too far towards a pre- 
dicted mean. More recent approaches (e.g., Battese and 
Fuller 1981 and Battese, Harter and Fuller 1988) use some 
components of variance model, or equivalent, to provide for 
local variation. Empirical studies show the superiority of 
this approach (e.g., Prasad and Rao 1990). 

This paper proposes a general multilevel model frame- 
work for small area estimation. This involves the potential 
to use auxiliary information at both the unit and small area 
level. In addition any of the regression parameters, rather 
than just the intercept as proposed by Battese and Fuller 
(1981), may be treated as varying randomly between small 
areas. The local variation is provided for by using diffe- 
rences between the means of unit level auxiliary variables, 
the small area level variables, and the various components 
of variance which allow variation between areas. 


For this general model, the small area predictor is 
obtained. In addition, an approximation to the mean square 
error (MSE) of each separate small area prediction and an 
estimator of this MSE are developed. 

The numerical study, based on a large data set from 
Brazil shows that such models may be useful for predicting 
small area estimates. The robustness of the approach to mis- 
specification of the variance-covariance matrix of the small 
area random effects and misspecification of small area 
covariates are also investigated. Further numerical results 
demonstrate the success of the MSE approximation and its 
estimator. 


2. THE MULTILEVEL MODEL FRAMEWORK 


2.1 Introduction 


We consider the following multilevel model for 
predicting the small area means: 


Y, = X;B; + &; 


BeaZiyy, i= 1).,m (2.1) 


where Y;, is the vector of length n, for the characteristic of 
interest for the sample units in the i-th small area, 
seen X, is the matrix of explanatory variables at 
sample unit level; Z, is the design matrix of small area 
variables; y is the vector of length q of fixed coefficients 
and v, = Oa is the vector of length (p +1) of 
random effects for the i-th small area. We assume the 
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following about the distribution of the random vectors: (a) 
the v. are independent between small areas and have a joint 
distribution within each small area with E(v,) = 0 and (b) 
VOye By (b) The e€,s and v,s are independent and 
Vie.) = = 

For the =e population (2.1) applies with n, replaced 
by N., the small area population sizes. 

The set of m equations in (2.1) can be concisely written 
by stacking them as 


YS XL OXY ss (22) 


It is worth noting that the random intercept model (see 
section 2.3) can be regarded as a special case of the model 
(2.1) where Z, is equal to the identity matrix for each small 
area and Q has all terms constrained to be zero except the 
one corresponding to the variance of the intercept term. 
Other intermediate models exist, for instance, when Q is 
diagonal so that the small area regression coefficients are 
random but uncorrelated between covariates. 

Holt (in Ghosh 1994, page 82) observes that the advan- 
tage of the model (2.1) over other competitors is that it 
effectively integrates the use of unit level and area level 
covariates into a single model. Besides the use of extra 
random effects for the regression coefficients gives greater 
flexibility in situations where it is not appropriate to assume 
the same slope coefficients apply for all small areas. 


2.2 Fixed and Component of Variance Parameter 
Estimates 


The fixed and components of variance parameters in the 
model (2.1) are y and @ = ([Vech(Q)]’, o”)’ respectively. 
Various methods for estimating these model parameters in 
the case of a general mixed linear model are available. Most 
of them, based on iterative algorithms, lead to the maximum 
likelihood estimator (MLE) or the restricted maximum like- 
lihood estimator (RMLE) under certain regularity conditions. 

Goldstein (1986) shows how consistent estimators can 
be obtained by applying iterative generalised least squares 
procedures (IGLS). He also proved its equivalence to the 
maximum likelihood estimator under normality. Later 
Goldstein (1989) proposed a slight modification of his algo- 
rithm (namely, restricted iterative generalised least squares 
(RIGLS)) which is equivalent to RMLE under normality. 
Unlike the IGLS estimates, the RIGLS estimation proce- 
dures provide unbiased estimates of the component of 
variance parameters by taking into account the loss in 
degrees of freedom resulting from estimating the fixed 
parameters. 

This work is confined to the RIGLS approach as in 
Goldstein (1989). The RIGLS procedure is described in 
details in Appendix A. 


2.3 The Estimator of the Small Area Mean 


Assuming the model (2.1) and considering that the 
population size N, in the i-th small area is large, we can 
write the mean for the i-th small area as 


(2.3) 


where X ; is the (p + 1) population mean vector for the i-th 
small area. 

An estimator of u, may be obtained by plugging the 
RIGLS estimators of y and @ in the respective terms of 
equation (2.3), where the predictor « of the i- ith small area 
random effect v, is given by ¥ = OX, ava '(Y, - -X,Z, 


-6?] - 64x06," Xa, and Go 


I 


where Oe 
(+ On Xe Xe QO)", 

This estimator of i, is known as Empirical Best Linear 
Unbiased Estimator (EBLUE) 


i Z,9 +X; %,. (2.4) 


Battese et al., (1981, 1988) propose and apply a random 
intercept model to provide small area estimates. In this 
case, the Empirical Best Linear Unbiased Estimator is 


—_ a 


Fie =X; Bes 

We use the label (RI) to imply a random intercept model 
since only the intercept of each small area is random while 
the other components of B remain fixed. 


2.4 Approximation to the Mean Square Error 
(MSE) 


Kackar and Harville (1984) show that, if 6 is a trans- 
lation invariant estimator of 8 and the random terms are 
normally distributed, the mean square error of a predictor of 
a linear combination of a fixed and random effect can be 
decomposed into two terms. The first one is due to the 
variability in estimating the fixed parameters when the 
components of variance are known, the second term comes 
from estimating the components of variance. 

Since under normality the RIGLS estimator is equivalent 
to the RMLE estimator and the RMLE is translation- 
invariant, Kackar and Harville’s (1984) results can be 
applied to the small area means estimators fi,, i=1, ...,m 

MSE(fi,) m Ea, = u]? a E(p, as yi] ¥ Elf; 7 fi,]° (2) 
where fi, is the BLUE of y,. 

The first term of (2.5), that is MSE[fi,], can be obtained 
by direct calculation as 


MSE(fi,) = X/(G,')7QX, + 


Ox (Ganz: 


m =I 
& 2F6,'x7x2, ZG aeee 6) 


i=] 


where G, =] +07 new X,Q. Kackar and Harville (1984) 
point out that the second term of (2.6) is not tractable, 
except for special cases, and propose an approximation to 
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it. Prasad and Rao (1990) propose an approximation to this 
second term and work out the details of their approximation 
for three particular cases: the random intercept model, 
random regression coefficient model and the Fay-Herriot 
model. They also give some regularity conditions for their 
approximation to be of the second order, and prove that 
their MSE approximation for the Fay-Herriot model is of 
the second order. Nevertheless, it seems to be more difficult 
to give general conditions for more complex models such as 
model (2.1). 

Applying Prasad and Rao’s approach, an approximation 
to the second term of (2.5) is developed in Appendix B. 

It is worth noting that the MSE approximation of (fi;) 
can be decomposed into three terms: 

MSE(f;) = T, + T, + T;, (2.7) 
where 7, and T, are respectively the first and the second 
term of equation (2.6) and T, is described in Appendix B. 

The term 7, is the variability of ff, when all parameters 
are known, the second term 7, is due to estimating the 
fixed effects and the third term 7, comes from estimating 
the components of variance. 

When sampling fractions are not negligible, estimators 
of the small area means can be built in the spirit of the finite 
population approach by predicting specifically for the non- 
sampled units: 

A; =f,y + X-Fi) 29 + ¥) S) 
where the superscript F indicates that a correction for the 
finite population sampling fraction f, was used; x, is the 
(p +1) vector of sample means. 

The MSE({i)) can be obtained by noting that 


fi; -Y,=(1-f) (x e@ Till Beals E°)| 


where X¥ = (1 -f) \(X, -f,x) and cs is the mean of €, 
for the non-sampled units in the i-th small area. Therefore 


MSE (fi) = (1 -f)?|MSE*(@,) +N, (1 -f)7? o’| (2.9) 


where MSE “*(fi,) is the equation (2.7) with x ; feplaced by 


2.5 Estimation of Mean Square Error 


It is common practice to estimate the MSE of a linear 
combination of the fixed and random effects in a mixed 
model as in (2.1) by replacing estimates of the components 
of variance respectively in the expression of MSE. This 
estimator ignores the contribution to MSE due to estimating 
the components of variance parameters. Several studies (see 
for example Singh, Stukel and Pfeffermann 1998 or 


15 


Harville and Jeske 1992) argue that this procedure tends to 
underestimate the MSE. Prasad and Rao (1990) reported a 
simulation study which showed that the use of this “naive” 
estimator leads to severe downwards bias. They also 
showed for the Fay-Herriot model (a special case of the 
model (2.1)), using “truncated Henderson” estimates for the 
variance components, that 


E(T,) = T, - T, + o@n™)); E(f,) = T, + om); 
E(f,) = T, + o(m”). 


Harville and Jeske (1992) establish some conditions for 
the unbiasedness of Prasad and Rao’s mean square error 
estimator. However, considering the more general model 
(2.1), again it seems more difficult to give general 
conditions for which the order of bias of Prasad and Rao’s 
estimator is o(m~'), especially if iterative procedures as 
RIGLS are used to obtain the parameter estimates. 

Nevertheless, motivated by the simulation study summa- 
rised in Section 3.4 and an extensive simulation study 
described in Moura (1994), we propose to use an estimator 
similar to Prasad and Rao’s for MSE(fi,): 


“A 


MSE = fale O07. (2.10) 
Where Ti are obtained from (2.5) by replacing o” and Q by 
their respective RIGLS estimators. 


From equation (2.9) we can also obtain an estimator for 
MSE(ji’) as follows: 


MSE(A;) = (1 -f) [MSE “(@,) +N, "(1 -f) 167) (2.11) 


where MSE (a) is the equation (2.10) with X ; replaced by 


i? 


3. A MODEL-BASED NUMERICAL 
INVESTIGATION 


3.1 Comparison of the Estimators 


In order to investigate the properties of alternative 
estimators, data was used from 38,740 households in the 
enumeration districts in one county in Brazil. The Head of 
Household’s income was treated as the dependent variable. 
Two unit level independent variables were identified as the 
educational attainment of the Head of Household (ordinal 
scale of 0-5) and the number of rooms in the household 
(1-11+). 

The assumed model is 


Y, = Bio Bi 415 +B in ®t Ey jal Sle N, 
Bio = Yoo * Yio? Bir = Yio * Yin? Biz = Y20 * Viz (3.1) 


where x, and x, respectively represent the number of 
rooms and the educational attainment of the head of the 
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household (centred about their respective population 
means). 

The parameter values for the fit model and their 
respective standard errors are 


Yo = 8-456(0.108) Y,9= 1.223(0.046) Yy)= 2.596(0.086) 
Oyq = 1-385(0.194) 65, = 0.354(0.66) 64, =0.492(0.117) 
6, = 0.333(0.054) 6,, = 0.234(0.35) 6,,=0.926(0.124) 
o? = 47.74(0.345) 


To carry out numerical investigations within the 
model-based framework a simulation was carried out 
keeping the enumeration district identifiers and the values 
of the two explanatory variables (X) fixed. Initially the area 
population means X,, and X,, were calculated for the 
whole data set and a randomly selected subsample of 10% 
of records from each small area was identified. This same 
subset was retained throughout the simulations (the 
Simulation subset). 

The data generation for the simulations was carried out 
in two stages using a data generation model which was the 
General Model (G), the Diagonal Model (D), the Random 
Intercept Model (RI) as appropriate. In the first case the 
parameter values were taken from the estimates mentioned 
earlier. In the second case the off-diagonal terms were set 
to zero, in the third case only 6p, = 1.385 was non-zero. 

The first stage of the data simulation process was to 
generate the level 2 random terms (that is, the non-zero 
elements of v,. and v,, and v,,) depending on the choice of 
the data generation model. These random terms were 
Normally distributed (jointly Normal in the case of the 
General Data Generation Model and the Diagonal Data 
Generation Model). At this stage the expected value of the 
mean for the i-th area conditional on the area level random 
effects generated by the model m, = G, D, RI in the r-th 
simulation could be obtained: 


o > e ‘i a X),+ ! X;; 

At the second stage of the data simulation process, unit 
values YY; were created for each of the data generation 
models. Having generated the data for the simulation subset 
under one of the data generation models, all three of the 
estimation models (G, D and RI) could be fitted to the 
simulated data to obtain parameter estimates and predictors 
for the small area means. 

For each data generation model m,= G, D, RI the whole 
simulation process was repeated R = 5000 times to yield a 
set of small area means rae and predicted means 
he Sale eo AO CACH small area, tat eee anGior 
the three estimation models: LOS G, D, RI. For each small 
area and for data generated under model dius G, D, RI, the 
Mean Square Error (MSE) of the prediction process for 
each estimation model m, may be defined as 


R 
MSE[ ie) RY (02m HE 
r=1 
and the absolute relative error (ARE) by 


R 
rs — p-l ~ (r) (r) (r) 
ARE[B in, mpl Be » [ieee es Him, Min,” 
r= 
For comparative purposes we contrast the properties of 
each estimator with those of the estimator which is the same 
as the data generation model. Hence we define the Ratio of 


Mean Square Error (RMSE): 
RMSE, mn, = 


> MSE nya i 6 MSE 100 
i=] i=] 


and the Ratio of Absolute Relative Error (RARE): 


RARE = 


m,,m, 
iS AREU if 5: ARE. p00. 
i=l i=l 


It will be seen that when the data are generated from a 
simpler model (e.g., RI) the more complex estimation 
procedures do not suffer any appreciable worsening of effi- 
ciency or bias. On the other hand when the data are gene- 
rated from a more complex model the simpler estimators 
have inferior properties. However the difference between 
the Diagonal and General estimators is much less than 
between these and the Random Intercept Estimator. From 
Table 1 one would conclude that it is worth introducing 
additional random coefficients of some kind, beyond the 
simple Random Intercept model assumptions, but not 
necessarily the full General Model. 


Table 1 
Ratios of Mean Square Errors and Ratios 
of Absolute Relative Errors (in parentheses) for the three 
Estimators and Three Data Generation Models 


Data Generation Model 


Estimator 
G D RI 

General (G) 100.0 101.8 101.2 
(100.0) (100.9) (100.6) 

Diagonal (D) 108.8 100.0 100.2 
(82.6) (100.0) (100.1) 

R. Intercept (RI) 131.9 109.1 100.0 
(176.9) (105.6) (100.0) 


The summary measures in Table | are average properties 
over all small areas. A careful analysis of the MSE perfor- 
mance of the estimators for each small area shows that there 
is a modest increase in the MSE for the Diagonal Estimator 
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compared to the General Estimator for all areas, whereas 
for the Random Intercept estimator a relatively small 
number of areas exhibit a substantial increase in MSE. A 
similar pattern occurs between the Diagonal and Random 
Intercept estimator when the Diagonal Data Generation 
Model is used. 


3.2 Introducing a Small-Area Level Covariate 


In this section an attempt is made to investigate the 
impact on small area estimates of introducing an area cova- 
riate Z. Unfortunately for the data set used, it was not 
possible to identify a single contextual area level covariate 
which had a substantial effect on the multilevel models. 
Nevertheless, the number of cars per household in each 
small area was a useful covariate for the random coeffi- 
cients for the individual level random slopes coefficients for 
“Room” and “Edu”, but not for the random intercept term. 
This was observed after some preliminary model fit analysis 
on the real data. Although the “numbers of cars” was the 
best small area level covariate found to explain between 
area variation, it was not as powerful at the individual level 
as “Room” and “Edu”, the individual level covariates 
chosen. 

The model above with the small area covariate Z can be 
written as 


Yi, = res 11% yt Bi2% i FE; Baa Neos (5) fia eee 


Big =Yoo* Yio? Bir =YiotV11 2: *¥in> Bin =Y20*Y21 Zit ¥ia- (3.2) 


The small area random effects were assumed uncorre- 
lated in order to avoid convergence failure in the simulation 
study. 

Table 2 reports the parameter estimates and their respec- 
tive standard errors obtained by fitting the Diagonal Model 
with the Z covariate (3.2) and without the Z covariate (2.1). 
It is worth noting the significant reduction of all the 
components of variance estimates, except 6, and 6’, after 
introducing the explanatory area covariate Z. 

In order to investigate the effect of misspecification of 
the Z variable, the model based simulation procedure 
described in section 3.1 was applied to the two models 
above, where the data generation was done according to the 
parameters presented in Table 2. Table 3 summarises the 
simulation results. 

It is worth noting that in both cases there is a significant 
loss of efficiency by using an unsuitable estimator. It can 
also be seen from an individual analysis of MSE for each 
small area that a considerable gain in efficiency is achieved 
with the introduction of a small area covariate Z over the 
diagonal model. For many small areas the MSE of the 
Diagonal with Z is significantly less than the MSE of the 
corresponding estimator without Z. Even for those few 
areas in which the MSE of the Diagonal with Z is 
unchanged or even slightly increased by the introduction of 
Z, the difference is not appreciable. 


Parameter Estimates and Standard Errors for General Model 


Table 2 


with Area Level Covariate: Demographic Data 


bf 


Parameter Diagonal Diagonal Model 
Model with Z 
hes 8.442(0.112) 8.688(0.136) 
Tx 0.451(0.179) 1.321(0.085) 
Vac 0.744(0.272) 2.636(0.134) 
Ske 3.779(0.507) = 
Yo 1.659(0.323) = 
Oo5 0.745(0.308) 0.637(0.303) 
oF 0.237(0.083) 0.471(0.116) 
on 0.700(0.197) 1.472(0.295) 
o 44.00(1.05) 44.01(1.05) 
Table 3 


Ratios of Mean Square Errors and Ratios of Absolute Relative 
Errors (in parentheses) for the Diagonal and the Diagonal with Z 
Estimators Under the Two Respective Data Generation Models 


Data Generation Model 


Estimator 
Diagonal Diagonal with Z 
Diagonal 100.0 110.3 
(100.0) (125.4) 
Diagonal with Z 126.2 100.0 
(107.5) (100.0) 


3.3. Comparisons with Regression Estimator 


One essential advantage of the multilevel models over 
regression models is to recognize that groups (here the 
small areas) share common features; they are not comple- 
tely independent as could be assumed, for example by using 
separate linear regression model for each small area. 
Nevertheless, the relatively small intraclass correlation 
observed for the data set used plus the fact that each small 
area has on average 28 units, could make one think that in 
this case the use of the multilevel model would not result in 
great improvement in the small area estimators. However, 
it is gratifying to know that even in these circumstances the 
multilevel model small area estimator performs on average 
better than the synthetic separate regression estimator, 
under either the multilevel model or even under the 
regression model. Table 4 illustrates this finding. 

The multilevel data generation model used was the 
General one with the parameters given in section 3.1. The 
parameters used in the data generation regression model 
were obtained by fitting a separate regression for each small 
area. 

It can be seen from Table 4 that the Separate Regression 
estimator which does not explore the difference of small 
areas through small area random effects shows substantial 
loss of efficiency when compared with the General estimator. 
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Table 4 
Ratios of Mean Square Errors and Ratios of Absolute Relative 
Errors (in parentheses) for the General and the Separate Regression 
Estimators Under the Two Respective Data Generation Models 


Data Generation Model 


Estimator 
General Separate Regression 
General 100.0 88.1 
(100.0) (83.1) 
Separated 247.6 100.0 
Regression (154.7) (100.0) 


Figure 1 illustrates this fact by showing a plot of the ratio 
of mean square error between the General estimator and the 
Separate Regression estimator for each small area. To 
demonstrate the effect of the small area sample size on the 
efficiency, the ratio of the MSEs is plotted against the 
sample size for each small area. It is clear from Figure 1 
that the gain in efficiency tends to decrease as the sample 
size increases. 


Mean square error ratio 


Small area sample size 


Figure 1. Model-based efficiencies of the general estimator 
compared with the separate regression estimator for each 
small area 


3.4 An Evaluation of the MSE Approximation and 
the MSE Estimator 


From the simulation results we may investigate the 
properties of the MSE approximation (2.7). If we consider 
the General estimator when the General Data Generation 
model is used the MSE approximation appears to be very 
good. The average underestimation of the MSE approxi- 
mation was 0.31% of the MSE value with a range from the 
largest underestimate of 5.4% of the MSE value through to 
a largest overestimate of 4.8% of the MSE value. For the 
situation considered here T, contributed on average 94.6% 
of the total variation and T, a further 4.3%. Given the large 
component of variance due to 6”, these results are not 
unexpected. For individual areas the component T, varied 
between 87.4% to 99.1% of the total and T, varied between 


0.7% and 10.5% of the total. The component T, never 
contributed more than 2.2% of the total MSE for any area. 

We also investigated the performance of the MSE 
estimator represented by equation (2.10) against the “naive” 
estimator of the MSE, which does not consider the last term 
of (2.10). The average Root Mean Squared Error of the 
proposed MSE estimator is 17.5% ranging from 4.7% to 
32.3%, while for the naive estimator the average is 20.9% 
ranging from 5.2% to 47.5%. The MSE estimator is on 
average unbiased while the naive MSE estimator 
underestimates the MSE on average by 9.1%, its relative 
bias ranging from -23.5% to -0.9%. Our results agree with 
others, see Singh, Stukel and Pfeffermann (1998) and 
Prasad and Rao (1990), which show that the naive estimator 
can exhibit severe bias. 


4. DISCUSSION 


Prasad and Rao (1990) and Battese et al., (1981, 1988) 
have demonstrated that models which include small area 
specific components of variance can provide greatly 
improved small area estimators. Some of the numerical 
results in this paper show that within the model-based 
simulation framework even better estimators can be 
obtained by allowing the small area slopes as well as the 
intercept to be random. 

The overall conclusions from this investigation for this 
set of parameter values are that: a component of variance 
model more complex than the Random Intercept estimator 
is beneficial; overspecification of the model (e.g., using the 
General estimator with data generated under the Random 
Intercept Model) does not lead to serious loss of efficiency; 
the use of small area covariates can also improve the small 
area estimates; and the use of multilevel models should be 
preferred rather than the Separate Regression Model. The 
simulation study confirms that the MSE approximation 
appears to be precise and the MSE estimation is approxi- 
mately unbiased, reflecting the variation in MSE between 
areas, but further theoretical investigation about the exact 
order of the approximation should be done. 

Clearly model fitting and diagnostics are crucial. If we 
apply a general mixed model in circumstances where it is 
only a poor fit to the data, then the results may be 
disappointing. Considerably more investigation is needed 
to understand what characteristics of specific small areas 
are likely to provide efficiency gains if general mixed 
models are used rather than simpler models. 


ACKNOWLEDGEMENTS 


We would like to thank the referees and the Editor for 
their helpful comments on the earlier version of this paper. 


Survey Methodology, June 1999 


APPENDIX A: RESTRICTED ITERATIVE 
GENERALIZED PROCEDURE 


The generalized least squares estimator of y in the model 
(2.1) is given by 


eM EEX VAXKL) (LAX OV OY je 


m “1 m 
bs Lx Vas x2] bs TaN as van 7 (A.1) 


i=] i=] 


where V = Diag (V,, ..., V,,) and V, = 07 +X 7QX is the 
covariance matrix of Xe, =e cece Te 

However, V is assumed to be a function of unknown 
parameters, thus y cannot be estimated using (A.1). On the 
other hand, if y is known then 

Y* = vech [(Y - XZy) (Y - XZy)"] (A.2) 

is an unbiased estimator of vech(V). Furthermore vech(V) 
is a linear function of 8. Then we can consider the 
following linear model: 


ra Oe. (A.3) 


Where F = dvech(V)/00 and & is arandom variable with 
mean O =(0,...,0) and the covariance of € is given by 
V. = 29, (VaV)@,. The matrix @,, is any linear transforma- 
tion of vec(A) into vech(A), and A is any nxn matrix such 
that vech(A) = @,vec(A), see Fuller(1987) for further 
details. Then, assuming that F has full rank and V, is 
known and non-singular, it may be shown that the 
Generalized Least Square Estimator of 8 is given by 


- eae(qavec(V)i\n(ilier 22 os 
@ = COV 6)[ 25) [sv leV vet? (A.4) 
where 
cov (0 As | seul] [gvtev>|( 2220) i 
08 2 fel) 
and 
VY XZ, 


Note that 8, depends on @ and y, so both may be 
iteratively estimated. The IGLS procedure starts with an 
initial estimate of V (that is, setting initial values of 8) 
which produces an estimate of y. Hence replacing the initial 
estimate of V together with the estimate of y in (A.1) 
provides an improved estimate of 9. In most cases 
convergence is achieved after a few iterations between 
equations (A.1) and (A.4), although it is not always 
guaranteed. 
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The RIGLS approach is based on the fact that if y is 
estimated by using generalised least squares with V known 
then 


E\(Y-XZ9)(Y -XZ9)"|=V-XZ(Z ™X TV 4XZ)1Z 7X7. 


The equation above suggests that we use 
(EZ) ANTEX Ze MAVEN DZ CAS) 


instead of (Y - XZy)(Y - XZy)’ at each iteration cycle 
described above in order to obtain an approximately 
unbiased estimator of V and consequently of 8. 

As pointed out by Goldstein (1986, 1989), if we start 
with a consistent estimate of y, say the ordinary least 
squares estimator, then the final estimates will be consistent 
providing finite fourth moments exist. 

It is worth noting that it is possible for the above 
procedure to yield negative estimates of variances. This 
problem can be avoided by imposing constraints at each 
iteration. For further details on this issue see Goldstein 
(1986). 


APPENDIX B: AN APPROXIMATION 
TO Elf, - i,7 


Prasad and Rao (1990), based on Kachar and Harville 
(1984), developed a second order approximation to the 
second term of (2.5) under some regularity conditions: 


(B.1) 


where, for the model (2.1), d,=X; K,(1@Q)X7V", 
K, = [0,...,1,...0], is the (p +1)x(p + 1)m matrix with the 
identity matrix J of order p +1 in the i-th position and 0 as 
the null matrix of order p+1, and 6 is any translation- 
invariant estimator of 0 = (0,,...,0.) where 0, = o” and 
03k =1,...,s-1 are the distinct elements of Q. Goldstein 
(1989) proves that under normality of the random terms of 
model (2.1), the RIGLS estimator of 8 is equivalent to the 
Restricted Maximum Likelihood Estimator (RMLE), which 
is translation invariant. 

Let us approximate E G - 6)(6 - 9)7| to the asymptotic 
covariance matrix of the RMLE estimator (B). The jk-th 
element of B”! is given by(see Harville (1977)) 


. sp OVy OV 
ni =1) Sr See | 


00, | 0, 


for j and k=1,..,s where P.=V,'-V, X,Z, 
OZ xe ECT )e ZX, Letubs, she gketh 
element of B. After some matrix algebra, it can be shown 
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that 
Sele Sol rT ms 
Tet be ACA Gea kee 
j=l k=l 
-] ie 
2 (Gmn bj eAj| ROX +b X/QS,QX, (B2) 
= 
where Ce oie G;! Oe Xs IG Go * G;? Kee 


Seo Ga Xtand 


is the s-1 square derivative matrix with respect to 
sgh. Atl bce sa alle 
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Composite Estimation of Drug Prevalences 
for Sub-State Areas 


MANAS CHATTOPADHYAY, PARTHA LAHIRI, MICHAEL LARSEN and JOHN REIMNITZ! 


ABSTRACT 


The Gallup Organization has been conducting household surveys to study state-wide prevalences of alcohol and drug (e.g., 
cocaine, marijuana, etc.) use. Traditional design-based survey estimates of use and dependence for counties and select 
demographic groups have unacceptably large standard errors because sample sizes in sub-state groups are too small. 
Synthetic estimation incorporates demographic information and social indicators in estimates of prevalence through an 
implicit regression model. Synthetic estimates tend to have smaller variances than design-based estimates, but can be very 
homogeneous across counties when auxiliary variables are homogeneous. Composite estimates for small areas are weighted 
averages of design-based survey estimates and synthetic estimates. A second problem generally not encountered at the state 
level but present for sub-state areas and groups concerns estimating standard errors of estimated prevalences that are close 
to zero. This difficulty affects not only telephone household survey estimates, but also composite estimates. A hierarchical 
model is proposed to address this problem. Empirical Bayes composite estimators, which incorporate survey weights, of 
prevalences and jackknife estimators of their mean squared errors are presented and illustrated. 


KEY WORDS: Alcohol abuse; Drug abuse; Empirical Bayes; Jackknife; Mean squared error; Small area estimation; 


Synthetic estimation. 


1. INTRODUCTION 


The Gallup Organization has been conducting a series of 
household surveys for different states to study state-wide 
prevalences of the use of alcohol and drugs (e.g., cocaine, 
marijuana) among civilian, non-institutionalized adults and 
adolescents. The common goal of these surveys is to esti- 
mate the use and dependence prevalences for alcohol and 
drugs and, on that basis, to project the treatment needs of 
dependent users. For planning and resource allocation, 
states need precise estimates of prevalences for certain 
subgroups of the target population. For example, it is of 
interest to estimate prevalences for sub-state planning 
regions and counties in demographic subpopulations (e.g., 
older white males). 

Traditional design-based procedures to estimate use and 
dependence for subpopulations have two drawbacks. First, 
if the traditional design-based survey estimate for a sub- 
group is positive, but sample size is small, then the corres- 
ponding standard error is unacceptably large. Second, since 
the problem is to estimate the proportion of a rare event, it 
is possible that the design-based procedure produces an 
estimate of zero and standard error estimation formulas for 
a particular subgroup, if applied, would give a false impres- 
sion of the true underlying variability. 

To improve on the traditional design-based estimators, 
one can use certain supplementary information usually 
available from administrative records in conjunction with 
the telephone survey data. This generally is done by using 
either implicit or explicit models that “borrow strength” or 
incorporate additional information that relates the various 


groups, counties, and planning regions to one another. The 
method proposed here combines information across 
counties in order to deal with problem of zero estimates in 
some counties. It is derived from a model that bounds the 
proportions away from 1, which is reasonable in an applica- 
tion with proportions expected to be very small, and esti- 
mates parameters using empirical Bayes methods. The 
procedure also incorporates the survey sampling weights in 
estimation. 

For a detailed account of small-area estimation methods, 
see Ghosh and Rao (1994). Other recent references can be 
found in Farrell, MacGibbon and Tomberlin (1997) and 
Malec, Sedransk, Moriarity and Leclere (1997). Farrell 
et al., (1997) propose estimating small-area proportions 
with empirical Bayes procedures. They model the 
proportions via a logistic regression that relates expected 
proportions to respondent variables and includes random 
effects for the small areas. Malec et al., (1997) use 
hierarchical Bayes models. They use logistic regression 
models to relate individual characteristics to probabilities of 
an outcome and then use a linear regression model to relate 
coefficients across small areas. Most existing methods, 
including those of Farrell et al., (1997) and Malec et al., 
(1997) do not directly use survey sampling weights in 
estimation. 

The survey design used by Gallup is described in 
section 2. In section 3, notations used in the paper are 
introduced. A direct design-based estimator and two 
synthetic estimators are presented in section 4. In section 5, 
several composite estimators of prevalences of alcohol and 
drug use and dependence are given. In this section, certain 


"Manas Chattopadhyay, The Gallup Organization; Partha Lahiri, University of Nebraska/Lincoln; Michael Larsen, Harvard University, Department of Statistics, 
Science Center, One Oxford Street, Cambridge, MA 02138, U.S.A.; John Reimnitz, The Gallup Organization. 
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empirical Bayes estimators and jackknife estimators of their 
mean squared errors (MSE) are proposed. In section 6, 
estimators presented in sections 4 and 5 are applied to a 
data set from a particular state. The focus of the analysis in 
this study is taken to be county level estimates. Sample size 
planning considerations originally were concerned with 
larger sub-state planning areas. 


2. SURVEY 


For sampling purposes, the state is divided into a few 
planning regions and samples are collected independently 
for each planning region using a truncated stratified random 
digit dialing (RDD) method of Casady and Lepkowski 
(1993). This design stratifies the Bellcore (BCR) frame 
into two strata: a high density stratum consisting of 100- 
banks with one or more listed residential numbers and a low 
density stratum consisting of all the remaining numbers in 
the BCR frame. About 52 percent of the numbers in the 
high-density stratum are estimated to be working residential 
numbers whereas in the low-density stratum, the corres- 
ponding percentage is only about 2 percent. The Casady- 
Lepkowski procedure exploits the significant difference in 
the cost of sampling between the two strata by optimally 
determining the sample size in each stratum. In the 
truncated version of the procedure, sampling is done only 
from the high-density stratum. 

Sample size in the original study was determined in order 
to estimate statewide prevalence with a desired degree of 
accuracy. Sample sizes were allocated to the planning 
regions using an optimal allocation scheme. Data on drug 
treatment admissions for the adult population in each 
county were used to compute the index prevalence (rate of 
admissions) percent in every planning region. These indices 
were then used to calculate the optimum sample size for 
each planning region. As a result of optimal allocation, 
relatively larger sample sizes were allocated to planning 
regions with higher index prevalences. The optimal alloca- 
tion also minimizes the variance of the estimators. Gallup 
also oversampled the 18-45 age group by planning region, 
because it is the age group with relatively higher rates of 
illicit drug use. Due to optimal allocation (which may be 
disproportional), the age oversampling and the complex 
design, weighting was needed to compute estimates from 
the sample data. The necessary weights, commonly known 
as sampling weights, were computed using current 
estimates of the population based on census data. 

Due to budgetary constraints, it is not possible to 
increase sample size for all sub-state regions and groups in 
order to achieve the desired accuracy. To estimate alcohol 
and drug prevalences, we consider empirical Bayes proce- 
dures (see Efron and Morris 1973, Fay and Herriot 1979, 
Ghosh and Lahiri 1987, among others) to improve on usual 
design-based estimates of drug prevalences by taking 
advantage of demographic measurements and social 
indicator data. 


Other variables that possibly are related to use and 
dependence prevalence by county and that are available 
from Census include the percent of population that is over 
65, under 30, white, male, married, and renters. Local 
governments can provide data by county on social 
indicators, such as DUI (Driving Under the Influence) rate, 
mortality rate, per capita liquor licenses, and drug and 
alcohol treatment admission rates. The more closely auxi- 
liary variables relate to use and dependence prevalence, the 
more likely it is that methods that “borrow strength” across 
areas and groups, such as the empirical Bayes methods 
presented here, can be employed to meet the desired 
accuracy levels for sub-state areas. 


3. NOTATIONS 


Let n, be the sample size allocated to the i-th planning 
region, 7 =1,...,/(n = sear n,). Samples are drawn inde- 
pendently in each planning region using RDD telephone 
surveys. After the sample is observed, suppose each region 
is post-stratified into K demographic groups. These groups 
are formed by cross-classifying gender (Male, Female) and 
age (18-24, 25-44, 45-64, 65+), resulting in K =2x4=8 
groups. Suppose there are J, counties in the i-th planning 
region (i =1,...,/) and ne observations within the k-th 

ij 

demographic group in the j-th county belonging to the i-th 
planning region (i=1.,...,/;j=1, fou ks Agee Key 
Since typically Nix is small, there is a good chance that 
some of the k demographic groups are not represented in a 
particular county. Let S,, be the set of demographic groups 
in the j-th county within the i-th stratum (i = 1,..., /;7=1, 
... J,) for which individuals have completed surveys. 

Let Vial be the /-th observation (O or 1) for the k-th 
demographic group in the j-th county belonging to the i-th 
planning.area.@= 1 Coyle J, keS l= 1, ...,Mjy): 
Let w,,, be the corresponding sampling weight available 
from the survey. The goal is to estimate 7,.,the true 
prevalence of substance use or dependence for the j-th 
county within i-th planning area (7 = 1,..., J; j = 1,..., J;). 


4. DIRECT SURVEY ESTIMATOR AND 
SYNTHETIC ESTIMATORS 


The direct sample survey estimator of 7, is given by 


Nig 


Want Y ijkl 
ij rip 
ye e; Wing 
keS,, 1=1 


The sample size available from a county could be very 
small (sometimes as small as 3 or 4). Thus, the estimator 
is highly unreliable. Other direct survey estimators are 
defined similarly. For example, the direct survey estimator 
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of m,,, the true prevalence in the k-th demographic group in 
the i-th planning region is 


De y W ita ijkl 


jkES;, [=1 


Do y Wing 


pikes, 1=1 


oe 
tk 


where the notation j:k € S,, means that the summation is 
Over counties 7 in which demographic group k is observed. 

Additional problems arise when estimating the pro- 
portion of rare events. It is quite likely that all observations 
in a county may be zero, resulting in a zero estimate for a 
county. If usual estimates of standard error were applied, 
an estimated zero standard error of the estimate would give 
a false impression of the uncertainty of the estimate. Thus, 
it iS very important to improve on the direct survey 
estimator. 

Synthetic estimators borrow strength from related 
counties through implicit modeling of supplementary data 
from the U.S. Census Bureau along with the telephone 
survey data. A synthetic estimator, which has been used in 
the past to estimate alcohol prevalence at the county level, 
is given by 


S1 
a! a a p))) 
<= S Gi T > 


where 7%, ? is the statewide direct survey estimator of 


prevalence of alcohol for the k-th demographic group and Cig 
is the proportion of individuals belonging to the k-th 
demographic group in the j-th county within the i-th 
pranming areata dns: Us fia los. J 0k = lo) Phe 
value a,, is available from current census estimates. For 
the household survey reported in this paper, the a,, values 
were obtained from database vendors like Claritas Data 
Services of Ithaca, New York. Based on latest available 
census data, the a.. values are typically estimated using 
projection models. ff practice, therefore, the a. iik values are 
not true proportions but are current census estimates of 
reasonable precision. Outdated or inaccurate Diy values 
cause the estimators using them to be biased. If population 
projections are used to calculate poststratification weighting 
adjustments in the survey, the direct survey estimator also 
suffers from this source of bias. It is beyond the scope of 
this paper to study the impact of alternate population 
projections. In proposing Ti; 7, °!, it is implicitly assumed 
that the prevalences for alcohol and drug use for the k-th 
group in all the counties are the same (or nearly the same). 

A less restrictive synthetic estimator of prevalence of 
alcohol and drug use is given by 


K 
Pa Sa =——D 
iy hes De Figg Nig > 
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where 7, P is a direct survey estimator of T,> the 


prevalence for alcohol or drug use for the k-th demographic 
group in the i-th planning region. It is implicitly assumed 
that the prevalences in the k-th group are the same (or 
nearly the same) for all the counties in a planning region. 
This assumption is more JE or less restrictive than 
the one made in proposing ae . A similar direct survey 
estimator Ty mz for the k-th demographic group within a 
specific county J in region i may be defined by restricting 
the sample to to oes J only. As compared to Tip z,, P, the 
estimator 7, * P will have relatively lower variance although 
it may have ! ole bias since it does not distinguish the 
counties. Ra , on the other hand, may be based on a very 
small sample size and hence may be significantly less 
reliable in terms of its variability. 

The above synthetic estimators achieve reductions in 
variances at the cost of increasing bias. The synthetic esti- 
mators distinguish counties only through an indirect 
variable Diy obtained from the census, whereas the direct 
estimator treats each county separately. 


5. COMPOSITE ESTIMATORS OF 7; 
USING TELEPHONE 
SURVEY AND CENSUS DATA 


A compromise between a direct survey estimator and a 
synthetic estimator is a composite estimator. A number of 
different composite estimators are proposed here based on 
the following identity: 


Ls ye Dig Mage * 3 Dig Misys 
keS, keS, 


where Tey is the prevalence for alcohol and drug use and 

Gi» as eaned above, is the proportion of individuals 
belonging to the k-th demographic me in the j-th county 
within the (7-th planning area @=1,..0 7, j7=1,..,J;,, 
Kale Ky: 

A simple composite estimator of 7;; is obtained when, 
for ke Si ,7, iS estimated by To the direct survey 
estimator ce Tip and for k € Si Tig is estimated by 7, Te 
The estimator is then given ey 


Cc 

Si 

y= aa 
keS;y 


y 


% Looks 


In the above formula, 7, (k € S,.) is estimated using a small 
sample and thus there is the possibility for improving on 
ae (and, hence, on 1; i, ©) by borrowing strength from 
relevant resources. To this end, an empirical Bayes 
estimate of 1, is proposed based on the following model. 


Model 


1. Given the a. ik ’s, the Y int ’s are uncorrelated with one 
another with EC jui!Mjy) = = Tip and Var(y,.,,!7;,) 
(l-m,) for ¢=TyeuhJ=lynoJgk=h.. ami 


Nig. 
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Zee Tessas are uncorrelated with pel te 
Var (te) = dpaianlss. Ba pou eerie a | 

If Tig ~ Uniform (0, 2u,), then in statement (2) - 18. 

Thus, unlike the implicit assumption made in the synthetic 

estimator 7, oe res Ti, = Hy)» Some variability of propor- 

tions across counties siti a region for a particular 

demographic group is allowed. 

The first assumption of the model implies that given Toiig 
the i t,,?’s are uncorrelated with one another, 
Ea 70. iit), = Tt and Var (75. Olt) = C iy My C1 ~ Tein) 
where ¢;, = =) anes Wy) fort = Aad sb 
k =1,...,K. The linear Bayes estimator of Te; under the 
model and squared error loss function, is given by 


—~B a D 
Fr 1 me ijk sees aay Tian % ( | 
SAY 


Bi,) Ma) a » Bin Vix? 
kes 


UT] 


where Bi, =d pig! (d Wax + Cig (My — (4 + 1) Wy) )- 

Since. ihe Bayes estimator involves the unknown 
parameter p1,,, it cannot be used in practice. The following 
empirical Bayes estimator of Ty is obtained when j1,, is re- 
placed by an estimator, say [oe SOL ae: 


Bass LS 
Ti; = a (Barmigt re Bix) Biz ) 
i 
D De ain Vin > 
keS,, 
where By, = di?! (diy? + c(i - (d+ 1) Hp )). 


The weight or Shrnkoge factor ik is a ratio of the vari- 
ance of 7,,, in the model to the (unconditional) variance of 


it pie The estimator of p,, is taken to be he ae ae : 


Mean Square Errors 


gc mean squared error r (MSE) of the SNS estimator 
Te 8 is defined as MSE (%, ieee ead SHG a es where 
(unconditional) expectation is taken with respect to the 
model. It can be checked that 


MSE(i,,~ ye Var (7, * — 1.) 


~8 ext 
= Var (7, ) + Var (a) -2Cov (1, a) 


~8 
=Var (1;;) = Var (7; ) 


=a Seal = 
keS;, 


2 MD) 
Bix) Mig + 3. Dig ix | - 
keS, 


It is customary to take MSE(7,,-?) as the MSE of the 
empirical Bayes estimator , PP, However, MSE(Z,,~ B) 
will underestimate the MSE of Ti; a, since it does not 
incorporate the uncertainty due to the estimation of the 
parameter p.,. See Prasad and Rao (1990) and Lahiri and 
Rao (1995) in this context. Using a standard Bayesian 
argument, it can be shown that 


CREE ESE 
MSE(7,,~ aie MSE(i,,~ ie Ba, aie ‘i 


It is necessary to estimate MSE(7,, mt, ”) since it eyes 
the unknown parameter p,. The first term MSE(Z,~ ai 
can be estimated ee 


ve mse(7;; ae 


mse , ae 
J; oa I, —~8 ~8 
is 3 ie » (mse_.y(, ye mse(7;, )), 


i 


als 2 eat nee 
mse(X, =a a in 1 - Bin Mix 


€5 5 


2 
ete 
cf Gin Hix 
keS;, 


B 
a—-—~—S~ 
Se(_y(%j = 


2 
af » ai(1 7 Bing- +) Hae u) as ae ae wa} 
ES. 
ij 


with 
Ji Mijx Jj Nix 
ae “) iE » Wadia 5, Wing 
j#ul=l1 
and 
Ban u) = Mia =u) 
ei -u) rem ig ye het 1) -u) 2). 
See Jiang, Lahiri, and Wan (1998) for for comment on these 
estimators. The second term E (1, wo. 8 Aine )? can be 
estimated with the following jackknife estimator: 
EB fitph oe —~EB 7 2 
Byte 7 ) FS 55 (Mic -u) Ve 


where 


—— 


ER ao oD o 
Rieu De Fig Bic—uy Mijn * (1-B 
keS;, 
na 
iy »3 Fig Mix —uy: 
keS 
Thus MSE(a,,*? ) is estimated by 

mse(®,~*) = mse, (f~®) + B, (~*~ *Y 


Jackknife methods are reviewed in the recent text by Shao 
and Tu (1995). 


en en 
iik(-uy) Hixe—uy) 
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6. AN EXAMPLE 


In this study, the primary objective is to provide informa- 
tion about treatment need. Anyone who meets the criteria 
for lifetime dependence or abuse as defined by the National 
Technical Center’s DSM-III-R criteria, is considered a 
member of the group of respondents who may have needed 
treatment during the last year. Several indicator variables 
were created in the dataset to identify respondents with a 
diagnosis for substance dependence or abuse for alcohol or 
drugs. For the purpose of numerical calculations, these 
indicator variables with O and 1 as possible values were 
treated as response variables ( Yiu) : 

In order to save space, results are presented for the 
outcome variable Alcohol Dependence only. Results on 
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other response variables can be obtained from the authors. 
In order to preserve confidentiality, results for only 40 
counties, identified as counties 1 through 40, are reported. 
Table 1 contains five different estimates of prevalence for 
alcohol dependence. In general, the direct estimates are 
highly variable and are often zero. The first synthetic esti- 
mator (S1) is the most stable, producing no zero estimates 
and estimates with little variability. The second synthetic 
estimator (S2) is similar to $1, but not as restrictive. The 
first synthetic estimates are very homogeneous, while the 
second synthetic estimates are homogeneous within the 
four planning areas. The estimates produced by the 
composite estimator are more variable than the other 
estimates. The empirical Bayes estimator produces 
estimates very similar to those of S2. In the model leading 


Table 1 
Five Estimators of Alcohol Dependence Prevalence Expressed as Percents for Forty Counties. 
Estimated Standard Errors for Direct (Est.se) and Square Root of Estimated Mean Square Error for Empirical Bayes 
(/Est.mse ) Estimates in Parentheses Also as Percents 


Estimator 
Synthetic | Synthetic 2 Composite ASTER) 
Direct Empirical Bayes Groupe 2 
Observed in 
County fe (Est.se) oe L Bae fe Rance (VEst.mse ) Sample Size County 
1 7/ (2.4) 3.4 1.6 0.9 1.6 (0.33) 30 8 
2 4.4 (2.0) 3.8 1.8 U2 2 (0.35) 111 8 
3 0.0 (0.0) 3.6 333 0.0 3.0 (0.85) 36 8 
4 0.0 (0.0) 33) 5.6 1.6 5.3 (1.79) 6 5 
5 9.4 (4.8) 3.3) 5.6 14.1 6.9 (1.78) 37 8 
6 1.6 (1.1) 3.4 3.0 7 2.7 (0.67) 136 8 
7 9.3 (5.8) 3.4 3.1 99 3.1 (0.81) 25 6 
8 0.0 (0.0) 3.6 3.2 0.4 rl (0.84) 20 7 
9 0.0 (0.0) 3.4 5.8 5.6 5.8 (1.93) 3 3 
10 1.5 (1.3) 3.4 Dall 0.7 1.9 (0.54) 81 8 
U1 0.0 (0.0) 333 1.6 0.0 1.5 (0.33) 58 8 
12 7.0 (6.8) By) ea 5.0 1.8 (0.35) 14 6 
13 5.7 (3.8) 3h 555 (DY) 6.4 @ig5) 37 8 
14 0.0 (0.0) 3.5, 1.7 0.8 1.6 (0.33) 12 4 
15 2.4 (1.4) 3.3 5.6 2.0 44 (1.56) 120 8 
16 4.1 (3.5) 3.3 3.0 25 3.0 (0.77) 32 7 
7) 2.8 (2.4) 3.8 1.8 1S, 1.8 (0.37) 48 8 
18 3.9 (1.1) 3.4 3.0 32 32 (0.60) 316 8 
19 0.0 (0.0) 3.4 S)oi/ 35 Syl! (1.95) 19 5 
20 31 (3.9) 3.6 Su 14.9 Be (0.82) 20 6 
21 Ded] (1.6) 3.3 5.6 4.1 5.8 (1.50) 102 8 
22 4.2 (1.8) 333} Dal 1.8 Bp) (0.42) 124 8 
23 9.7 (2.7) 4.3 8.0 11.8 8.8 (2.11) 121 8 
24 0.0 (0.0) 33 2.0 0.2 1.9 (0.54) 22 6 
25 7.8 (4.7) 333} 1.6 2.8 1.8 (0.33) 32 6 
26 0.0 (0.0) 335) il-7/ 0.0 1.6 (0.37) 28 7 
27 DB) (1.8) 32 5.6 1.6 4.9 (1.74) 63 8 
28 10.5 (13.7) 3.4 1.6 14.2 1.7 (0.35) > 5 
29 0.0 (0.0) 3y9) Sul 1.8 3.0 (0.81) 12 5 
30 0.0 (0.0) BZ ES 0.0 RS (0.33) 11 6 
31 4.6 (3.2) Sis) 58) 17.0 5.8 (1.87) 44 8 
32 8.4 (3.8) 37 3.4 8.4 4.1 (0.84) a2 8 
33 25 (1.3) 3.4 Pape 25. 23 (0.50) 144 8 
34 29 (2.4) 3.6 17 ies} 1e7 (0.35) 49 7 
Shs) 0.0 (0.0) 258) 3.0 0.0 2.8 (0.77) 22 8 
36 0.0 (0.0) 3.4 Se 0.3 29 (0.82) if 6 
37 4.2 (4.0) 3.0 2.0 3.4 74,3 (0.54) 26 6 
38 0.0 (0.0) 3.4 5.8 Bi D7) (1.97) 16 6 
39 0.0 (0.0) 35 ay 0.6 3.0 (0.81) 10 6 
40, 5.3 (1.9) 3.4 Sul 2.9 355) (0.69) 144 8 
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Table 2 
Summary of Five Estimators of Alcohol Dependence Prevalence for All Counties. Results Expressed as Percents. 


Estimator minimum 1* quartile median 
Direct 0.0 0.0 22 
Synthetic 1 3.0 33 3.4 
Synthetic 2 ji) 1.8 3.0 
Composite 0.0 0.4 ig 
Empirical Bayes Kes) 1.8 2.8 


to the empirical Bayes estimator, d was chosen to be one 
third. 

Table | also displays the estimated standard errors of the 
direct estimates and the square root of the estimated mean 
squared errors (see section 4) of the empirical Bayes 
estimates. The standard errors of the direct estimates, 
which are calculated as 


Sp) _—~D 
y Xj tf T; )In, , 


are often (incorrectly) estimated to be zero and are quite 
variable. The square roots of the estimated MSE of the 
empirical Bayes estimates are relatively stable and always 
below .025. 

Table 2 summarizes alcohol dependence estimates in the 
previous table for all counties in the state. The means of the 
synthetic and composite estimates are higher than the mean 
of the direct estimates, because there are fewer zero esti- 
mates and the means in the summary tables are unweighted. 


7. CONCLUSION 


We have proposed simple empirical Bayes estimators to 
estimate county level prevalences. Empirical Bayes esti- 
mators are found to be very effective when sample sizes for 
the counties are small and when prevalences are extremely 
small. We have introduced a measure of uncertainty of the 
proposed empirical Bayes estimator based on the jackknife 
method. The proposed measure incorporates additional 
sources of variability due to estimation of various model 
parameters. In our model, presented in this paper, we have 
implicitly assumed that the selection probabilities are 
unrelated to Viel In the household study reported in this 
paper, the selection probabilities were unequal and depended 
on several factors like number of telephone lines and number 
of adult household members in the household. None of these 
variables were related to y,,,. The sample allocation to 
different regions, however, was done based on the number 
of “treatment admissions” in each region. Hence, the 
selection probabilities might be indirectly related to Viet In 
this paper, we have not addressed the issue of sample 
selection bias, which can be handled appropriately by 
following procedures discussed in Pfeffermann (1993). 

In this paper, we have not considered the use of auxi- 
liary variables in the model to relate small areas to one 
another and to facilitate improved estimation. The use of 
available auxiliary data from the U.S. Census and other 


3 quartile maximum mean standard deviation 
4.3 10.5 2.8 32 
35 4.3 3:5 0.2 
4.4 8.0 Bez Neg) 
4.6 IES 3-1/ 4.8 
4.2 8.8 32 4.8 


administrative records may be a sensible use of resources 
that can be used to improve planning for treatment of drug 
and alcohol abuse and dependence. We plan to do further 
work in this area with an actual example in a future paper. 
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Some Issues in the Estimation of Income Dynamics 


SUSANA RUBIN BLEUER and MILORAD KOVACEVIC! 


ABSTRACT 


Two design-based estimators of gross flows and transition rates are considered. One makes use of the cross-sectional 
samples for the estimation of the income class boundaries at each time period and the longitudinal sample for the estimation 
of counts of units in the longitudinal population (longitudinal counts); this is the mixed estimator. The other one is entirely 
based on the longitudinal sample, both for the estimation of the class boundaries and the longitudinal counts; this is the 
longitudinal estimator. We compare the two estimators in the presence of large attrition rates, by means of a simulation. 
We find that under a less than perfect model of compensation for attrition, the mixed estimator is usually more sensitive to 
model bias than the longitudinal estimator. Furthermore, we find that for the mixed estimator, the magnitude of this bias 
overshadows the small gain in precision when compared to the longitudinal estimator. The results are illustrated with data 
from the Survey of Labour and Income Dynamics and the Longitudinal Administrative Database of Statistics Canada. 


KEY WORDS: Attrition; Gross flows; Transition rates; Longitudinal weighting; Cross-sectional weighting; Bootstrap 


variance estimator. 


1. INTRODUCTION 


Gross flows are counts of transitions from one time point 
to the other between a number of states for individuals in a 
population. Related parameters are longitudinal proportions 
and transition rates. Longitudinal proportions are relative 
gross flows, while transition rates are relative gross flows 
conditional on the initial transition state. Estimates of these 
parameters for transitions between different income classes 
are required in studies of income dynamics and can be 
obtained from longitudinal surveys. The boundaries of the 
income classes often have to be estimated from the survey 
as well. An example is the low income measure defined as 
half of the median income, where income is adjusted for 
family size. Thus, in this case, estimators of counts of tran- 
sitions to and from “low income state” require the estima- 
tion of the income medians at the time period of interest. 

The income class boundaries usually refer to the 
respective cross-sectional populations and have to be esti- 
mated from the cross-sectional samples to obtain unbiased 
estimators. If the change in population from one wave to 
the other (that is the number of “births” and “deaths’’) is 
negligible, a longitudinal sample may represent the respec- 
tive populations at both time points, and we may estimate 
the income class boundaries from the longitudinal sample. 
Otherwise, estimation of income class boundaries from the 
longitudinal sample may yield biased estimates. By 
“deaths” we mean real deaths and/or emigration; similarly, 
“births” means real births and/or immigration. 

Two design-based approaches are considered for esti- 
mation of longitudinal parameters involving two waves. 
One approach is based on the cross-sectional samples for 
the estimation of the class boundaries at each time period 
and on the longitudinal sample for the estimation of counts 


of units in the longitudinal population (longitudinal counts). 
This results in an estimator that we term the mixed esti- 
mator. The other approach uses an estimator based on the 
longitudinal sample for both the class boundaries and the 
longitudinal counts, and we call it the longitudinal esti- 
mator. The main objective of this study is to compare the 
two approaches in terms of their performance under 
different attrition adjustment models. 

In order to make the comparison we address two related 
issues: the impact of attrition on the considered estimators 
and the estimation of their variance. Attrition refers to the 
type of non-response that occurs from a certain wave on, 
until the end of the period of observation. The real issue 
with attrition is that non-respondents cumulate over time, 
and the longer the study lasts, the greater is the non-re- 
sponse. In some surveys like SIPP (Survey of Income 
Program Participation), attrition reached 20% by the time 
of the third wave (Rizzo, Kalton, and Brick 1996). Even if 
extra care is taken in the development of adjustments to 
compensate for the missing data, the resulting estimators 
may still be sensitive to a less-than-perfect model of 
compensation. We investigate empirically the sensitivity to 
attrition of the estimators considered. 

Variance estimation is also an issue because the para- 
meters of interest are non-linear functions of the observa- 
tions and are dependent on the income class boundaries. 
The problem of variance estimation of low income propor- 
tions, and other measures of income inequality from com- 
plex cross-sectional samples was studied by Shao and Rao 
(1993), Binder and Kovaéevié (1995) and Kovaéevié and 
Yung (1997), among others. In the longitudinal situation, 
changes in the population over time imply the need to 
combine different samples and different systems of weights, 
which complicate variance estimation. The ultimate units 


! Susana Rubin Bleuer, Business Survey Methods Division, Statistics Canada, Ottawa, Ontario, K1A OT6, e-mail: rubisus@statcan.ca; Milorad S. Kovatevi¢, 
Social Survey Methods Division, Statistics Canada, Ottawa, Ontario, K1A OT6, e-mail: kovamil@statcan.ca. 
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in a longitudinal sample may belong to different primary 
sampling units (PSU’s) at different waves, some PSU’s in 
the sample at one wave may not belong to the sample at 
another wave, etc. In this study, we develop an appropriate 
bootstrap variance estimator for estimators of income 
dynamics and for the complex design used in the example. 

The data used for illustration come from Statistics 
Canada’s Survey of Labour and Income Dynamics (SLID) 
and Longitudinal Administrative Database (LAD); both are 
sources with quite accurate longitudinal income data 
obtained from income tax returns. At the time of the study, 
SLID had response data from only two waves and the 
attrition rate was about 10%. 

Section 2 outlines the general assumptions for the popu- 
lation under study and for the design. In section 3 we deal 
with the issue of estimation of longitudinal low income 
proportion and the impact of attrition on it by means of a 
small simulation study performed on an artificial data set 
created assuming the log-normal distribution. Section 4 
deals with the bootstrap variance estimation for longitudinal 
complex surveys. A more extensive simulation of various 
attrition models, using different adjustment methods and 
data from a complex design, is described in section 5, and 
the results are presented and discussed in section 6. 


2. LONGITUDINAL POPULATION, 
SAMPLE, AND WEIGHTING 


Let U, represent the population at time O and U, 
represent the population at time 1. In this study we only 
consider parameters involving two periods of time, and 
therefore, the longitudinal population is defined in terms of 
two waves by U,, where U, = U, ! U,. 

“Deaths” and “births” from one time period to the next 
cause a change in the population. If we denote by U,, the 
set of individuals who belong to the population U, at time t =0 
and do not belong to the population U, at t=1 due to 
“death”, and by U : the set of “births” from time 0 to 1, then 
the longitudinal population can be expressed as U, = 
UN Ure, NU 

Similarly, we denote by s,, a representative sample of 
U,, by s,, arepresentative sample of U, and by s, and s 
the respective subsamples of individuals in s, who “died” 
between t=0 and t=1, and of individuals in 5; “born” 
between t=0 and t=1. Hence, the longitudinal sample, 
representing U,, is defined by s, = 5, 1s, = 5)\s,=5,\5,. 

Non-respondents to the initial wave at t =O exist but they 
are relatively few compared to non-respondents in later 
waves. For the sake of simplicity, assume that sy is the 
sample without the initial non-response and with the asso- 
ciated weights already adjusted for it. Attrition from wave 
0 to wave 1| will be represented by a subset of individuals in 
Sy denoted by s_. Hence, the longitudinal sample affected 
By attrition can be expressed by s;/ = 5 FV EAL 

Note that for some parameters of ees s, Should 
remain in the longitudinal sample for weighting purposes 


(Tambay, Schiopu-Kratina, Mayda, Stukel and Nadon 
1997). The parameters considered in this paper refer to the 
longitudinal population U,, and therefore units that “die” 
from one wave to another are out of scope. 

Large scale surveys often employ stratified multistage 
designs with a large number of strata and relatively few 
clusters or primary sampling units (PSU) sampled within 
each stratum. The selected PSU’s are subsampled in one or 
more stages until the ultimate units are obtained. Here we 
assume that the number of strata and clusters within strata 
does not change from one wave to the other. 

We assume that the cross-sectional samples s, consist of 
n, sampled PSU’s with replacement within stratum h and 
mi units sampled within the i-th PSU in stratum h, for 
t=0,1,h=1,...,H andi=1.,...,n,. Let {wy}, j= oe ams 
be the set of survey feds corresponding to the cross- 
sectional sample s,. We assume that the survey weights 
provide approximately unbiased estimators of population 
totals so that E,(d,, Wij) * N', where N’ is the size of 
UF, Lon t= Onin Here E_ is the expectation with respect to 
the design p(s). When the set s_ of attritors is large, the 
original weights Wri have to be adjusted to account for the 
missing units and the adjusted weights should add up, in 
average, to the size N, of the longitudinal population: 


L 
z,E,| > i = N,. 
So\(sqgUs,) 
Here the expectation Eis taken with respect to the model 
m assumed for the probability of response. 


Examples: 


1. Inthe Survey of Labour and Income Dynamics (SLID), 
every wave has an added component that consists of 
“cohabitants”, i.e., individuals who live in the house- 
holds of the longitudinal individuals (Lavallée and 
Hunter 1992). SLID has a stratified two-stage design 
with approximately H = 400 strata at each wave. The 
number of clusters within stratum h may change if 
there is growth in it. The number of sampled clusters 
is usually 2 or 3. When a new panel is selected or an 
old one is replaced from time t=0 to time t=1, then 
the number of sample clusters per stratum may vary. 


2. The Longitudinal Administrative Database (LAD) of 
Statistics Canada is a longitudinal sample obtained 
from administrative data files and is a representative 
sample of the income-tax-filing population at any year. 
The LAD is a collection of many panels since a panel 
is “born” at each wave (year). Here non-response is 
approximately 5% of the cross-sectional sample every 
year. Longitudinal administrative samples, like LAD, 
do not have attrition, but are subject to wave non- 
response caused usually by late filing (Rubin Bleuer 
1996). The design for LAD is non-stratified and single 
stage. We use LAD as a base for a simulation of 
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attrition because its data are representative of the Canadian 
income population at every wave. 


3. ESTIMATION UNDER ATTRITION 


Without loss of generality (wlog), in the following we 
define and explain the two estimation methods in terms of 
longitudinal low income proportions. In section 6 results on 
the impact of attrition are given for other two-wave para- 
meters like gross-flows and transition rates. We also assume 
a negligible amount of “births” and “deaths” in the finite 
population, relative to the attrition rate. In fact, we assume 
that U, =U, and that though the units are the same at both 
time points, the incomes attached to the units can vary. 

Let oh be the value of the characteristic of interest 
(family income adjusted for family size) for the j-th ultimate 
unit in the i-th PSU of stratum h, j=1,...,M,,, i=1,..,N,, 
h=1,...,H, andt=0, 1. Then the longitudinal proportion 
of individuals with income less than or equal to x at t= 0 
and income less than or equal to y at t= 1 is given by 


1 H Ny, Mi " : 
Tes) =P PY, gd ober: wAy 2) ea 
N, hal i=l j=l 


coincides with the size of the original population U). J is 
the indicator function of the incomes smaller than or equal 
to x and y respectively. F(x, y) is the bivariate distribution 
function of incomes at times 0 and 1. Let us now denote by 
M) /2, half the median income at time t = 0, and by M, /2 
half the median income at t = 1. Then the longitudinal low 
income proportion is defined by 


@ = F(M,/2, M, /2). (3.2) 


Under complete response, and Cc U fe @ is the bivariate 
version of the cross-sectional low income proportion which 
was studied, among others, by Shao and Rao (1993). Under 
a framework for the development of asymptotic theory in 
the design space and under certain regularity conditions on 
the design and the income distributions, Shao and Rao 
proved that the estimator of the cross-sectional low income 
proportion F (M, /2) is consistent (as the number of 
PSU’s, Nat approaches infinity) for general stratified 
multistage designs where the PSU’s are selected with repla- 
cement. The framework assumes: (i) the existence of a 
sequence of finite populations with either increasing 
number Nosy of PSU’s or increasing number of inde- 
pendent units if the population is not clustered, and (ii) the 
existence of a corresponding sequence of probability 
designs with the first stage sample size n,,.,, increasing to 


infinity as Nocy > 
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This result is easily extended to the longitudinal situation 
for the estimator 
= F(M,/2,M;/2) (333) 
under the assumptions of no change in the population from 
t=0 to t=1 and of no attrition. 
Let M, denote the estimator of the median income at 


time ¢ based on the cross-sectional sample s, and corre- 
sponding cross-sectional weights {wyis}s for t= 0, 1 


M, = inf { yj, €5, 1 F,04) 2 2}, 
where 


F, (y) = ree Wri L Orig s »/S, Wri 


and let M , denote the estimator of the median income at 
time ¢ based on the longitudinal sample s, and the longitu- 
dinal weights {w,;;}: 


M, = inf{ys,¢s, | F,0y,) 2 U2}, 


where 


F.0) = Yo, Wag! Ong SY) / Ye, Mai 


Then, there are two possible ways to estimate the 
longitudinal parameter (3.2): 
Teeaag p21 AYE PASS GO) Vor 


mixed 


Ye wie Typ < My /2) (yh; <M, BOs wit, 3.4) 
oT Ye 


and 


Bong =F (My/2, M,/2) = 


0 
» wil t(ye, < Mo/2) 1( yh, < M,/2 >» Wins) 
L 


The first estimator is termed “mixed” because it com- 
bines longitudinal and cross-sectional samples. The second 
is only based on the longitudinal sample. Note that when 
there are no “births” or “deaths” from one wave to the next, 
the median at t = 1 can only be estimated from the longitu- 
dinal sample and thus we use M , in the definition of the 
mixed estimator. 

Under attrition, most of the missing data may correspond 
to individuals who are different from the rest of the popu- 
lation, and failure to account for this may result in biased 
estimates. Hence, weights are adjusted to compensate for 
the missing information according to a model. The esti- 
mates will become more sensitive to model misspecification 
as attrition increases. Thus, estimators that are robust to the 
choice of the model for non-response adjustments are 
desirable. 
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In order to compare estimators (3.4) and (3.5) regarding 
their robustness against incorrect non-response adjustments 
we made a simple simulation study to empirically estimate 
the expected (with respect to the design and the attrition 
model) values of O'e 4 and Bion , When the adjustment model 
was both the correct one mae an incorrect one. 

As we already pointed out, if there is no change in the 
population from one wave to the next, and thus no new 
sample is selected in the second wave to represent the 
change, the estimation of the median in the second wave can 
only be based on the longitudinal sample. Thus the only 
difference between the two estimators lies in the estimation 
of the low income measure in the first wave. Hence, 
wlog, we consider for our simulation the parameter 
8 = F(M,/2,). In that case, 8 coincides with the cross- 
secionak low income proportion, and the estimator of 0 
under complete response, Oege F, (M, /2), is consistent 
(and thus asymptotically unbiased) as : Nowe tends to infinity. 

The simulation study, described in detail in Appendix A, 
consisted in simulating 1,000 samples of size 1,000 from a 
log-normal income population similar to the Canadian 
income population. We first selected a simple random 
sample without replacement (SRSWOR) from a large finite 
population of incomes and then we simulated attrition in that 
sample. Here we call a model missing at random (MAR) if 
the probability of non-response in the second wave is 
constant within response classes; and we call a model of 
attrition missing completely at random (MCAR) if the 
probability of non-response in the second wave is constant 
in the whole population. The attrition was simulated 
following a missing at random model where the non- 
response was induced in a low income class. The boundary 
of the low income class was the first quintile of the finite 
aes knowna priori. For every sample, we calculated 6 ee s5 

O and Om with adjustments under both the correct 

(MAR) and a MCAR attrition model. The arithmetic mean 
. the estimates approximates the double expectation (with 
respect to the model and the design) of the first two 
estimators and approximates the expectation of Oh with 
respect to the design. This last expectation approximates, in 
turn, the parameter 0, since 6 cross 18 aSymptotically unbiased 
aS Npoy > &. When the weight adjustments are calculated 
under the MCAR (incorrect) attrition model, the following 
relationship is empirically found: 


Ee Oren) 0) ee (Cereals 


pect 
where m refers to the simulated attrition model and p refers 
to the design under SRSWOR. Note that attrition from low 
income individuals will always bias upwards the estimator of 
the median and thus we will always obtain Gir < thee 
The somewhat surprising result is that the estimator which 
utilises less information is, in average, nearer the true 
parameter, meaning that more information, if it is not used 
well, does not improve the estimator. Similarly, when @, is 
the proportion of incomes higher than the income category 


boundary estimated from the sample, and attrition is heavier 
in the lower income categories, we will always have the 
inequality 
long, $ O wives? 

and as with the low income proportion 8, the estimator of 
8, using less information is, in average, nearer the truth. 
The description of the simulation and the numerical results 
are in Appendix A. 

The question now is if the bias caused by model mis- 
specification is larger than the increase in variance caused 
by the attrition. In sections 5 and 6 we tackle this issue by 
simulating attrition on data from SLID and LAD, calcu- 
lating 6, given by (3.3), o= xeq and Oe , and calculating 
the design variance of the estimators as well. 


4. BOOTSTRAP VARIANCE ESTIMATION 
FOR LONGITUDINAL SAMPLES 


In order to compare the two approaches to estimation we 
need to study them in terms of variance and bias under 
different attrition situations. The estimators Gius2s and oe 
defined in section 3 are nonlinear functions of the obser- 
vations; in addition, the income data come from complex 
surveys. The variances of these estimators cannot be ex- 
pressed in simple terms, and we have to rely on approximate 
variance estimation techniques. We seek a method that is 
easy to apply to many different complex parameters, and 
under different designs. We would like to evaluate the two 
estimation approaches for any parameter, using the same 
criteria and a consistent method of variance estimation. We 
concentrate on developing a bootstrap variance estimator 
that can be applied to a stratified multistage longitudinal 
design. It is important to emphasize that only the primary 
sampling units are resampled, not the units within them. 

Kovaéevi¢ and Yung (1997) compared several resam- 
pling methods and the Taylor linearization method for 
variance estimation of cross-sectional estimators of income 
inequality under a complex survey design. They found, by 
means of a simulation study, that the best method (in terms 
of relative bias, coverage properties, stability, robustness 
against assumptions, etc.) is the Taylor linearization method 
via the estimating equation approach, and that the next best 
is the bootstrap method. 

In the calculation of the number of individuals in one 
income Class at time 0 and another income class at time 1, 
the units in the longitudinal sample s, are involved, and the 
bootstrap sampling scheme must ensure the selection of 
units in s,. However, if we are confined only to the 
resampling of units in s,, we would not allow enough 
variability for the Consistent estimation of the variance of 
the cross-sectional quantile estimators M, and M.. 
Therefore, the bootstrap sample should canta as well 
elements from Sa ioas s,, and OR RY at each iteration. 
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We assume a stratified two-stage design, and we assume 
that the primary sampling units (PSU’s) are exactly the same 
at both t=0 and t=1, that is there are no “deaths” or 
“births” of PSU’s from one wave to the next. 

This is the case of the first and second waves of SLID. 
The “births” and cohabitants that appear in the second wave 
live in dwellings with individuals who were selected in the 
first wave. Every unit u in s, or s, is assigned to a PSU that 
was selected in the first wave: 


if u € s,(s,, then we assign u to the PSU corresponding to 
its original dwelling at time t=0; 


if we Sys then we assign u to the PSU it belonged to at 
=O 


if u€ s,\s, and u lives with v € s,/s,, then we assign u to 
the PSU of v. 


In this way we reduce the problem to a cross-sectional 
situation. Then we perform the following steps: 

Suppose that the original weights of an individual are 
Wri Wri Wrij- 


1. We select a simple random sample with replacement 
(SRSWR) of PSU’s of size n,-1, independently 1 in each 
stratum. A union of such samples i is denoted by sy... It 
contains a subsample So boot Of units from s, that are not 
in s,, asubsample 5, ,,., of units from s, that are notin s, 
and a subsample s,,,,,, of units that are in both, s) and 


si 
2. Let m,, be the number of times the Ai-th PSU is 
selected; the bootstrap modifications of the weights are 


(0) ee | RAO 

ie weirs My; Whiz > 
h 

*(1) coe n, * . 

Wr = “1 My; Wri > 
nN), 

*(L) pe n), * E 

hip Lene My; Whi- 
h 


The weights Wai and Wa are obtained from the 


original weights by alupiane, by an attrition adjustment 
factor. The adjustment factors are the inverses of the 
response probabilities (assumed different for each response 
class). These probabilities are estimated from the original 
data set. The process of estimation of the response probabi- 
lities and subsequent adjustment is imitated in the bootstrap 
resampling: for each bootstrap sample s,.,, the adjustinents 
are recalculated, to produce new w,,° and w ee 


L) 


A 


Then the estimate 9 ixed COMputed pon a “bootstrap 
sample Sy, 1S 
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or wrt? Hyg;s M2} yp,s My 12} ib barks 
SLbo0t 
where 


come. 3 


M, : = inf), SS ieose Stuea lt Opis) 2 V/ 2| 


FO) epee TO) i DY wi,1=0,1. 


Stooot YU Srpoot 


. A * . 
The estimate 0,,,, computed from $74, is 


Ax *(L) *(L 
6,= >) Ww Wnhij Nypj<M, “2h {yas Mt, /2} /2 WDE Was 5 


Spro0t 


where the medians M! are estimated from the longitudinal 
sample See 


3. Repeat steps 1 and 2 a large number of times, say B. A 
Monte Carlo estimate of the variance is obtained as 


a 


, 1 raba es 2 
Va Onixea) - B » (3;., =f hen 


and 


By resampling the original PSU’s, we reduce the 
problem of variance estimation in a longitudinal survey to 
that of a cross-sectional framework. This is an extension of 
the bootstrap variance estimator developed by Rao and Wu 
(1988) and later Kovaéevi¢ and Yung (1997) for variance 
estimation of cross-sectional income inequality measures 
from a stratified multistage sample survey. 

In order to accommodate attrition, we look at the original 
data set as a set of longitudinal records. Then, attrition can 
be viewed as item non-response and accordingly the weight 
adjustment for attrition can be considered as ratio 
imputation (Hajek-ratio). 

Indeed, recalling that s, = s,Us,, let us denote by yg 
(hij€s,) the ratio-imputed value of wave one information, 
based on the onan ee data in the longitudinal sample; and 
let us denote by he “(hijes, ) the ratio-imputed value of 
wave zero information based on the longitudinal sample 
(s,). Note that the values Bae (hij€s_,) are not missing, but 
we need y,,;; to represent the weight adjustment in the 
longitudinal ‘sample. 
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The estimation of @ with vor adjustments for attrition 
is equivalent to on on a “complete” imputed data set 
weighted by Wray , (AYE S,). The set 


(0) ah) (0) > 


» mixed Hoe » Vnij ), hy € Sis Vnij » Vnij ), hij € s,}, 


is used to calculate 6 and the set 


mixed 
(0) (1) (O)* | (1)* + 
ore -{o° Yai ME Sp Ong Ynij ),hijes, } 


is used to calculate Gace 

We noted above that adjustment due to attrition is 
equivalent to ratio imputation for item non response. Hence 
the variance estimator proposed here has the same properties 
as the cross-sectional variance estimators for imputed survey 
data: consistency now follows from the consistency of the 
bootstrap variance for imputed survey data (Shao and Sitter 
1996) and good coverage properties and small relative bias, 
as documented by Kovacevié and Yung (1997). In the case 
of small number of PSU’s per stratum (SLID has two or 
three PSU’s per stratum) Kovar, Rao and Wu_ (1988) 
showed empirically that the bootstrap variance estimate 
overestimates the true variance by no more than 10%. 


5. EMPIRICAL STUDY 


In order to compare the two approaches to estimation, we 
now consider two real longitudinal surveys, SLID and LAD, 
and simulate different attrition situations. The study begins 
with a sample of complete respondents in two waves. The 
response pattern of the individuals in this sample can be 
presented as 


RESPONDENTS 


Responded in both waves Xx x 


Here X means that the response is available for the indivi- 
dual at the corresponding wave, and 0 means the opposite. 
We omitted “births” and “deaths” from both SLID and LAD. 

The respondents in the first wave are divided into two 
response classes, low income class and else. The boundary 
is given by M, /2, where M, is the estimate of the median 
income at time t = 0, based on all respondents in the first 
wave. The size of the SLID sample (Ontario) is approxi- 
mately 10,000, from which 2,000 were low income 
individuals. 

We simulate three different attrition situations. In all of 
them we select a subsample of the complete respondents 
with pattern XX and convert them into the following pattern 


RESPONDENTS 


Responded in the first wave 1, 
not in the second 


1) 10% attrition. We select a subsample. at random of 
individuals with low income (ni < M, /2} at time 
t=0, and make them non- eeohicns In order to 
have 10% of the overall sample missing at time f = 1, 
we convert 50% of low income individuals into non- 
respondents in the second wave. 


2) 20% attrition. We select 70% of individuals from 
{ o < M,/2} and 7.5% from {y,,,>M,/2} at random 
and convert them into non-respondents at the second 
wave. This results in 20% overall attrition for SLID. 


3) 30% attrition. We select 80% of individuals from 
{Yn < M,/2} and 17.5% from {ny > My /2) at ran- 
dom and convert them into non-respondents at the 
second wave. This results into 30% attrition for SLID. 


We then consider two different adjustment models for 
each situation: 


Model 1: The non-respondents are missing completely at 
random (MCAR). This model is the worst 
possible model that we might use given that 
attrition is usually experienced by the group of 


low income individuals. 


Model 2: The non-respondents are missing at random 
from the low-income class. We allow for a 
small increase of the upper boundary for the 
low-income class, $0 that the response classes 
are defined as (ni <M, OMS M, /10} and 
(yng > My (Jae M, /10}. We assutie that this 
model as one of the best possible models under 
our setup, since it recognizes the response 


classes as separated by low income boundaries. 


We chose these two models of adjustment because they 
represent the two extremes. In practice, we may only be 
able to choose a model between these two. 

Let 1, denote the low income measure defined as half 
the median: 1, = M,/2,t = 0,1. Several longitudinal para- 
meters were studied. We define some of them in Table 5.1. 
The values of the estimates are presented in Tables B1 to 
B3. The standard errors were obtained using the bootstrap 
method described in section 4 assuming that the correspon- 
ding adjusted weights are known a priori and do not change 
for each bootstrap sample. 
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Table 5.1 
Some Longitudinal Parameters Evaluated 
in the Empirical Study 


Proportions 


The proportion of individuals with income 


(adjusted family income) below J, at t= 0, 1. PY Sty Y, $41) 


The proportion of individuals with income 
below J, at t= 0 and above J,” =(11/10)J, at 
t= 1; the factor 11/10 is used to be able to 
detect true transitions from one state to the 
other. 


POS 4, 21") 


The proportion of individuals with income 
above he =(11/10), at t= 0 and below 1, at 
ale 


Pz oy, <4) 


The proportion of individuals with income 
above |, and J,” at times 0 and 1 
respectively. 


PO 24 ¥, 24 ) 


Conditional Rates 


The probability of an individual having low 
income at the second wave (second year), 
given that he or she had low income in the 
first wave. 


PO, 4, |¥os 4p) 


The probability of not having low income at 
the second wave, given that the individual 
had low income at the first wave. 


PO,>1 |¥ sy) 


6. RESULTS AND DISCUSSION 


The empirical study shows that attrition does affect 
estimates adversely, but different outcomes result depending 
on whether the parameter of interest is cross-sectional or 
longitudinal. In the estimation of later-wave cross-sectional 
parameters, estimators based on the actual longitudinal 
sample are more biased than estimators based on the cross- 
sectional sample whether the model of adjustment is sound 
or not, (see for example the estimates of the median at t = 0 
in Tables B.1-B.3.) However, in the estimation of 
longitudinal parameters, longitudinal estimators (based 
entirely on the longitudinal sample) are less biased than 
mixed estimators (based on the three samples.) 

Tables 6.1a and 6.1b present gross flows estimated from 
SLID and LAD data, respectively. The estimates are 
calculated with the complete data set and after 20% non- 
response is simulated in the second wave. For the complete 
data set the longitudinal and the mixed estimators coincide 
(this is the no-attrition situation). As explained in the 
previous section, 20% of non-response was simulated by 
eliminating 70% of the responses from individuals who were 
low-income and 7.5% of individuals with income higher than 
1, in the first wave. The adjustment for non-response was 
done assuming that the individuals were missing completely 
at random. 

The applied adjustment model means that the original 
survey weights were adjusted with a factor of 1.25 
(representing 20% attrition) across the sample, whereas the 
correct adjustment should have been with a factor of 3.33 
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(representing 70% attrition) in the domain of individuals 
who were low income in the first wave (1993), and with a 
factor of 1.08 (representing 7.5% attrition) in the domain of 
individuals who had an income higher than the LIM in 
1993. Thus, by adjusting with an incorrect model, we incur 
in a much greater error in the estimation of one domain 
(y, s M,/2) than in the estimation of the other (y,> M,/2). 

We see from these tables that both the mixed and 
longitudinal estimates seriously underestimate the para- 
meter of interest in the first column and overestimate it in 
the second column, assuming that estimation based on the 
complete data set results in reasonable and acceptably good 
estimates. It is obvious that the mixed estimates are more 
affected by the wrong adjustment, verifying the inequality 
stated in section 3. 


Table 6.1 
Gross Flows Estimated From SLID and LAD 20% Attrition 
(70% of the Low Income Missing) 


a. SLID, Ontario 


1994 sek 
y,<M,/2 y,>M,/2 
y, <M,/2 1,602,000 113,000 No attrition 
425,000 152,000 Mixed 
710,000 125,700 Longitudinal 
y,>1.1M,/2 70,000 8,080,000 No attrition 
15,000 8,975,000 Mixed 
30,000 8,870,000 Longitudinal 
b. LAD, Sub-Area from Toronto 
1992 Loe 
y,<M,/2 y,>1.1M)/2 
y, <M,/2 2,700 640 No attrition 
1,100 800 Mixed 
1,500 740 Longitudinal 
y,>1.1M,/2 580 10,420 No attrition 
190 12,150 Mixed 
380 11,650 Longitudinal 


Tables B.1 to B.3, given in Appendix B, show the results 
for SLID at three different attrition levels: 10%, 20% and 
30%. For each parameter the estimates and their corre- 
sponding bootstrap standard errors were calculated using 
both the longitudinal and mixed estimators. First, we 
calculated them for the ideal longitudinal “no attrition” 
sample, and then for the reduced sample adjusted under the 
two non-response models described in section 5. We 
provide the estimate of the model bias as the difference A 
between the estimate obtained under the model and the “no 
attrition” estimate. 

The numbers in Tables B.1 to B.3 repeat the same 
pattern that was shown for gross flows in Tables 6.la and 
6.1b, i.e., the estimates obtained using the longitudinal 
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estimators are “less sensitive” to a choice of the non-re- 
sponse adjustment model. At the same time, there is almost 
no difference between the corresponding standard errors 
(given in parentheses). Overall, we found that the estimates 
of the standard errors of ie 4 are slightly smaller than for one : 
and that this negligible difference in favour of 6,,,..4 is not 
enough to compensate for the larger bias affecting 0 
induced by the wrong adjustment for non-response. 
There is no difference between 0_..., and Orong when the 
second (best) adjustment for non-response is used. This is 
true for most parameters except for the conditional rates: for 
example, in Table B.1 (10% attrition) the empirical bias of 
the mixed estimate of the conditional rate of remaining low 
income in 1994 was found statistically significant, whereas 
the empirical biases of the longitudinal estimates of the two 
conditional rates were found non-significant (see Appendix 
C). Of course the “perfect” model for adjustment (not shown 
here) yields exactly the same numbers from the two 
estimation methods, and 6 is approximately equal to 


mixed ” 


mixed 


Oe for any parameter considered, but their variances differ. 

We introduce a single “sensitivity measure” that com- 
bines information on sampling standard error and model bias 
caused by the applied attrition adjustment model: 


i (6 og Op) + 8:€.26 


aA 
nied! oe 


(6.1) 
s.c.7(8,) 


Here, 6, and Gi, q (A= MCAR or MAR) denote estimates 
obtained under “no attrition” and under an attrition adjust- 
ment model respectively, and s.e.(.) stands for the standard 
error due to sampling. Similarly, we define s(6 ). If an 
attrition adjustment does not change by much the value of an 
estimator and its standard error (compared with the estimate 
obtained using another attrition adjustment), we say that the 
estimator is relatively insensitive to the applied attrition 
model. The ratios of the two sensitivity measures of the two 
applied adjustment models are defined by 
Fa eae s (McA) s(6MA8) and 


mixed mixed 
6 “~MCAR “AMAR 
TatiOrong = s(6Mc ) / son ), 


Values of the ratio for different attrition scenarios are 
presented in Charts B.1-B.3 in Appendix B. 

From Charts B.1-B.3 it is evident that the ratio of the 
sensitivity measures (6.2) is systematically lower for the 
longitudinal estimator. This further means that the sensitivity 
measure of longitudinal estimator under applied adjustment 
models are more alike than those of the mixed estimator. The 
longitudinal estimator seems to be more insensitive on the 
applied adjustment models. We refer to this as “robustness”. 
Regarding the simulated attrition rates, the charts show that 
as the attrition rate increases the sensitivity measures ratio 
approaches 1. This means that both models of adjustment 
perform alike for higher attrition rates, and then the choice 


(6.2) 


of the estimators becomes more important than the model 
used in the adjustments. 
We summarize our findings as following 


1) In the estimation of later wave cross-sectional 
parameters, estimators based on the actual longitudinal 
sample are more biased than estimators based on the 
cross-sectional sample. 


2) In the estimation of longitudinal parameters, both the 
mixed and longitudinal estimators are considerably 
biased if the wrong model of attrition adjustment is 
used. 


3) The longitudinal estimator is more robust against the 
inappropriate adjustment for attrition than the mixed 
estimator. Under the perfect adjustment model, these 
two estimators perform alike. 


4) In general, the sampling variance of the mixed 
estimator is smaller than the variance of the longitu- 
dinal estimator. This relationship remains steady over 
different attrition rates and different adjustment 
models. 


5) For the mixed estimators, the magnitude of the bias 
coming from inappropriate non-response adjustments 
overshadows the small gain in precision when 
compared to the longitudinal estimates. 


6) Different models of adjustment perform alike for 
higher attrition rates. In this case the choice of the 
estimator is more important than the efforts at model 
improvement. 
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APPENDIX A 


Description of Simulation for Section 3. 


The simulation consisted of the following steps. 


1. Let X be a log-normal random variable, X ~ exp {N 
(u = 10.3, 62 =0.64)}. These parameters correspond 
to a median similar to that of the SLID estimate for 
1992, and a spread similar to that of the Canadian 
population. The low income boundary was set to the 
first quintile of the income population. The first 
quintile g, was estimated from a simulated sample of 
size 50,000. The value obtained was q, =14,901. 


2. From this infinite population, 1,000 independent 
random samples of size 1,000 were selected. 


3. To simulate attrition, from each sample, 50% of the 
units with income below q, were selected at random 
and dropped from the sample for the calculations 


Survey Methodology, June 1999 


pertinent to the second wave. Thus 10% attrition from 
the low income class was simulated (MAR model). 


4. For each sample i, the low income proportion estimators 
O nixed) and 0,,,(7) were estimated with weights 
adjusted under both the correct attrition model (MAR) 
and under the incorrect assumption of units missing 
completely at random (MCAR). 


5. Also, for each sample i, we calculated the cross-sec- 
tional estimator under complete response, OPE), 
which is entirely based on the sample before attrition. 


6. For each type of adjustment, the expectation with 
respect to design and the attrition model of ae : ee 
and 0... was estimated by their respective arithmetic 
means over 1,000 samples with the incorrect adjustment, 


and over 539 samples for the correct adjustment. 


Result of the Simulation 


The next two tables show that under the incorrect specifi- 
cation, the longitudinal estimator has less bias than the 
mixed estimator, and under the correct specification for the 
adjustment, both estimators are unbiased (with respect to the 
model and the design). 

The arithmetic mean of One over the 1,000 different 


values was 0.193, and the standard deviation of the 1,000 
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values was 0.012. This implies that fora SRSWOR sample 
of size 1,000, the estimate Gee , 18 quite stable and its 
expectation can be used as surrogate for 8. The expected 
values of Orme and Bion 2 are estimated by 0.109 and 0.145, 
with standard deviations of 0.011 and 0.013 respectively. 


Expected Values Under Mis-Specification 


of the Adjustment Model 
: Expected Standard Number of 
Estimator a 
value deviation samples 
Oe 0.109 0.011 1,000 
On 0.145 0.013 1,000 
Oe 0.193 0.012 1,000 
Expected Values Under the Correct Adjustment 
of the Attrition Model 
Esti Expected Standard Number of 
stimator sae 
value deviation samples 
eer 0.193 0.016 539 
Shee 0.193 0.014 539 
6 0.194 0.012 539 


cross 


We see from the table above that both estimators approx- 
imate the true value of the parameter if the adjustment 
model is correct. 
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Table B.1 
Estimates of Different Population Characteristics and Their Standard Errors Obtained From 
the Complete Data Set and Under 10% Attrition in the Second Wave 


Attrition Adjustment Model 


Parameter Type of Estimator No Attrition MCAR MAR 
6 S.e. 6 S.e. A 6 S.e, A 
Quantiles 
Speers M 29,300 (1,000) 29,300 (1,000) 0 29,300 (1,100) 0 
0 L 29,300 (1,000) 30,900 (1,000) -1,600 29,300 (1,200) 0 
ee M 28,600 (1,100) 30,400 (900) -1,800 28,600 (1,100) 0 
b 28,600 (1,000) 30,400 (1,000) ~-1,800 28,600 (1,200) 0 
Proportions 
M 0.156 (0.010) 0.092 (0.008) 0.064 0.124 (0.009) 0.032 
P(Y9 < ty 1 <t) L 0.156 (0.010) 0.111 (0.008) 0.045 0.124 (0.009) 0.032 
Pp <b, 2h) M 0.007 (0.002) 0.003 (0.001) 0.004 0.005 (0.002) 0.002 
L 0.007 (0.002) 0.004 (0.001) 0.003 0.005 (0,002) 0.002 
: M 0.011 (0.002) 0.013 (0.003) -0.002 0.012 (0.002) 0.001 
P(Yo > bys 1 sh) 0 0.011 (0.002) 0.011 (0.003) 0.000 0.012 (0.002)  -0.001 
Sls M 0.790 (0.040) 0.840 (0.040) -0.050 0.804 (0.042) —-0.005 
P(Yo2!»¥1 241) ib 0.790 (0.040) 0.831 (0.042) -0.041 0.804 (0.043) -0.005 
Conditional Rates 
M 0.923. (0.023) 0.546 (0.025) 0.377 0.734. (0.033) 0.189 
P(Y, <1, |¥9<b) ie 0.923 (0.023) 0.926 (0.030) -0.003 0.921 (0.031) 0.002 
: M 0.040 (0.010) 0.018 (0.006) 0.022 0.030 (0.009) 0.010 
P(y:>4 |Yo $4) L 0.040 (0.010) 0.036 (0.010) 0.004 0.038 (0.012) 0.002 


I; =(1INO)L; I, 
M denotes Mixed (6) and L denotes Longitudinal (0) estimates. 


” is used to identify true transitions from one wave to the next. 


6 is the estimate, s.e. denotes the standard error of the estimate, and A is the difference between the corresponding estimates 
obtained using the attrition adjustment model and assuming no attrition. 
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Table B.2 
Estimates of Different Population Characteristics and Their Standard Errors Obtained From 
the Complete Data Set and Under 20% Attrition in the Second Wave 


We knee Attrition Adjustment Model 


Parameter Type of Estimator MCAR MAR 
) S.e. i) Sie A 8 S.e. A 
Quantiles 

M, (median, t =0) M 29,300 (1,000) 29,300 (1,000) 0 29,300 (1,000) 0 

i 29,300 (1,000) 31,800 (1,100) -2500 29,300 (1,000) 0 

M, (median, t=1) M 28,600 (1,100) 31,100 (800) -2500 28,600 (1,000) 0 

L 28,600 (1,000) 31,100 (900)  -2500 28,600 (1,000) 0 

Proportions 
M 0.156 (0.010) 0.055. (0.008) 0101 0.096 (0.012) 0.060 
PY 5 by $4) Li 0.156 (0.010) 0.080 (0.006) 0.076 0.096 (0.013) 0.060 
P(%y <I ¥ 2h) M 0.007 (0.002) 0.001 (0.001) 0.006 0.004 (0.002) 0.003 
i. 0.007 (0.002) 0.003 (0.001) 0.004 0.004 (0.002) 0.003 
, M 0.011 (0.002) 0.014 (0.003) -0.003 0.012 (0.002)  -0.001 
P(Y9 2 !y¥ 3h) ‘% 0.011 (0.002) 0.012 (0.002) -0.002 0.012 (0.002)  -0.001 
é : M 0.790 (0.040) 0.864 (0.041) -0.074 0.820 (0.049) — -0.030 
P(N >! + 2h) ry 0.790 (0.040) 0.855 (0.042) -0.065 0.820 (0.048)  -0.030 
Conditional Rates 

M 0.923 (0.023) 0.323 (0.051) 0.600 0570 (0.057) 0.353 
P(y, sh | Yoh) 0.923 (0.023) 0.914 (0.040) 0.009 0.928 (0.058)  -0.005 
: M 0.040 (0.010) 0.007 (0.005) 0.033 0.026 (0.010) 0.014 
PCy > ty [Yq 5 49) L 0.040 (0.010) 0.030 (0.012) 0.010 0.042 (0.014) —-0.002 


Table B.3 
Estimates of Different Population Characteristics and Their Standard Errors Obtained From 
the Complete Data Set and Under 30% Attrition in the Second Wave 


Attrition Adjustment 


Parameter Type of Estimator No Attrition MCAR MAR 
6 Sie! ) Stes A 0 Se A 
Quantiles 

; M 29,300 ~=—(1,000) 29,300 (1,000) 0 29,300 ~=(1,000) 0 

M, (median, t=0) 
It 29,300 (1,000) 32,000 (900) -2,700 29,300 = (1,000) 0 
: M 28,600 (1,100) 31,200 (800) -2,600 28,600 (1,000) 0 

M, (median, t=1) 
Ww 28,600 (1,000) 31,300 (900) -2,700 28,600 (1,100) 0 


Proportions 


M 0.156 (0.01) 0.04 (011) 0.116 0.080 (©.014) 0.076 

P(% § yyy $41) L 0.156 (0.01) 0.07 (0.006) 0.086 0.080 (0.016) 0.076 
PON nin) M 0.007 (0.002) 0.001 (0.001) 0.006 0.004 (0.002) ~—0.003 
L 0.007 (0.002) 0.003 (0.001) 0.004 0.004 0.002) 0.003 

M 0.011 (0.002) 0.015 (0.003)  -0.005 0.013. (0.002) _-0.002 

PY? ty», sh) t 0.011 (0.002) 0.012 (0.003) -0.001 0.013 (0.002) —_-0.002 
Se M 0.790 (0.04) 0.874 (0.037) —--0.084 ~—«-0.829-—«(0.049) ~—-0.039 
P%>'9+¥, 2h) ib 0.790 (0.04) 0.864 (0.038) -0.074 0.828 (0.051)  -0.038 

Conditional Rates 

M 0.923 (0.023) 0.245 (0.045) 0.678 0.465 (0.071) 0.458 

PO <4, 1% $49) L 0.923 (0.023) 0.885 (0.045) 0.038 0.930 (0.099) -0.007 
/ M 0.040 (0.010) 0.008 (0.006) 0.032 0.022 (0.012) 0.018 

PA >t 1% 5 4) i 0.040 (0.010) 0.037 (0.016) 0.003 0.044 + (0.017) _-0.004 
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Charts B 
Sensitivity Measures Ratio of the Mixed and Longitudinal Estimators 


1. 10% attrition rate in the second wave 


Sensitivity Measures Ratio 


8 


p{y(0)<=L0,y(1)<=L1} 


p{y(0)<=LO,y(1)=>L1} 


p{y(0)=>L0,y(1)<=L1) 


P{y(0)=>L0,y(1)=>L1) 


p{y(1)<=L1 ly(0)<=L0) 


p{y(1)=>L1 ly(0)<=L0} 


2. 20% attrition rate in the second wave; 


Sensitivity Measures Ratio 


4 6 8 


p{y(0)<=L0,y(1)<=L1} 


[Mixed (MCAR/ MAR) BEB { ongitudinal (MCAR /MAR) 
p{y(0)<=L0,y(1)=>L1} : | | . / 
p{y(0)=>L0,y(1)<=L1} 
p{y(0)=>L0,y(1)=>L1} 


DIV) celtly (0) 260) 


ply(1)=>L1 ly(0)<=Lo} 


3. 30% attrition rate in the second wave 


Sensitivity Measures Ratio 


4 8 


C1 Mixed (MCAR / MAR) 
BB Longitudinal (MCAR / MAR) 


ply(0)=>L0,y(1)<= : | | 


} 


p{y(1)<=L1 1 y(0)<=LO} 


p(y(1)=>L1 ly(0)<=L0) eee ere ee 
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APPENDIX C 


We found the empirical bias of the mixed estimates 
(under a MAR adjustment model) of the conditional rate of 
remaining low income in 1994 given that the individual was 
low income in 1993, statistically significant when 
performing a conservative test of the form 


6, c. ieee | var nixea) Bs var(6,). 


We found the empirical bias of the mixed estimates of 
the conditional rate of having an income higher than the 
LIM in 1994 given that the individual was low income in 
1993, (under a MAR adjustment model) non-significant 
when performing a “radical” test of the form 


(6, 7] bape) / s.e.(6 nixea) 


Similarly, we found the empirical bias of the longitudinal 
estimates (under a MAR adjustment model) of both 
conditional rates, non-significant when performing the 
same type of “radical” test as above, i.e., when assuming 
that the estimate under no attrition is non-stochastic. 

These results hold for 10%, 20% and 30% attrition rates. 
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Utilising Longitudinally Linked Data from 
the British Labour Force Survey 


PAM F. TATE’ 


ABSTRACT 


The British Labour Force Survey (LFS) uses a rotating sample design, with each sample household retained for five 
consecutive quarters. Linking together the information on the same persons across quarters produces a potentially very rich 
source of longitudinal data. There are however serious risks of distortion in the results from such longitudinal linking, 
mainly arising from sample attrition, and from response errors, which can produce spurious flows between economic activity 
states. This paper describes the initial results of investigations by the Office for National Statistics (ONS) into the nature 


and extent of the problems. 


KEY WORDS: Longitudinal data; Labour Force Survey; Economic activity; Attrition bias; Response error. 


1. INTRODUCTION 


The British Labour Force Survey (LFS) is a household 
survey, gathering information on a wide range of labour 
force characteristics and related topics. Since 1992 it has 
been conducted on a quarterly basis, with each sample 
household retained for five consecutive quarters, and a fifth 
of the sample replaced each quarter. 

The survey is designed to produce cross-sectional data, 
but in recent years it has been recognised that linking 
together data on each individual across quarters could 
produce a rich source of longitudinal data, the uses of 
which include estimation of labour force gross flows. 

The process of linking information on the same individ- 
ual from different quarters in the LFS is relatively straight- 
forward. However, there are methodological problems 
which pose serious risks of distortion in the results from this 
new, hitherto untested use of LFS data. Similar problems 
have been identified in other countries’ labour force 
surveys, but there are as yet no generally accepted methods 
of dealing with them. The Office for National Statistics 
(ONS) has therefore undertaken a programme of work to 
address this issue. 

This paper describes the results so far of investigations 
into the nature and extent of the problems, and the proposed 
methods of dealing with them. The issues fall into two main 
groups: biases arising from sample attrition and related 
factors; and biases arising from response errors, particularly 
their effects in producing spurious flows between economic 
activity states. These are considered in turn. 


2. SAMPLE ATTRITION AND ITS BIASING 
EFFECTS 


Some sample members are lost at the initial stage, 
because of nonresponse in the first interview, either because 
it has not been possible for them to be contacted during the 


1 


narrow time window available, or because they have 
refused to be interviewed. After that, further sample 
members are lost from each successive quarterly interview 
round, either because they have moved house (the basic 
sampling unit for this survey being the dwelling), or 
because it proves impossible to contact them or they refuse 
to continue. All these groups of people are, in different 
ways, atypical of the population as a whole, so their loss 
from the sample can introduce biases. 

Some of these biases are compensated for in the course 
of applying the normal LFS weighting procedure, which 
produces population level estimates which are consistent 
with census-based control totals by sex, age group and 
region. This process will compensate for biases arising, at all 
stages of the survey, from differential attrition by sex, age and 
region. However, biases in other characteristics which are not 
themselves used in the weighting procedure will not be 
compensated for (and may even be increased) in that process, 
except when they are related to age, sex or region, in sucha 
way that the bias is caused entirely by the under- or over- 
representation of particular age, sex or region categories. 

Work on this subject therefore looked first at what 
characteristics are more or less represented in the LFS 
sample than the whole population, and in different waves of 
the LFS sample. (Each quarter, the sample is made up of 
five waves, the people in the first wave having their first 
interview, those in the second wave their second interview, 
and so on.) It then examined whether and to what extent 
these characteristics are related to each other, and whether 
it is possible to define a set of variables which characterise 
those people who are likely to be under-represented. 


3. CHARACTERISTICS OF 
NON-RESPONDENTS 


Analysis of the proportions which could not be linked to 
the next quarter, by wave, for key demographic and 
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economic variables (Table 1 gives an illustration for broad 
age/sex groups), showed that, consistently across all waves, 
there is a greater propensity to be under-represented for 
young people aged 18 to 29 (and especially 18 to 24), single 
people, those living in London, people in rented accommo- 
dation (especially privately rented), the unemployed, and 
those in temporary employment. Most of these characteris- 
tics have also been found (by Foster (1994) in a study which 
linked data from the 1991 Census with non-responding LFS 
sample households) to be associated with high non response 
at the first interview, particularly young adults, single 
people, one person households, and those living in London. 


Table 1 
Percentage of Unlinked Cases by 
Sex and Age Group by Wave 
Variable & Unlinked percentage 
category Wave | Wave 4 
All persons 8.6 4.8 
AGE & SEX 
Male 8.6 4.9 
15-17 6.8 4.9 
18-29 13.8 10.2 
30-44 6.8 4.1 
45-64 UD 2.5 
Female 8.7 4.7 
15-17 5.9 3.0 
18-29 13.9 10.9 
30-44 6.3 2.8 
45-59 Tes Ded, 


Note: More detailed analyses are available from the author. 


Several of the characteristics of those who are lost to the 
sample appear likely to be related, and this was investigated 
in the first instance using logistic regression. The variables 
identified as being independently associated with whether 
the cases were lost from the sample, were found to be 
largely consistent for the four waves. In each case they 
included age group, marital status, tenure, (i.e. whether the 
accommodation was owned, rented from a private landlord, 
or rented from a local authority or housing association), 
qualification level, and a combined economic activity 
variable incorporating broad economic activity (employed, 
unemployed or inactive), and, for the employed, employ- 
ment status, part-time/full-time and temporary/permanent. 
Region was found to be independently associated in only 
two of the four waves, and sex in none. 

For the five variables consistently appearing for all 
waves, there was a good degree of consistency concerning 
which categories were associated with sample attrition. 
Table 2 gives the multiplying factors for the odds ratio for 
all categories with a consistent association with increasing 
attrition. Being in the younger age groups, between 18 and 


Tate: Utilising Longitudinally Linked Data 


29 (and especially 18 to 24), has a particularly strong effect, 
as does being in privately rented accommodation. Being 
single (i.e., never married and not cohabiting) has a 
moderate association. There are no consistent associations 
with particular categories of economic activity or qualifica- 
tion level, except for a slight one with full-time, temporary 
employees. The effect of region is not consistent even for 
the two waves in which it appears. 


Table 2 
Multiplying Factors for Odds Ratios - 
Categories Associated with High Attrition 


Multiplying factor for odds ratio 


Variable Category Wavel Wave2 Wave3 Wave4 

Age Group 18-19 1.89 2.56 2.86 | Oy. 
20-24 eS 2.08 2.10 2.83 
25-29 tele) 1.30 1.44 NSS 

TEDUrS yi ya Eivalely eee) eve ae 9 80) 
rented 

Marital ; 

Stata Single IoD S (1.12) Lh eF7) 1.49 

Economic Employee, 

activity/ full time, (1.12) (E36) (IRIS) eels 

status temp 


Note: () indicates coefficient is not significant at 5% level. 


The logistic regression analysis performed did not allow 
for interactions between the variables, and to investigate 
this possibility a further analysis was performed, using the 
CHAID module of SPSS to produce a segmentation of the 
data set into groups which have as great a variation as 
possible with respect to the proportion of unlinked cases. 
The results of this were however very similar to those of the 
logistic regression analysis. Overall, the main characteris- 
tics independently associated with a high proportion of 
sample loss were the younger adult age groups (18 to 29, 
especially 18 to 24) and living in privately rented accommo- 
dation, with some relatively minor additional effects of 
being in temporary employment for the youngest age 
groups. Separate analyses of the characteristics of those 
sample members who had been lost through moving away, 
and those lost through non-contact (or, more rarely, refusal) 
produced similar results. 


4. COMPENSATING FOR ATTRITION BIAS 


The analysis so far has been directed at the biasing effect 
of sample attrition on the cross-sectional characteristics of 
the longitudinal sample, and has identified the charac- 
teristics independently associated with greater nonresponse. 
A possible approach to compensating for the bias arising 
from this is to incorporate tenure as well as age into the 
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weighting procedure for the longitudinal data. This is being 
explored, using a calibration approach with CALMAR 
software, and including prior weights derived from the 
work described above to compensate for differential 
nonresponse by tenure. 

However, there may be a problem which would limit the 
effectiveness of this approach. The propensity to not 
respond may be directly dependent on the unobserved 
labour force status of the individual, and possibly independ- 
ently of their observed characteristics. Nonresponse of this 
kind is an example of non-ignorable nonresponse (Rubin 
1976), and its presence would imply that estimates of the 
important measures of labour force gross flows would be 
biased even after the application of a weighting process of 
the type being explored. 

There are two indirect approaches which give some 
indication of whether non-ignorable nonresponse might be 
a problem for longitudinal LFS data. One is to investigate 
whether the proportion of the gross flows in the sample 
which are transitions between different economic activity 
states systematically decrease (or increase) from wave 1-2 
to wave 4-5; if so, this would suggest that people changing 
from one state to another are more (or less) likely to be 
nonrespondents than those in a stable state. However, 
Table 3 shows that there is no consistent systematic pattern 
across waves — though this does not exclude the possibility 
of other patterns of differential nonresponse by labour force 
flows category. 


Table 3 
Percentage of Transitions Between Different Economic 
Activity States by Wave for Pairs of Adjacent Quarters 


Percentages 
Data Set Wave Wave Wave Wave 
1-2 2-3 3-4 4-5 
Summer/autumn 1995 8.0 UWS U3 Tell 


Autumn 1995/ 
winter 1995-1996 


Summer/ autumn 1996 7.6 7.0 1S TS) 


Autumn 1996/ 
winter 1996-1997 


UL 6.7 6.5 6.5 


6.8 6.5 6.2 6.5 


Another possibility is that people moving addresses (and 
thereby lost to the LFS sample) may have a different pattern 
of labour force flows than the rest of the population. We do 
not have any information on the people who have moved 
away, but we do know something about the people who 
have moved into the sample addresses from elsewhere. 
These movers-in can reasonably be taken to represent the 
movers-out, since they are equally samples from the same 
population of movers (ignoring the possible effects of the 
small proportion of international moves). Table 4 shows 
the distribution of the linked sample (all adults whose 
records were able to be matched) and of the identifiable 
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movers-in for a pair of adjacent quarters in 1995. (It should 
however be noted that the flows categories are not strictly 
comparable, since the previous economic activity state for 
the movers-in is obtained by retrospective reporting.) It is 
clear that the sample of movers does differ, with a lower 
proportion in stable inactivity, and a higher proportion in all 
the other flows categories, and in particular a greater 
proportion of people changing their economic activity state; 
but that the movers make up such a small proportion overall 
that the effect on the whole sample is negligible. 


Table 4 
Gross Flows for Movers — in Compared with Linked Sample 


Activity states Linked sample Movers-in Linked + movers 


(%) (%) (%) 
EE 551 56.9 Spill 
EU 0.8 1 0.8 
EN iis 1.6 Ital 
UE 1.0 iley 1.0 
UU DS, 6.5 3.0 
UN 0.7 fle 0.7 
NE i 2S 1.3 
NU 1.0 23 Lil 
NN 36.2 26.0 35,9 
All transitions one) 10.6 6.0 
TOTAL (no.) 80,664 1,790 82,454 


Note: E represents in employment 
U represents ILO unemployed 
N represents economically inactive 


hence EE represents in employment at both quarters 
EU represents in employment then ILO unemployed etc. 


These indirect approaches do not indicate any very 
strong effect of non-ignorable nonresponse, but they do not 
rule it out. This possibility is therefore being investigated 
by work involving the modelling of nonresponse in the 
LES. 


5. RESPONSE ERROR AND ITS BIASING 
EFFECTS 


All surveys in general, and household surveys in particu- 
lar, are subject to response error, when the information 
given by the respondent is not an accurate reflection of the 
actuality. This may occur for a variety of reasons — the 
respondent may misunderstand the question; the interviewer 
may misunderstand or misrecord the response; the respon- 
dent may not know or remember the correct answer; or the 
respondent may knowingly give an incorrect answer for 
reasons of embarrassment, prestige, fear of breach of 
confidentiality or a wish to give the “expected” answer. 
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In the field of labour force surveys it has generally been 
found (for an overview see Lemaitre 1994) that, for 
cross-sectional data, there is no particular tendency for the 
errors to be systematic, so that on average they tend to 
cancel out. However, for longitudinal data produced by 
linking together data collected on the same person at 
different points in time, this cancellation may not occur. 

In particular, this is likely to be the case for data on gross 
flows between economic activity states. The numbers of 
people who move from one state (in employment, unem- 
ployed, economically inactive) to another during the relati- 
vely short period usually considered (a month, a quarter, or 
perhaps a year) are small compared with the numbers of 
people who remain in the same state. A response error at 
one point of time is much more likely to lead to an apparent 
change of state when the true situation is one of stability, 
than the reverse. Thus response errors are likely to have a 
very disproportionate effect in upwardly biasing flows 
between reported states. In the LFS, they may arise from 
the use of proxy respondents, where one person answers 
questions on behalf of someone else in the same household; 
and from respondent errors. We will consider these in turn. 


6. THE EFFECT OF PROXY RESPONDENTS 


To investigate the effect of proxy respondents, we need 
to look at the distribution of activity states at the two 
quarters according to whether the first quarter’s interview 
was in person or by proxy, and whether the second quarter’s 
interview was in person or by proxy. Very young adults 
under 20 are both exceptionally likely to be represented by 
proxies and also likely to be particularly volatile in terms of 
their economic activity category, and so may distort any 
relationship between these two factors. Table 5 therefore 
shows the distribution of activity states at the two quarters, 
for men aged 20 to 64 and women aged 20 to 59. There is 
a higher proportion of transitions for personal followed by 
proxy interviews than for personal at both quarters, but 
proxy followed by personal interviews show only a very 
slightly higher proportion than personal at both quarters. 
Thus switching between proxy and personal interviews 
does not show a consistently greater proportion of 
transitions. Cases with both interviews by proxy have the 
lowest proportion of transitions of all, and the inclusion of 
these brings the overall proportion to a level consistent with 
that for personal interviews at both quarters. Thus there do 
appear to be differences between the various combinations 
of interview types, which merit further investigation, but in 
the LFS the use of proxy respondents does not of itself 
produce an exaggerated estimate of gross flows. 
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Table 5 

Percentage of Transitions by Interview Type 
Interview Men (20-64) Women (20-59) 
type Sample no. %trans. Sampleno. % trans. 
On aay 5.2 19,582 73 
personal 
acer 2,044 7.0 1,597 8.3 
proxy 
oe 2,214 5.4 1,632 7.6 
personal 
OS 8,602 47 4,206 5.4 
proxy 
All 27,387 502 27,017 dal 


7. RESPONDENT ERRORS 


By their nature, respondent errors are impossible to 
identify directly, (except perhaps by re-interview, and even 
then there may be doubt about what is the correct answer). 
It is however sometimes possible to identify internal incon- 
sistencies in the survey data, which may indicate response 
error. In the LFS, respondents who are in employment, and 
respondents who are unemployed, are asked how long they 
have been in that state. If the period is greater than three 
months, but they stated in the previous quarter that they 
were in a different state, there is an inconsistency which 
may indicate a false transition between economic activity 
states. 

Table 6 shows the percentage of inconsistencies for 
various kinds of transitions — these are high throughout. 
Transitions from economic inactivity produce the highest 
percentages, especially when the transition is into unem- 
ployment. (There are no large or consistent differences 
between the different subcategories of the inactive.) Sepa- 
rating those in employment into part-time and full-time 
shows that there is a consistent pattern of a greater 
proportion of inconsistencies for part time employment, and 
similar but less pronounced results were found for the 
self-employed. 


Table 6 
Percentage of Inconsistencies by Transition Type 


Percentage of inconsistencies 


Transition Type All Full time Part time 
(%) (%) (%) 
Unempl. to Employment 8.7 7.8 122 
Inactive to Employment 26.2 18.1 30.4 
Employment to Unemployment 18.7 14.7 2S 
Inactive to Unemployment 49.5 


All 2319 
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It is possible that the inconsistencies may have arisen 
through errors in the reported length of time in the econo- 
mic activity state at the second quarter, rather than in the 
initial state at the first quarter. The distribution of the length 
of time does not however show heaping at around four to 
five months (as would be expected in the case of errors in 
the duration data). Also, the duration data reported in 
consecutive quarters for people in a stable state were found 
to be very consistent. These findings tend to suggest, 
though the evidence is indirect and by no means conclusive, 
that the errors are more likely to be in the reporting of 
economic activity at one or other of the interviews. This is 
not the only possibility — for example, it may be that some 
respondents have correct transition data, but incorrect 
duration data through using an interpretation of their past 
economic activity which is not consistent with the standard 
definitions applied to the reporting of their current state — 
but the findings so far suggest that it is likely to be the most 
common. 

Some light on which of the inconsistent categories is 
correct may emerge by looking at the pattern of responses 
over three interviews. Table 7 shows the proportions of 
each group of inconsistent transitions from one quarter to 
the next which are followed by each economic activity 
category in the third quarter. (All relevant waves are 
combined in order to obtain reasonable sample sizes.) It is 
clear that of the transitions into employment in the second 
quarter, the great majority remain in that category in the 
third quarter. The transitions into unemployment show a 
much more mixed pattern, with a little over half remaining 
in unemployment, but a substantial group of about 30 to 40 
per cent reverting to the state reported in the first quarter. 
It is noteworthy that scarcely any of the transitions from the 
second to the third quarter for this group were found to have 
a repeated inconsistency between the transition and the 
reported duration data. The results so far suggest that, in 
the case of an inconsistent transition into employment, that 
is likely to be the correct state, but more investigation is 
needed to achieve further clarification. 


Table 7 
Percentages of Inconsistent Transitions 
by Economic Activity at Following Quarter 


Transition Total Activity state in next quarter 

type inconsis- Employed Unempl. Inactive 
tent (%) (%) (%) 

Unempl. to 60 90 7 3 

Employment 

Inactive to 159 79 4 7 

Employment 

Employment 87 39 53 8 

to Unempl. 

Inactive to 229 17 55 28 

Unempl. 
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8. ADJUSTING FOR RESPONSE ERROR BIAS 


It is clear from the above that there is likely to be a 
substantial level of response error affecting the raw data on 
gross flows. Work on adjusting for such errors has so far 
been largely confined to the USA and Canada. A review of 
three methods proposed for USA data is given by Flaim and 
Hogue (1985), and a later proposal for Canadian data is 
given in Singh and Rao (1995), but to date, to the author’s 
knowledge no official adjusted gross flows data are being 
published, though several countries are publishing unad- 
justed data while drawing attention to their limitations. The 
adjustment methods so far proposed all rely on assumptions 
about the nature of the errors which seem unlikely to be met 
in practice — either full independence of the classification 
errors or very limited departures from that assumption. 
(See Lemaitre 1994 for a review of problems with these 
adjustment methods.) 

It seems worthwhile to explore different routes to the 
development of methods of adjustment or compensation 
for response error bias. As a first stage, work is continuing 
on the investigation of the characteristics and circumstances 
of cases of inconsistency, and of other possible ways of 
identifying false transitions. It is also proposed to investi- 
gate the circumstances of people giving inconsistent 
responses of the kind analysed above, by means of more 
detailed follow-up interviews. This should provide better 
indications of the extent to which the inconsistencies do 
represent response error, and may provide results useful for 
both reducing, and adjusting for, response error. Both these 
strands will provide inputs to a third element of the forward 
programme, in which it is proposed to develop models of 
classification error in reporting economic activity. 
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A Model Based Justification of Kish’s Formula for 
Design Effects for Weighting and Clustering 


SIEGFRIED GABLER, SABINE HAEDER and PARTHA LAHIRI’ 


ABSTRACT 


In this short note, we demonstrate that the well-known formula for the design effect intuitively proposed by Kish has a 
model-based justification. The formula can be interpreted as a conservative value for the actual design effect. 


KEY WORDS: Cluster size; Intraclass correlation coefficient; Selection probabilities. 


1. INTRODUCTION 


We consider multistage, clustered, sample designs where 
each observation belongs to a weighting class. For example, 
the clusters are blocks which are selected proportional to 
the number of its households. Within each block the same 
number of households is selected with equal probabilities. 
A randomly chosen person of the household has to be inter- 
viewed. Then, the household sizes determine the weighting 
classes. Kish (1987) proposed the following formula for 
determining the design effect in order to incorporate the 
effects due to both weighting needed to counter unequal 
selection probabilities, and clustered selection: 


i 
Da wi) m; 


deff as. isp), 


Kish — 7” 
I 
ye wim; 
a 


where m, and w, denote the number of observations and 
the weight attached to the i-th weighting class (i = 1,...,/), 
m =; _,m,, the total sample size, b is the average cluster 
size and p is the intraclass correlation coefficient. Kish’s 
formula is very intuitive and novel, but he said that his 
“treatment may be incomplete and imperfect.” 

Kish’s formula is now used by many survey samplers. In 
fact, the above formula will be used in the sample size 
determination in the European Social Surveys to be 
conducted by its member countries. The purpose of this 
note is to provide a model-based justification for using 
Kish’s formula. 


2. A MODEL BASED JUSTIFICATION 
OF KISH’S FORMULA 


Let m,, be the number of observations in the c-th 
sampled cluster belonging to the /-th weighting class 


1 


(i=1,...,f;¢=1,...,C). Then m, = °_,m,,, the number 
of observations in the /-th weighting class. Let b. = 
ee ;m,., the number of observations in the c-th cluster 
(=I Com lc )sottayb= Cle yb a ley. 
and Wo be the observation and the weight for the j-th 
sampling unit in the c-th cluster (c = 1,..., C;j = 1,..., b.). 
The usual design-based estimator for the population mean 
is defined as 


To justify Kish’s formula, we assume the following 
model: 


Var (y,;) SIG, fOlG = eee jade 


€ 


Pe) povitta= cay ay. 
Cov(y,;; Yer’) we 0 otherwise. (1) 
The above model is appropriate to account for the cluster 
effect and was used earlier by others (see, e.g., Skinner, 
Holt and Smith 1989). We shall then define design effect 
as deff = Var,(y,)/Var,(y), where Var,(y,,) is the 
variance of y, under model (1) and Var,(y) is the 
variance of the overall sample mean y, defined as 


ies j-1 Y,j/m, computed under the following model: 


VarQy) = G atorcrs nan Cs jaw lea 
Cov(y5. Ye) =O for all (c,j) # (c',J'). (2) 


Note that model (2) is appropriate under simple random 
sampling and provides the usual formula o7/m for 
Var, (y). 
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Now, turning our attention to Var, (y,,), first note that 1 
SS W; m; 
a Se races Eis 1p (4) 
Var, Ss Ds Wed bs wm 
c=1 j=l ret ba 
C b. 
=e) Lava wy. Peres i j terety 
» » oiNej where b* = OMA uC ema: su? m,. 
Using the Cauchy-Schwarz inequality, we get 
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Ca LN Est bet Note that be can be interpreted as an average (weighted) 


cluster size. If D, is equal to b, e.g., if all b, are equal, the 
Noting that Ne ae af 5 Va ewehave upper bound of deff is simply Kish’s formula. Thus Kish’s 
ge ie cee formula serves as a conservative value for the actual design 


effect. 
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In This Issue 


This December 1999 issue and upcoming June 2000 issue of the Journal contain papers from 
some prominent statisticians invited to participate in the celebration of 25 successful years of 
existence of Survey Methodology. As an introduction to this special issue, Richard Platek, the 
founding Chairman, who remained at the helm of the Journal until 1987, has provided an excellent 
overview of the gradual evolution of the Journal from a modest divisional to a respected 
departmental publication and then to an international publication of repute. 

I would like to take this opportunity to acknowledge a few important events which helped shape 
the Journal to the status it currently enjoys internationally. Firstly, during the first 10 years of the 
Journal, which may be called its formative years, important articles by some of the senior 
management of the Bureau, such as G.J. Brackstone, I.P. Fellegi, P.G. Kirkham, L.E. Rowebottom, 
J. Spear, M.B. Wilk and D.A. Worton, as well as by some well known survey statisticians, such as 
J.G. Bethlehem, R.E. Fay, S.E. Fienberg, W.A. Fuller, L. Kish, G. Nathan , J.N.K. Rao and C.-E. 
Sarndal helped to set the solid foundation of the Journal and defined it's role as a forum for 
publication of innovative articles relevant to a statistical agency. 

Secondly, the support and recognition of Survey Methodology by the ASA Section on Survey 
Research Methods, and in particular by some of its past chairs B. Bailar, G. Kalton, F.J. Scheuren 
and D. Binder, helped to popularize the Journal more widely among survey methods researchers as 
well as practitioners. 

Lastly and perhaps most importantly, a large part of the success the Journal has enjoyed over the 
years may be attributed to the excellence and dedication of the Editorial Board members and the 
strong commitment of the referees. The size and composition of the Board has changed significantly 
over the years. The current membership as usual is given on an earlier page and a complete list of 
past Associate and Assistant Editors is provided at the end of this issue. There are however a few 
members, such as D.R. Bellhouse, J.N.K. Rao, and G. Kalton, who joined the Board in 1984, the 
year when the scope of the Journal was greatly enlarged, and are still strongly committed to its cause. 

I now turn to the individual papers in this special issue. 

Fellegi considers the challenges facing government statistical agencies and strategies to prepare 
for these challenges. He first describes the environment of changing information needs and the 
social, economic and technological developments driving this change. He goes on to describe both 
internal and external elements of a strategy to meet these evolving needs. Internally, a flexible 
capacity for survey taking and information gathering must be developed. Externally, contacts must 
be developed to ensure continuing relevance of statistical programs while maintaining non-political 
objectivity. 

Kish describes the challenges and opportunities of combining data from surveys of different 
populations. Examples include multinational surveys where the data from surveys of several 
countries are combined for comparison and analysis, as well as cumulated periodic surveys of the 
“same” population. He also compares and contrasts the combining of surveys with the combining 
of experiments. 

Brackstone discusses issues of quality in the products of a national statistical agency. He 
identifies and discusses six different dimensions of data quality: relevance, accuracy, timeliness, 
accessibility, interpretability and coherence. He then describes the components of a quality 
management system. 

In his paper Scheuren considers the possible uses of administrative records to enhance and 
improve population censuses. After reviewing previous uses of administrative records in an 
international context, he puts forward several proposals for research and development towards 
increased use of administrative records in the American statistical system. 

Godambe and Thompson consider the problem of confidence intervals in survey sampling. They 
first review the use of estimating functions to obtain model robust pivotal quantities and associated 
confidence intervals, and then discuss the adaptation of this approach to the survey sampling context. 
Details are worked out for some more specific types of models, and an empirical comparison of this 
approach with more conventional methods is presented. 


108 In This Issue 


J.N.K. Rao gives an overview of the methods and models used for small area estimation. This 
is an update of his previous overview (Ghosh and Rao, 1994, Statistical Science). He first presents 
a general discussion of small area models, making a distinction between areal level models and unit 
level models. He then describes the development in the three main approaches for inference based 
on these models: EBLUP, EB and HB, and gives several examples of recent applications. Finally, 
he presents an interesting discussion identifying the gaps and areas that require further research. 

Sirken and Shimizu derive a Horvitz-Thompson estimator for population based establishment 
sample surveys (PBESs). A PBES is a survey of establishments where the sampling frame consists 
of establishments with which a preliminary sample of households or individuals has had some 
contact. 

Deville shows how to use simple tools to calculate the variance of a complex estimator using a 
linearization technique. The process is that of a software used at INSEE for estimation of the 
variance of a complex estimator. It gives a way of computing the variance of a total estimated by 
the simple expansion estimator. In the case of a complex statistic, the process uses a derived variable 
that reduces the computations to those of the simple expansion estimator. Multiple examples are 
given to illustrate the process. 

Brewer proposes a method of weight calibration in survey sampling, called cosmetic calibration, 
which yields cosmetic estimators of totals, i.e. estimators that can be interpreted as both design- 
based and prediction based. He also discusses variance estimation and shows how the problem of 
negative weights can be easily and naturally handled using cosmetic calibration. Finally he 
compares the properties of the weights and the resulting estimators to some alternative approaches 
using some Australian farm data. 

In the final paper of this special issue, Estevao and Sarndal consider two types of design-based 
estimators used for domain estimation. The first, a linear prediction estimator, is built on the 
principle of model fitting, requires known auxiliary information at the domain level, and results in 
weights that depend on the domain to be estimated. The second, a uni-weight estimator, has weights 
which are independent of the domain being estimated and has the clear advantage that it does not 
require the calculation of different weight systems for each different domain of interest. These 
estimators are compared and situations under which one is preferred over the other are identified. 


1 am pleased to add that with this 25" Anniversary issue, we are making Survey Methodology 
available to you in electronic format. It is easy to access the Journal on our Web site by keying in 
the following URL address: www.statcan.ca/english/e-pub. 

Once you’ve checked out the electronic version we'd appreciate you completing the brief on-line 
survey you'll find at the same location. This prototype is being offered as a test to find out what your 
future format preferences for the Journal might be. 

I assure you that any change in delivery format will not affect the high quality you expect and 
receive from Survey Methodology. 


M.P. Singh 
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Survey Methodology 
— The First 25 Years 


RICHARD PLATEK' 


This year the Survey Methodology journal, published by 
Statistics Canada, celebrates the silver anniversary of its 
remarkably successful existence that began in 1975. 
During these 25 years, the journal has developed into a 
dynamic and innovative leader in survey methodology. The 
future promises the same. 

The first issue of the journal appeared in June 1975. 
Although the publication of the journal may have surprised 
many, the period 1960-75 provided a ripe background for 
it. In Statistics Canada methodological research flourished. 
Important and challenging ideas were developed worthy of 
presentation at international conferences. In this period of 
productive activities, Quarterly Bulletin and Memoranda, 
the forerunners of the journal, were established. These 
publications highlighted more significant developments, and 
were intended as a tool in staff training. Their circulation 
had been mostly internal, however, they soon found their 
way outside to various statistical organizations, universities 
and private research centres. The breadth of subject matter 
covered by the two series was enormous. They provided a 
springboard for a number of important papers on topics 
such as small area estimation, record linkage, edit and 
imputation, variations in response and others. As research 
and development work kept increasing, so too did a need 
and desire among statisticians at Statistics Canada to publish 
formal papers that could be subjected to a refereeing 
process. Thus, in 1975, the Survey Methodology journal was 
quietly but not prematurely born. At the beginning of its 
existence, the journal was for all intents and purposes an in- 
house publication guided and nurtured by one division. 

Notwithstanding the journal’s modest beginning, its first 
Editorial Board, consisting of Richard Platek (Chairman), 
M.P. Singh (Editor), and Paul Timmons, were not modest 
in their ambitions, as expressed in the editorial policy: 


“The objective of the Survey Methodology journal 
is to provide a forum in a Canadian context for 
publication of articles on the practical applications 
of the many aspects of survey methodology. The 
Survey Methodology journal will publish articles 
dealing with all phases of methodological develop- 
ment in surveys, such as design problems in the 
context of practical constraints, data collection 
techniques and their effect on survey results, non- 
sampling errors, sampling systems development 
and applications, statistical analysis, interpretation, 


evaluation and inter-relationships among all of 
these survey phases. The emphasis will be on the 
development strategy and evaluation of specific 
survey methodologies as applied to actual surveys. 
All papers will be refereed, however, the authors 
retain full responsibility for the contents of their 
papers and opinions expressed are not necessarily 
those of the Editorial Board or of the Department.” 

(Statistics Canada 1975) 


The foregoing makes it abundantly clear that the intent 
was to create a professional journal with a very specific and 
unique focus. Up to this point, there had not existed a 
forum for the illumination of general methodological issues 
arising during the course of putting a survey into the field. 
Most statistical journals were accepting articles dealing 
primarily with the mathematical aspects of sample design. 
The journal filled a long existing vacuum in the field of 
survey methodology. It provided an immediate benefit and 
challenge to survey methodologists. By publishing in the 
journal they had the opportunity to disseminate their work 
and ideas to a wider range of survey practitioners and 
theoreticians. In a number of countries, the journal, almost 
from the beginning, provided a base for teaching and 
training new Statisticians. As S.S. Zarkovich, a prominent 
statistician from Yugoslavia put it: 


“Tn this country, the situation is as follows. Survey 
Methodology was a highly regarded periodical by 
the young generation of statisticians in this 
country. It was a subject of conversation. A good 
part of production of our young generation was 
based on the ideas expressed in Survey 
Methodology.” (Zarkovich 1985). 


Initially, for a number of years, the journal relied exclusi- 
vely on papers written by the staff in Statistics Canada. It 
was distributed, free of charge, within and outside Statistics 
Canada. The external recipients were: federal and provin- 
cial departments, university libraries, survey research 
centres, and statistical organizations abroad. This gracious 
policy had far reaching effects. The journal received a great 
deal of support from statisticians and statistical organiza- 
tions in many countries. Statisticians began to enquire about 
submitting their papers and statistical organizations ex- 
pressed interest in subscribing to the journal. In a relatively 


Richard Platek, International Consultant on Statistical Surveys, formerly at Statistics Canada, Ottawa, Ontario, Canada. 
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few years of its existence the journal won and secured for 
itself professional recognition and international stature as a 
technical journal with a unique focus on survey methodo- 
logy. References to and abstracts from the papers published 
in the journal now appear in various statistical journals and 
publications. A brief article on the journal was featured in 
Encyclopedia of Statistical Sciences (Singh 1988). 

Over the first 10 years the journal was steadily and 
successfully evolving but the process was gradual. The 
year 1984 saw the result of many important decisions that 
had the potential to change the character of the journal 
significantly. First of all the journal became an official 
Statistics Canada publication and with this came several 
concomitant developments. Commensurate with Statistics 
Canada’s policy for its publications, the journal acquired a 
price tag, and officially became a bilingual publication 
(Wilk 1982). The general appearance, printing, and format 
were improved. The production process became smoother 
and more efficient to ensure timeliness and quality of the 
final product. With respect to editorial policy and the scope 
of the journal, it was realized that a broader base in its 
content, its contributors and its readership would enhance 
its value and effectiveness. On the other hand, there was 
some concern that its main objectives, as expressed in the 
initial Editorial Policy, not be lost in the process. Finally, 
a decision was made to broaden the journal’s scope, 
expanding the Editorial Board to new areas, accepting and 
inviting papers from outside. The international community 
responded to the invitation by submitting many papers to 
the journal. This trend continues to this day. 

Another important decision was the establishment of a 
separate Management Board. The Management Board, with 
the help of a Production Manager would coordinate various 
phases of the journal’s production to keep pace with its 
professional responsibilities. The journal’s pricing, rela- 
tionship with other journals, and production issues are 
frequently on the agenda of the Management Board. 

Concurrently with all the new decisions, discussions 
were held and distribution agreements were reached with 
the International Association of Survey Statisticians, the 
Statistical Society of Canada, and the American Statistical 
Association, and more recently with the American Asso- 
ciation for Public Opinion Research. The members of these 
associations were given the opportunity to subscribe to the 
journal at various special rates. 

All of these developments resulted in a different 
perception of the journal, both internally and externally. 
Externally, the journal entered the international arena. 
Internally, important changes took place in its Editorial 
Policy, which emphasized that “The Survey Methodology 
journal will publish articles dealing with various aspects of 
statistical development relevant to a statistical agency” 
(Statistics Canada 1984). 

While keeping abreast of new requirements and needs, 
the journal continues to extend its scope to cover a full 
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range of methodological questions arising in surveys. In its 
steady growth, the journal introduced, in 1988, a preface 
called “In this Issue” (Statistics Canada 1988). Further- 
more, from time to time, the journal has been carrying 
special sections dedicated to topics of particular interest. 
Examples of topics that were covered in such special 
sections include census coverage errors, data analysis, 
establishment survey methods, and longitudinal surveys and 
analysis. Notices of conferences and seminars on surveys 
also appear in the journal. 

To reflect the increasing number and depth of topics 
published in the journal and to keep pace with its profes- 
sional commitments, the journal’s Editorial Board was 
enlarged and another new Management Board was 
established. 

The very essence of any journal is its sensitivity to 
changing times and expectations. The management of the 
journal has been, therefore, conducting market research 
studies in order to evaluate customers’ reaction to the 
journal. Although the outcome of some recent investigations 
show that some readers feel that their needs for practical 
applications are not fully met, most regard the journal as a 
high quality journal and are satisfied with its content. 

In recent years the journal has become very popular 
among academics, with many seeking to publish their 
articles in it. A view has been expressed that, if this is not 
controlled, the journal may lose its general and educational 
appeal to some readers in many countries. While it is 
proper and healthy to recognize and publish theoretical 
papers, it is equally important to ensure that this will not 
become a dominant trend. 

At present, the variety of topics published in the journal 
is very impressive. Based on the classification by topics 
provided by the Index to Survey Methodology volumes | to 
24, out of 420 articles, 31% dealt with estimation, 20% with 
sampling design and survey development, and 12% with 
non-sampling errors. The other articles dealt with analy- 
tical methods, data collection, quality assurance, edit and 
imputation, confidentiality and a few with general topics. 
It should, perhaps, be encouraged that papers on question- 
naire design and non-response, the weakest links in survey 
design, be more frequently published in the journal. 

For the past several years, the journal has been extremely 
ably guided by Gordon Brackstone, Chairman of the 
Management Board, M.P. Singh, an excellent Editor since 
the beginning, and Frank Mayda as Production Manager. 
The Editor is assisted by Associate Editors, who come from 
universities, government agencies, and private sectors 
around the world, ensuring a desirable mix of theoretical and 
practical interests. The large number of subscribers from 
many countries (70) gives a clear testimony to the journal’s 
broad appeal and importance. Statistics Canada should be 
proud of its journal. The journal is not only effective 
publicity for the organization, but is also a leading 
methodological publication in the world. 
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Statistical Services — Preparing for the Future 


IVAN P. FELLEGI’ 


ABSTRACT 


In this last year of the 20" century I propose to look forward: to the challenges facing statistical agencies and how to prepare 
for them. I will first of all review the context within which statistical offices must evolve: first the main forces at work that 
are modifying our economy and society; second, specific policy issues that need to be addressed; and third, changes in the 
nature of government and in expectations from it. I will then try to outline an internal strategy for statistical offices derived 
from the foregoing analysis. On the one hand, this will require the development of new types of data systems that are needed. 
I will illustrate these with reference to recent initiatives by Statistics Canada. While crucial, these new data systems will 
probably only account for a relatively small proportion of our expenditure. Hence a second important component of our 
strategy designed to cope with external social and economic changes must be to ensure a high level of adaptability of our 
core activities. Such adaptability requires specific initiatives. Finally, I will describe the elements of an “external strategy”: 
how to manage our interactions with the world around us. Three elements will be touched upon: achieving and maintaining 
a high level of relevance; the issue of political objectivity and its perception; and international collaboration. In each case 
I will try to outline specific measures that I consider essential. 


KEY WORDS: Statistical organization; Strategy; Planning; Conceptual frameworks; Relevance; Non-political objectivity. 


113 


1. INTRODUCTION: THE POLICY 
CHALLENGES 


An early version of this paper was prepared for the 1997 
UK Statistics Users Conference (London, November 1997). 
It also formed the basis of the Gold Medal address deli- 
vered to the 1998 Annual Meeting of the Statistical Society 
of Canada. 

Peering into the future and discerning relevant trends is 
never easy. Even more difficult is the derivation of a 
strategy for statistical offices. 

Indeed, there is a saying that “forecasting is very difficult 
— particularly of the future.” I am therefore very fortunate 
that, by coincidence, I can rely on others for part of my job. 
Recently the head of the public service of Canada (the 
Clerk of the Privy Council) asked a group of senior policy 
analysts from major departments (I will refer to them as the 
Policy Group) to produce a paper “on the pressure points 
that are likely to arise in Canadian society by the year 2005 
as a result of economic, demographic and social trends”. 
Statistics Canada played a major part in the events leading 
up to the commissioning of this report and in its prepara- 
tion. The Chief Statistician was asked to chair an interde- 
partmental committee of senior officials to report on the 
current capacity for policy analysis of the government. One 
of its key recommendations was that such capacity is 
maintained in response to demand from the Cabinet and the 
clerk of the Privy Council for serious policy analysis. A 
specific follow-up action was the commissioning of the 
report from the Policy Group. The report drew extensively 
on an in-depth analysis prepared by Statistics Canada on 
important long-term trends. They reported in October, 1996 
and | will start with an outline of their conclusions. While 


the report was written from a Canadian perspective, I think 
their findings have relevance for most developed countries. 

Next, I will touch upon some trends in the political 
environment and governance that are of relevance to 
statistics. The bulk of the paper is devoted to an outline of 
what I think might be a robust strategy for statistical offices. 


2. MAJOR POLICY CHALLENGES 


2.1 Main Forces at Work 


This part of the paper is based on the report “Growth, 
Human Development, Social Cohesion” prepared by an 
interdepartmental committee for the Clerk of the Privy 
Council Office, Canada, in October, 1996. 

The Committee identified five forces at work with 
pervasive impacts on a broad range of policy domains. 


2.1.1 Globalization 


Globalization is the integration of production and distri- 
bution across national boundaries. In response to dramatic 
declines in shipping costs, customs barriers and the pheno- 
menal evolution of computer communications, multi- 
national companies and complex partnerships can operate 
as integrated entities, even though their operations span the 
globe. This enables them to exploit the relative advantages 
of each location with little loss to the traditional benefits of 
tight centralization. What is happening is not just a pheno- 
menon of increasing exports, but altogether new production 
and distribution arrangements that render national bounda- 
ries increasingly irrelevant. Globalization affects not only 
the economy but all aspects of society and culture. Indeed, 
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a major challenge will be to obtain the benefits of economic 
_ integration, while maintaining independence in other 
domains, such as social programs, culture, and the 
environment. 


2.1.2 The Information Revolution 


The speed of change of the so-called information 
revolution was well captured by The Economist (1996), “If 
cars had developed at the same pace as microprocessors 
over the past two decades, a typical car would now cost less 
than $5 and do 250,000 miles to the gallon”. This is the 
development at the heart of the globalization of economic 
production which affects the delivery of services perhaps 
even more fundamentally than that of the production of 
goods. All sectors have made massive capital investments 
in information technology, but so far — and if we trust our 
productivity measurements — society’s return on these 
investments has been limited. Nevertheless, there is 
continued hope for major future productivity improvements, 
as a result of the information revolution, with a consequent 
and sustained improvement in economic performance. 

However, technology will affect different people diffe- 
rently. So there is also a major risk that a new and pervasive 
social fault line might evolve, one which divides those with 
a mastery and access to technology from those who are ill 
equipped to do so. Technology also affects culture and 
social cohesion and it promotes the formation of interest 
groups which transcend national boundaries. Identification 
with traditional unifying entities such as nation or city have 
come increasingly under pressure. 


2.1.3 Environmental Pressures 


We are all aware of a series of environmental pressures, 
such as the threat to the ozone layer, global warming, or the 
collapse of fishing in certain traditional areas. But our 
awareness is not matched by a thorough understanding of 
either the full risks, or of the linkages between changes in 
economic or social activity and the environment. This 
makes it particularly difficult to weigh potential trade-offs 
among economic, social, and environmental objectives. 


2.1.4 Various Demographic Pressures 


Most developed countries have a birth rate that is below 
the replacement level. Combined with continued progress 
in longevity, this results in societies in which the weight of 
the aged is increasingly felt. The trend will accelerate, at 
least temporarily, when the post-war generation of baby 
boomers reaches the retirement age. 

The continued evolution of the family as the basic social 
unit poses a series of ill understood challenges. Not only 
has the role of women changed as the two-earner family 
became the norm, but different forms of family are gaining 
in prevalence (single parents, common law, same sex 
couples). The impacts of these changes are not fully under- 
stood but are certainly felt in such important policy domains 
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as poverty, labour market activity, child development, 
pension plans, and caring for the chronically ill elderly. 

Immigration has become, not only for Canada but for 
most of the OECD area, the dominant source of population 
growth. While it is generally regarded as a positive factor, 
the integration of people from a variety of cultures has 
implications for social norms, policy and collective identity. 
Illegal immigration, somewhat less of an issue in Canada, 
is a major source of current problems and a potential source 
of significant future social divisions in many developed 
countries. 

These developments, and others, have cumulative 
impacts that extend well beyond the present time. The 
evolution of a child into a happy and productive citizen, the 
development of cancer or heart disease, the availability of 
a pension at the time of retirement are examples of 
processes that extend over long years and involve complex 
interactions. The supreme policy challenge is to gain a 
better understanding of causal factors, particularly those 
amenable to modification through social programs. Much 
better information can be of immeasurable help in gaining 
the necessary understanding. 


2.1.5 Fiscal Context 


All the pressures described above, and the policy space 
available to deal with them, interact with the fiscal context, 
i.e., the balance to be struck between reducing the accu- 
mulated debt of government versus the resources to be 
made available to deal with current or emerging issues. 


2.2 Policy Challenges 


The Policy Group identified a number of specific policy 
challenges, many of them closely interwoven with the 
pressures outlined above. They grouped the challenges 
under three broad headings, of which I will touch on two: 
growth, and human development. I can only give here a 
brief indication of what they saw as areas of particular 
concern in Canada. 


Growth 


— Economic growth. The growth of real GDP per capita, 
as well as of real average family income has slowed 
considerably in the last twenty years from what it was 
in the previous decades. 


— Productivity. In spite of the wide scale introduction of 
computer technology during the last twenty-five years, 
productivity growth rates have declined in several of 
the major industrialized countries. The reasons for this 
are ill-understood, in spite of the crucial importance of 
productivity for economic growth. 


— Adjusting to the so-called knowledge-based economy. 
We are aware of a shift in the economic centre of 
gravity towards services and knowledge and techno- 
logy-intensive industries. In terms of both employabi- 
lity and income, there are considerable and still 
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increasing returns to individuals from education, and 
perhaps even more from literacy and life-long learning. 
Similar findings apply to firms that innovate and adjust. 
But, once again, we have a very inadequate under- 
standing of the relationships among such forces as 
individual skill acquisition, the business practices of 
firms, the growing shift to non-standard forms of 
employment, the use of technology, innovation, and 
productivity. 


Environmental issues. These interact with the econo- 
my, as well as with most other domains. There are 
basic questions, very poorly understood, that are 
loosely described under the heading of sustainable 
development. 


Human Development 


Imbalances in time use. The Policy Group drew 
attention to a number of what they called imbalances in 
time use. 


Less time is used working, compared to being in retire- 
ment. The ratio of one to the other has declined by a 
factor of two in thirty years as the age of entry into 
labour force continued to increase even while the age 
of retirement continued to decline. This development, 
which appears to be part of a longer term trend rather 
than a simple consequence of the business cycle, places 
substantial pressures on both public and private 
pension systems. 

The distribution of available work is getting more 
polarized: in the last twenty years the number of 
persons working both short and long hours has steadily 
increased. 

Large scale unemployment coexists with a serious 
“time crunch” experienced mostly by young working 
couples with children — with potentially important but 
ill-understood implications for the quality of care 
received by their children and their elderly parents. 


Labour market issues. There are important visible signs 
of major changes in labour markets. Unemployment in 
most industrialized countries has increased from one 
economic cycle of the post-war period to the next; 
more jobs are non-standard (part time, temporary and 
self-employed); individuals change their status more 
frequently between employment, unemployment and 
spells of education; there is a polarization of both 
earned incomes and hours worked; education and 
perhaps even more so skills are becoming increasingly 
important. While we regularly monitor these changes, 
the underlying forces involved are poorly understood. 


Transitions. Besides those transitions occurring within 
the labour market, other key changes in life are from 
home to school, school to work, childlessness to 
parenthood, and from work to retirement. We have 
very little quantified knowledge about the factors that 


ES 


result in successful transitions, or about the interaction 
of the various forces at play. 


Increased polarization of incomes and the role of the 
tax/transfer system. A significant finding is that, in 
Canada as in the United States, the polarization of 
gross family incomes has increased over the last two 
decades: those with high incomes increased their share 
in the total while those at the bottom of the income 
distribution have reduced theirs. Unlike the United 
States, in Canada this trend was fully offset by the 
progressive character of the tax/income transfer system 
— at least until now. There are important policy 
questions raised by these trends about the role of social 
safety nets, particularly in a period when a fight against 
government debt has a high priority. 


Children and youth. One of the most difficult issues 
relates to youth employment. The unemployment rate 
for young people is stubbornly high. Furthermore, this 
has persisted in the face of more youth staying in 
school longer, thus alleviating somewhat the pressure 
on the youth labour market. Even when they are 
employed, the real earnings of young workers have 
declined over the last twenty years, in contrast to that of 
their elder colleagues. Our understanding of causes and 
possible remedies is very incomplete. There are issues 
related to children that are even less well understood, 
e.g., the impacts on children of the socio-economic 
status of parents, their parenting styles, the education 
system, the teacher, the neighbourhood, the environ- 
ment, or heredity. 


Health. Prompted by government expenditure controls, 
considerable public debate is focussed on cutbacks in 
hospital and physician services. Yet, there is mounting 
evidence that the formal health care system is only one 
of the factors affecting population health, and perhaps 
it is not even the most important one. Some of the 
others are life-style, socio-economic status, the environ- 
ment. Even within the formal health care system, there 
are well documented and widely divergent practices 
(for example in the propensity to use coronary bypass 
operations or Caesarian sections), with important cost 
implications, but whose longer term impacts on health 
are poorly understood. 


Aboriginal people. A whole series of policy issues 
relate to the aboriginal population — a major issue in 
Canada. On almost any socio-economic scale they 
continue to score considerably worse than the rest of 
the population. 


Law and order. Opinion surveys show high and still 
growing public anxiety about crime. Perhaps in 
response to public anxiety, the rate of incarceration is 
growing much more rapidly than any measure of crime 
— even though there is no evidence that more 
incarceration results in less crime. 
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The list above is not exhaustive, nor does it need to be. 
I hope it suffices to indicate the broad concerns which 
dominate our public policy agenda. I believe it also demon- 
strates that, while our current statistical system largely 
succeeds in describing the phenomena of concern, more 
often than not it does not provide nearly sufficient help to 
understand them. 


3. TRENDS INGOVERNANCE 


Without any doubt the single most important role of 
statistical agencies is to assist the public policy process. 
Consequently the role that governments play, and the public 
expectations regarding such a role, have a crucial relevance 
for us. It is therefore worth reviewing briefly recent trends 
and likely developments. 

During much of the post-war period, the economic 
concerns of the governments virtually everywhere in the 
OECD area were macro-economic, and their attitude was 
interventionist. The statistical response to interventionism 
in fiscal, monetary, industrial and trade related affairs was 
to develop a comprehensive system of economic accounts 
supported by an equally comprehensive system of business 
and household surveys. 

In the social domains, the post-war years saw the esta- 
blishment of great universal programs in the fields of health 
care, access to post-secondary education, unemployment 
insurance, pensions, and so on. These programs imposed 
relatively less stringent demands on the statistical system. 
We were asked (perhaps) to measure their cost, other major 
inputs (e.g., health and education personnel), key operating 
ratios (students per teacher, population served by each 
physician), “raw” measures of output (students graduating, 
number of people discharged from hospitals), and so on. 

The situation has changed — gradually in the eighties, 
and much faster in the nineties. A number of factors were 
responsible for these changes. Slower economic growth, 
apparently ineffectual macroeconomic policies, and the cost 
of universal social programs which almost invariably 
exceeded the initial estimates, resulted in mounting deficits. 
At the same time, globalization of financial markets 
increased the pressure on governments to “deal with the 
deficit”. The issue, therefore, rose to the top of the national 
agenda, implying substantial cuts to established programs 
that necessarily lead to questions of “what works”, and “for 
whom is the program essential”. The statistical system was 
not well prepared to answer these difficult questions. 

The retrenchment of government programs is always a 
politically difficult task. It was particularly so in the midst 
of slow growth and persistently high unemployment. The 
combination exacerbated the concerns of the public — 
already cynical about the role of government and indeed 
about government itself. 

All these developments lead to a search for evidence about 
the real impacts of government programs on society and the 
economy. The interest was spearheaded by governments 
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themselves who wanted and needed information for their 
own analysis prior to making controversial decisions about 
the elimination or major modification of established public 
programs. But they also needed new and detailed 
information as objective support in public debates. Indeed, 
anew movement emerged requesting from government that 
it identify and officially adopt performance indicators with 
a focus on outcomes, as opposed to processes. The combi- 
nation of increasing intellectual rigour and limited financial 
means to initiate major new programs has actually lead to 
a view according to which it is a core function of govern- 
ments to ask the right questions, and to ensure the availabi- 
lity of information needed to answer these questions. 

These developments clearly have major implications for 
statistical offices. In the economic domain a high priority 
continues to be placed on the monitoring of macroeconomic 
developments. While maintaining their macro-economic 
interest, recent Canadian governments have been paying 
much greater attention to microeconomic considerations, 
i.e. understanding the factors that account for successful 
business outcomes and attempting to underpin macro- 
economic intervention with coherent policies designed to 
help business at the micro level. 

Daunting as this task is, the new requirements are even 
more demanding in the social domain — and for several 
reasons. First, outcomes are typically the results of long 
term effects, for example in the health and education 
domains. These cannot be traced back unambiguously to 
unique causes. At best one can hope to identify factors that 
tend to move outcomes in different directions. Furthermore, 
policy interest shifted from considerations of broad social 
impacts to the examination of impacts on particular groups 
—an intrinsically difficult task. And to make the task even 
more difficult, the weighing of policy alternatives unavoid- 
ably involves an examination of their expected future 
impacts (a form of simulation). In effect, we are asked to 
provide the rich statistical data base needed to identify the 
policy levers which, at an acceptable cost, are likely to 
result in some specified desired outcomes (Fellegi and 
Wolfson 1997). 

Even as Official statistical agencies are called upon to 
become much more policy relevant, they must do so in a 
manner that preserves both their political independence and 
reputation for professional competence. Indeed, this has 
become more important than ever before, precisely because 
of the heightened impact of official statistics, combined 
with an environment in which the government is trying to 
convince a sceptical and insecure public of the wisdom of 
its actions, making use of evidence that must be accepted as 
“objective” (Fellegi 199 1a). 


4. IMPLICATIONS FOR STATISTICAL 
OFFICES: AN OVERVIEW 


One can argue whether the Policy Group correctly 
identified the forces that are most likely to have a large 
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impact on our evolving society, and whether they correctly 
deduced the particular areas of policy which will require the 
greatest attention. I submit that this would not be particu- 
larly productive. After all, societies do not have a particu- 
larly good record of forecasting the challenges that will face 
them in a few years’ time. Nevertheless, there are some 
important implications for us that we ignore at our peril. 

Even though I would not propose the uncritical accep- 
tance of their specific list of expected policy challenges, I 
think that it is possible to identify broad domains in which 
major challenges can be anticipated (the issue of unemploy- 
ment, the evolving character of employment, productivity, 
the causes of health and illness, the role of education and 
training, efc.). After all, we are developing major statistical 
systems to illuminate a broad policy area, and not to support 
some specific policy initiative. The domains, together with 
the nature of the information that is likely to be needed, 
should give us considerable guidance regarding the 
statistical developments that are needed. 

It is clear from the work of the Policy Group that many 
of the areas that they identified are characterized by funda- 
mental gaps in understanding. Garnet Picot (Picot 1997), 
for example, analysed a variety of government measures 
designed to deal with the issue of high unemployment and 
showed that their likely effectiveness depends on which of 
several possible causes we think are primarily responsible 
for the problem. There are a number of plausible contribu- 
ting causes: low economic growth, disincentives to accept 
low paying jobs (due to the character of social transfer 
systems and unemployment insurance), high payroll taxes 
which render hiring of new employees more expensive, a 
mismatch between skills needed and available, high 
minimum wages, efc. Disentangling their relative impor- 
tance is a prerequisite of sound policy remedies. In turn, he 
describes the statistical data systems, some of them quite 
innovative, that are needed to accomplish this goal. 

I would also take as a good working assumption that the 
political environment will continue to evolve broadly along 
the lines discussed in the section on trends in governance — 
with clear implications about the general character of the 
statistical service that the country needs. 

In summary, therefore, we can foresee major challenges. 
In some instances we must improve existing data systems, 
and in others start monitoring phenomena whose priority 
has increased (e.g., the environment). I expect that the 
greatest challenge will be to devise new data systems desi- 
gned to go beyond monitoring and with an explicit orien- 
tation to shed light on the underlying dynamics. While we 
might well be able to identify the domains in which such 
information will be needed, there will be considerable 
uncertainty about the precise policy issues which we will be 
called upon to illuminate — with great insight but also with 
great objectivity. In the face of these challenges our strategy 
must be bold, but also robust — hence evolutionary. The 
three ideals that we must pursue are: relevance, adaptability, 
and objectivity. 
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These three themes will be the themes of the rest of the 
paper which will be divided into the following sections: 
prerequisites and approaches leading to essential new data 
systems required to illuminate policy domains and to inform 
public policy discussions; strategies with respect to our core 
programs and the organizational flexibility needed for their 
further evolution; and finally a section devoted to what 
might be called an “external strategy” to ensure and safe- 
guard both program relevance and non-political objectivity. 


5. IMPLICATIONS FOR STATISTICAL 
OFFICES: NEW DATA SYSTEM 


5.1 Elements of a Strategy 


It is at the heart of our challenges to try to develop the 
new types of statistical systems that are needed to inform 
public policy discussions in key fields. Policy development 
is a complex process. It involves politicians, the public, 
special interest groups, as well as researchers and policy 
analysts within and outside government. Experiences and 
views of all these groups, as well as political ideology, 
combine to arrive at policy proposals. It is essential, how- 
ever, that there should be relevant empirical and theoretical 
evidence to both nourish and to temper the views of all 
participants. What is needed is a concerted effort to try to 
understand the forces at work, to be able to anticipate with 
confidence the likely performance of alternative policy 
levers. This does not usurp the role of the political process, 
but rather helps to inform it (Fellegi and Wolfson 1997). 

We must be clear, however, that helping to understand 
economic and social phenomena, as opposed to monitoring 
their impacts, is a task that is at least one order of magni- 
tude more difficult. In this section I will outline the 
elements of a broad strategy that we have attempted to 
follow in Statistics Canada. I will then provide some 
illustrative examples of new data systems implemented at 
Statistics Canada. 


(i) Development Must be Rooted in Relevant 
Outcome Measures 


A key end objective is to help the public policy process 
to discern the relevant “policy levers” that are likely to be 
most effective in moving us toward the achievement of 
desirable social and economic objectives. It is logical, 
therefore, that the development of new data systems should 
start with an attempt to understand the key outcomes that 
policies in a given domain would like to promote. This does 
not imply either policy advocacy or a politicization of the 
statistical system: it is in the common interest that the goals 
of government be carried out on the basis of the best avail- 
able information, and that the same information be made 
equally available to others who might wish to promote 
different policies. 
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A source of major difficulty is that in many areas, 
particularly in the social domain, there are no broadly 
accepted outcome indicators. For example, while we all 
agree on the objective of wanting to improve education, 
there is no general consensus on what this should involve 
and how progress should be assessed. Do we want the 
outcome of a good education system to be people who are 
successful in the labour market, who are well rounded 
individuals, who have acquired the skills to continue to 
educate themselves in an adaptive mode, who embrace the 
values of good citizenship, or some combination of the 
above? Difficult though these questions are, they are clearly 
essential to the development of a truly relevant and useful 
system of education statistics. 


(ii) Connecting Outcomes and Policies is a Major 
Objective 


High quality and operationally measurable outcome 
indicators represent the first step in developing useful data 
systems. They are fundamental to monitoring progress 
toward objectives, telling us whether or not improvements 
can be detected. But good outcome indicators alone are 
insufficient since, at least in democracies, society’s ultimate 
objectives seldom lend themselves to direct intervention: 
e.g. Sustained employment cannot be generated directly, nor 
can the health of the population be improved by any direct 
measures. Truly useful statistical systems must therefore 
allow observers and analysts to discern the relationship 
between outcomes and public policy interventions: the 
so-called policy levers. 

We cannot assume that the traditional policy levers are 
necessarily the most important ones. For example, there is 
growing recognition that class size or pupil-teacher ratios 
do not have a particularly large influence on student out- 
comes. Similarly, health may have as much to do with 
family income as with the medical interventions of the 
health care system. The implication is that policy relevant 
data systems should be based on broad views of the relevant 
causal factors, and the ways they relate to each other — in 
other words, they should be based on a conceptual 
framework. 


(iii) Conceptual Frameworks are Prerequisites 


There is no widely shared agreement about what consti- 
tutes an adequate conceptual framework for a statistical 
system. A conceptual framework is not, in and of itself, a 
theory. It is, rather, a carefully constructed reflection of our 
present understanding of the forces at work which have a 
potentially significant impact on our selected outcome 
indicators. I believe that one of its essential features has to 
be the attempt to reflect, at least schematically, the forces at 
work within a given domain, including their interactions 
and the direction of their effects. 

A useful conceptual framework is neither abstract, nor 
static. It gains both its empirical and adaptive usefulness 
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from being dynamically coupled to a measurement system. 
On the one hand, conceptual frameworks should guide the 
evolution of those data systems which quantify the inter- 
actions displayed by the framework. On the other hand, data 
systems should have a profound influence on the evolving 
conceptual framework: they should lead to the elimination 
of insignificant or irrelevant relationships (for example, of 
ideological dogma!), and to the further elaboration of those 
that are most important. Furthermore, data analysis might 
bring to light altogether new relationships and insights and 
in due course may lead to a revision of the framework. 


(iv) Partnerships are a Necessary Condition for 
Progress 


The type of statistical evolution outlined here represents 
a very ambitious undertaking. The effort is justified by the 
overwhelming need to improve our understanding of the 
forces at work underlying the most pressing and vexing 
social and economic problems. This is clearly a necessary 
condition for more effective policies and programs. The 
cost, while not negligible, is dwarfed by the cost of govern- 
ment programs designed to deal with ill-understood 
problems. 

The major effort that is required cannot succeed without 
an intensive tripartite collaboration involving the sectoral 
policy department concerned, the statistical office, and the 
social science community. The policy department’s support 
must take at least three forms: moral support, direct 
financial support (or alternatively, support for the financial 
requirements of the statistical office), and effective colla- 
boration in exploiting existing models and data systems in 
the course of analysing existing government programs and 
policy options. 

The participation of the social science community is 
fundamental to ensuring that prevailing theories are brought 
to bear, helping to design the instruments for shedding light 
on the relevant phenomena, testing and modifying theories. 
Their analytic work should play a critical role in high- 
lighting missing statistical information needed to test 
existing theories. At the same time, social science benefits 
from availability of quantitative information which can be 
used to sort out idle speculation from empirically validated 
hypotheses. 

Of course, the role of statistical offices in such tripartite 
collaboration is highly significant. They must take the lead 
in convincing decision makers of the critical importance for 
them — the decision makers — of launching the long term 
developmental process that the provision of the right 
information at the right time requires. They must also take 
the lead, with help from policy analysts and social 
scientists, in identifying and, if funding can be secured, 
implementing the needed data systems. In our experience, 
these systems tend increasingly to be longitudinal surveys 
or administrative systems in domains such as health, 
education, and labour market and income. Longitudinal 
data, to a much greater extent than cross-sectional, can 
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associate outcomes with a range of possible causal variables 
—a prerequisite for the identification of causal links. 

It is fundamental that the required extensive collabo- 
ration occur and that it be productive. The leadership drive 
to start the process may come from anywhere — including, 
I should emphasize, official statisticians as well. We do not 
need to wait for others to come to us for our help. On the 
contrary, we should have a well developed analytic program 
on the basis of which we are able to articulate not only what 
are the data gaps, but also what are the areas of public 
policy where so-called “evidence based decision making” 
is not possible because of missing conceptual frameworks 
and supporting data systems. 

Statistics Canada, in collaboration with our government 
and academic partners, did take a number of significant 
initiatives to develop data systems designed to lead to 
significantly improved understanding in several important 
public policy domains. In a subsequent part of the paper I 
shall briefly describe a few examples. 


(v) Practical and Useful Approaches are Sectoral 


In spite of the increasing recognition of the inter- 
relatedness of social and economic phenomena, there are 
both substantive and practical reasons for preferring the 
development of new data systems along either sectoral or 
functional lines. There are separate ministries and other 
organizations dealing with policies in the fields of human 
resources and labour markets, trade, industry, welfare, 
health, education, justice, efc. Data systems can only 
become policy relevant if there is a constituency for the 
information, one whose function is to consider the impli- 
cations of the findings. But beyond this “mundane” consi- 
deration, it is almost always the case that outcome measures 
are formulated as sectoral (The word “sector” is used here 
to connote a domain which is the subject of particular 
government policies and programs: health, education, 
labour markets, macroeconomic policies, and so on. Typi- 
cally, a government department is assigned either sole 
responsibility or at least a lead role in respect to policies 
and programs in that sector.) objectives: to reduce 
unemployment, improve population health, improve the 
effectiveness of the education system, and so on. If the data 
systems are to shed light on our performance, they must 
specifically be developed to improve our understanding of 
the given sector (Fellegi and Wolfson 1997). 

We know that there are important interactions among the 
sectors: for example, both income and education are known 
to affect health, while also health affects education. But 
these effects can be accommodated within the sectoral 
models as exogenous variables. 


5.2 Examples of New Data Systems in Statistics 
Canada 


Statistics Canada 1s engaged in the development of new 
data systems in a number of dornains, broadly in line with 
the areas of policy challenge identified by the Policy Group. 


TS 


A common characteristic of these initiatives is the goal to 
illuminate a given policy domain, i.e., to identify the main 
forces at work and to measure their relative importance. 
Where a broadly shared understanding exists about what 
these forces are, the main task consists of quantifying their 
respective strengths in affecting the outcomes of interest. 
This is the case, for example in the area of income and 
labour market dynamics. In other instances a major initial 
effort is needed to outline a conceptual framework which is 
subsequently fleshed out with data and modified through 
use. This is the case with health, and science and techno- 
logy. In the case of education and child development we 
could only identify what we, in collaboration with our 
partners, thought is a reasonably comprehensive list of all 
possible forces (but without the complex interactions 
among them). In this case we decided to start with a very 
comprehensive survey, hoping to elaborate a more complete 
conceptual framework through the analysis of the resulting 
data. 

Most of these initiatives take the form of longitudinal 
surveys. This is not surprising since cross-sectional surveys 
can monitor phenomena, but only longitudinal surveys are 
capable of linking outcomes to their correlates — an 
essential prerequisite for the analysis of the relative 
importance of alternative “policy levers” and other 
(exogenous) variables. 


(i) Labour, Income and Family Dynamics 


In the socioeconomic domain the single dominant 
problem facing most of the G7 countries is the persistence 
of high unemployment, the attendant poverty, and the 
possibility of a semi-permanent underclass (those caught in 
the “poverty trap”). More generally, the issue is the relation- 
ship between income, labour market participation, and 
personal as well as family circumstances. There are a 
number of important questions: under what circumstances 
do poor families manage to escape poverty? What personal 
characteristics and what government programs appear to 
help single parents to cope successfully? Under what 
conditions do unemployed youth, particularly those without 
post-secondary education, manage to break out of the 
vicious cycle of “jobs require experience but experience can 
only be acquired on the job”? What factors account for 
successful and unsuccessful transitions from school to 
work, from job to unemployment, from work to retirement? 

In Canada we have started an on-going program to shed 
light on this complex of issues. It is based on a sample of 
families, each of whose members will be tracked for at least 
six years as they move through various labour market and 
income experiences, as some members move out of the 
original family and perhaps form new families, and so on. 
Key characteristics of the program are its longitudinal 
dimension and the explicit objective of trying to link causes 
and effects; the close collaboration in its development 
between Statistics Canada, the main policy department, and 
the academic community in the conception of the survey 
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and its analysis; and the explicit objective of maintaining a 
capacity for the further evolution of the survey. It was felt 
that, in this domain the existing literature had already 
identified the main forces at work, and what was needed 
were suitably organized data on how these forces play out 
themselves in Canada. 

The survey includes core questions on incomes, labour 
market experiences, and family characteristics, but there is 
also room for supplementary questions to explore new 
hypotheses that the analysis of the data might suggest. 


(ii) The Interaction of Business Performance and 
Employee Outcomes 


There is increasing suspicion that productivity outcomes 
can only be studied at the micro-economic level and that a 
number of business practices may be ultimately related to 
output per unit of labour. For example, at what rate and 
with what effects is information technology used in the 
workplace? Does the effective use of technology imply a 
higher investment in skills upgrading? Do employees with 
lower level skills risk becoming “disposable”? Is the use of 
flexible labour market practices (increasing use of contrac- 
ting out and of temporary or contingent workers) a 
significant contributor to business success? 

We have carried out a pilot to establish the feasibility of 
an on-going longitudinal survey of business establishments, 
including a subsample of their employees who would be 
tracked for at least one extra year after their employment 
with the selected business comes to an end. 

The survey we expect to take would provide information 
on the extent of use of new technologies, on training 
available to employees, business strategies pursued (e.g. the 
extent and role of R&D; the emphasis on new products; 
expansion into new geographic markets; collaboration with 
other firms in R&D, in production, or in marketing; efc.), 
labour market strategies (e.g., downsizing, re-engineering, 
greater reliance on part-time or temporary workers, 
increased use of overtime in place of new hiring), degree of 
market competition, change in the occupational composi- 
tion of employment. The information collected in this 
fashion will be related to “objective” business performance 
indicators such as value of production, sales, exports, 
profits, efc. It will also relate the firm’s behaviour to 
impacts on employees: their training and the acquisition of 
new Skills; the relationship between the use of technologies 
and wages; training and other worker outcomes; and the 
relationship of all these factors to employment stability. 


(iii) Survey of Children 


We have an incomplete understanding of education and 
child development, even more so than of the dynamics of 
incomes and employment. What are the key influences that 
lead to the development of productive and happy members 
of society? My third example involves a very ambitious 
longitudinal survey of children, initially of 0 to 11 years of 
age, which attempts to shed light on this rather basic 
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question. Because of clear indications from existing 
research that causal factors in this domain operate over very 
long time periods, the objective is to follow the same 
sample of children well into young adulthood — up to 20 
years. However, the survey is arranged to provide important 
analytical and policy-relevant results on a continuing basis. 
We are collecting a wide range of possibly relevant expla- 
natory variables related to them: mother’s health during 
pregnancy, socioeconomic conditions of the family, 
parenting styles (the nature of parent-child interactions and 
stimulation), early signs of emotional or learning problems, 
socialization (relations with peers and potential friends), 
scholastic tests, teacher’s assessment of the child, and the 
principal’s assessment of the school. 

In this case we did not have a fully developed conceptual 
framework to guide our survey development. However, 
working in the closest possible collaboration with relevant 
researchers and academic staff, we could identify a long list 
of variables which could have a material impact on child 
development. This resulted in the exceptionally wide range 
of variables that are included in the survey. Rather than 
starting with a fully developed conceptual framework, we 
plan to approach its refinement through analysis of the 
survey data. Indeed, we have arranged a wide range of 
contracts and other forms of collaboration to ensure a full 
exploitation of the data base. 

As in the case of the previous examples, the survey can 
be adapted from one round to the next to reflect our 
gradually improving understanding, or simply to collect 
some additional information in a cost effective manner. 


(iv) Population Health 


Most G7 countries spend on health 7 to 10 per cent of 
their GDP. Health is also a policy area that is consistently 
near the top of the list of greatest concerns to Canadians. 
Yet, here again, the substantive policy challenges far out- 
strip our ability to provide information that would support 
“evidence-based decision making” regarding the deter- 
minants of population health and the long term impact of 
health interventions. Our third longitudinal survey is 
designed to gain some insights in this domain. 

The survey follows a sample of individuals for a period 
of years yet to be determined. It contains a core set of 
questions, including those on health status, disability, health 
care utilization, health problems, family situation, and 
labour market participation or other major activity. In 
addition each survey also contains a series of questions that 
delve into a specific topic for that cycle only (the initial 
cycle focussed on mental health). There is also an arrange- 
ment for linking respondent records with provincial records 
of health care administration in order to incorporate into the 
data base the encounters of sample persons with the formal 
health care system. 

Prior to the development of the survey we did invest 
considerable effort to develop an explicit conceptual 
framework to guide us. As in the other examples, the design 
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of the survey instrument and the supplementary inquiries 
incorporated into each round have been developed in close 
and continuing collaboration with the main federal and 
provincial stakeholders of the health field, as well as with 
a broadly representative group of advisors. 


(v) Science and Technology 


The need to understand the impact on society of science 
and technology has risen high in our policy agenda. Much 
has been written about the importance of adequately inves- 
ting in science and technology — but much of it is unsub- 
stantiated. Is it true that there is a close link between a 
country’s investment in science and technology and its rate 
of economic growth? What are the impacts on employ- 
ment? On the physical environment? On social cohesion? 
What is the relative contribution of different sectors of 
society (government, university, business, etc.) to the gene- 
ration of knowledge and what are the results? What can we 
say about the storage of knowledge (both informally, in 
people’s heads, and in formally accessible devices such as 
books, diskettes, etc.)? How is it used, with what effects? 
How is knowledge generation financed? 

In order to attempt an answer to these questions we are 
proceeding along several tracks. With the help of an 
external advisory committee, we began to develop a con- 
ceptual framework. As this framework is defined, we are 
reviewing existing information to assess which parts of the 
framework it supports and where are the important data 
gaps. At the same time, we are trying to understand the 
main policy questions which ought to be answered. This 
will allow us to outline a multi-year program of information 
development in order to improve our understanding of key 
questions affecting our economy and our social organi- 
zation. And even while the conceptual work is proceeding, 
we are beginning to collect relevant information that will 
clearly be needed: on innovation, on the adoption of 
advanced technologies, and on knowledge flows to business 
from universities. 


(vi) Productivity 


My final example deals with the issue of productivity. 
Collectively, we are investing heavily in the new techno- 
logy embodied in computers and related telecommunica- 
tions and software. The September 28, 1996 issue of The 
Economist estimates this combined investment at 12% of 
total capital stock, the same as the level of investment in 
railways at the peak of the railway age in the 19th century. 
Normally, when heavy investments are made in a new 
technology, one expects significant productivity returns. 
Yet in most G7 countries there is a decline in the measured 
rate of productivity growth during the last twenty years 
compared to the previous twenty. The Economist calls this 
finding “a statistical black hole”. 

Many believe that, to the extent there is a measurement 
problem, it has to do with the measurement of the output of 
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several high growth service industries: banking, tele- 
communications, consulting, and so on. The problem in 
these sectors is that it is hard enough to define the unit of 
output, let alone the quality improvements to which these 
outputs are subject at an increasing rate. 

This area also provides an example of effective interna- 
tional collaboration. Statistical offices of several countries 
decided to work together, drawing on the relative strengths 
of each. In fact, their representatives agreed to develop a 
conceptual framework and corresponding “model surveys” 
for particular service industries, often in collaboration with 
leading businesses in their respective countries. These 
model surveys have been piloted in other volunteer 
countries and experiences compared. Not only are improved 
measurement techniques developed in this manner, but as 
a byproduct international comparability of data is also 
achieved. 


6. IMPLICATIONS FOR STATISTICAL 
OFFICES: ADAPTABILITY AS 
KEY STRATEGY 


6.1 The Core Program 


Even while new policy domains gain prominence, most 
of the problems of the postwar years continue to be rele- 
vant. Undoubtedly, we shall continue to collect data on 
economic growth, inflation, employment and unemploy- 
ment, the evolution of incomes, education levels, health, 
etc. — phenomena whose monitoring remains intrinsically 
important even if our level of understanding of how to 
improve our performance in each of these domains is 
relatively limited. We do not stop taking the temperature of 
the patient just because we do not fully understand the 
reason for the fever, or how to cure it. For example, we may 
not have succeeded in understanding how to cure unem- 
ployment, society learned to make a variety of accommo- 
dations to it. Some of these involve adjustments of indivi- 
dual behaviour. Others are more programmatic and try to 
alleviate its worst effects (e.g., unemployment insurance), 
or try to bring about improvements (e.g., labour market 
training programs). We may adjust the patient’s diet, try to 
bring down the temperature to avoid secondary compli- 
cations, and so on. 

While our core function will certainly continue, we can 
expect important challenges — both old and new. 

First, the challenge of finding the right mix between 
preserving continuity and adapting our concepts to 
changing reality will continue to be with us. Here, as in so 
many other places, international collaboration is needed and 
productive. Indeed, in the face of conceptual difficulties we 
can speed up progress by pooling our respective strengths. 
Furthermore, where the conceptual underpinnings are weak, 
international practice and convention confers a degree of 
legitimacy. International standards are all the more 
important since an increasing proportion of our clients 
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operate in a global context and want information on the 
basis of which valid comparisons can be made of the 
performance of different countries in different domains. 

Second, this being our core program, it is where the bulk 
of our expenditures are spent, and where we must look for 
efficiencies. And we will certainly need to find savings 
since we are inevitably called upon to contribute to the 
funding of new statistical initiatives. In my experience, 
necessary conditions to obtain new government funding are 
to be seen as efficient in carrying out our core program, and 
to be able to show that we have identified and eliminated 
programs of lower priority. But to do so we must have an 
effective planning system (Fellegi 1992). 

The third challenge with respect to our core activities is 
to improve our dissemination program, particularly as it 
affects the needs of the general public, most of whom 
receive their statistical information via the media. We have 
to do much better in informing them about findings, as 
opposed to releasing data. Emphasizing findings as opposed 
to releasing data has an enormous impact on how the public 
perceives our relevance (Fellegi 1991b). 


6.2 Ad hoc Survey Capacity 


The need to conduct special surveys arises when a client 
requires some information which cannot be met from the 
regularly funded program of the statistical agency. The 
capacity to respond to ad hoc requests, provided they are 
accompanied by the required funds, represents an important 
form of flexibility/adaptability of the statistical system. The 
requirement may take a number of forms, but I will restrict 
my attention to surveys or pilot surveys. As I indicated in 
(Fellegi 1996), there are compelling reasons to maintain a 
strong capacity for client funded surveys. 

Special surveys result in new information being placed 
in the public domain, often in new areas. Charging for the 
development of ad hoc information provides a type of 
market test: if a contracting department is willing to spend 
significant funds from its own budget, then the resulting 
information is likely to be relevant to serious policy 
concerns. Since all official statistics, irrespective of the 
source of funding, should always be available to the general 
public, the external funding of policy relevant information 
is clearly in the public interest (While a strong capacity to 
respond to the ad hoc requirements of client departments is 
important and unambiguously beneficial, there are strong 
reasons of both statistical policy and efficiency to prefer 
that the regular statistical needs of clients be met from the 
regular budget of the statistical office.). 

Additional benefits of having a capacity for client funded 
surveys include the following: 


—  client-sponsored surveys are safety valves for demand 
which cannot be satisfied within the budget constraints 
of the statistical office. The flexibility to respond, 
therefore, has a major impact on client satisfaction with 
the statistical system; 
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— special client-sponsored surveys typically relate to new 


areas and hence involve innovation. As such they 
contribute importantly to the maintenance of an 
environment that is open to new ideas. Indeed, some of 
our cost recovered surveys are pilot surveys designed 
to test new approaches prior to seeking regular funding 
for them; 


— to the extent that charges include full costs, including 


overhead, they contribute to the maintenance of an 
operational capacity; 


— Statistics Canada has established two divisions, both 


capable of rapid expansion whose budget derives 
entirely from client-sponsored surveys. The staff work 
very closely with major client departments and have 
learned to “market” not only their operational capacity, 
but also their ideas. These divisions necessarily evolve 
a culture of client orientation whose benefits are far 
reaching. 


How to create and maintain a special surveys capacity? 
After all, to a limited extent every statistical office is able to 
carry out one-time work by mobilizing the needed 
resources. However, I think that we need to go well beyond 
that. We need to create an organizational culture that 
welcomes, indeed seeks out such work — otherwise it risks 
becoming an extra chore accepted grudgingly. The 
principal means used by Statistics Canada to achieve this 
broader objective were: 


the creation of the two divisions mentioned above, 
which operate respectively, in the households/social 
domain and in business statistics. Both entities have to 
“earn their keep” through contract work; 


— a marketing orientation for the entire organization, 
including explicit revenue targets; 


— a personnel and financial management environment 
that encourages the deployment of people for specific 
tasks and specific periods; 


— astrong set of central operational capacities which are 
capable of expanding and contracting on the margin, 
according to need. I will return to the issue of opera- 
tional capacity later. 


While we strongly encourage client-sponsored survey 
work, some ground rules are enforced: 


— noclient-sponsored work is carried out on a privileged 


basis, i.e., with results that are kept private; 


— Statistics Canada maintains full professional control, 
subject only to having to meet the substantive needs of 
the client. Professional control includes questionnaire 
content and design, sample design, the collection 
operation, and processing. It also reserves the right to 
use the resulting information in its own analytic 
publications; 
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— Statistics Canada will not carry out surveys in certain 
fields which are incompatible with its mandate. 


— These include political polling, as well as questions 
which the public might regard as offensive; 


— Finally, Statistics Canada is not in competition with the 
private sector: it is engaged in large scale surveys with 
high quality requirements which the agency is in a 
better position to carry out cost-effectively and for 
which the agency’s stamp of professionalism and 
legitimacy is important. 


6.3 Elements of Professional and Operational 
Capacity 


Maintaining a strong professional and operational capa- 
city iS a prerequisite of adaptability. It is particularly 
important to safeguard it consciously during periods of 
budget reduction because infrastructure represents a temp- 
ting target whose weakening has no immediately visible 
impact on outputs. Research, analysis, and a methodology 
capacity are particularly vulnerable. 

A strong professional and analytic capacity is parti- 
cularly necessary for being able to recover from adversity. 
Indeed, without it we may start a downward spiral of both 
credibility and resources. We will need our professional 
staff to develop programs as and when the opportunity 
presents itself. In addition, they may be able to create 
informed demand through analytic work which highlights 
the relevance of statistical information and, whenever 
appropriate, identifies important gaps in the empirical base 
needed to support significant conclusions. The analytic 
capacity of professional staff is also needed for the develop- 
ment or refinement of the conceptual frameworks. In turn, 
as discussed earlier, such frameworks are prerequisites for 
the development of relevant new data systems. 

Methodology is part of the essential professional capa- 
city of the agency. Our reputation depends on the solidity of 
our Statistical methodology. It might be argued that in times 
of budget constraints we do not need to have a strong 
survey design capacity since we are not very likely to 
launch many new surveys. Yet we have found that impro- 
ving scientific method can be an important contributor to 
overall efficiency. This can come about through better 
survey design and through the development of generalized 
measurement and processing tools. While it can be 
destroyed in months, it takes years or even decades to build 
a strong methodological capacity. 

Much the same can be said about the mix of tools and 
competencies that add up to operational capacity. A well 
maintained and classified register of businesses; the core 
supervisory staff of operational entities around which we 
can build up or reduce operational staff, according to need; 
the full range of skills needed to maintain a flexible, 
demand driven informatics capacity; and so on. 

It is not enough to simply “preserve” each of these 
capacity areas. Each must prepare itself for the future by 
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adapting its processes to handle new technology, new 
methodology or changing respondent attitudes. 

Beyond any of the particular elements of operational and 
professional flexibility, what is needed is particular atten- 
tion to preserving a spirit of research and innovation at all 
times. No statistical agency can survive for long without it. 
Simply carrying on with the same programme, perhaps 
periodically reduced in response to budget cuts, is a recipe 
for eventual irrelevance. Yet innovation is particularly diffi- 
cult to maintain in periods of budget stringency when expe- 
rimentation has to compete for funds needed to preserve 
important existing outputs. It therefore requires particular 
attention. In Statistics Canada we have a planning system 
(Fellegi 1992) which facilitates this process. Good year or 
bad, we set aside 2-3 per cent of our budget to support new 
initiatives. Such a reallocation helps to maintain the 
intellectual curiosity and ferment that is so characteristic of 
healthy organizations. A portion of the reallocated funds are 
used to support pilot surveys and small scale tests which 
can be used to demonstrate to key client departments how 
new information could help them anticipate, decide, and 
monitor policies and programs. 

An element of organizational flexibility relates to 
making multiple exploitations of data as easy as possible. 
To describe fully the elements of a strategy would take us 
too far from the theme of the present paper (Fellegi 199 1a). 
Here I would only emphasize the need for three broad 
approaches. First, we need to create and maintain a single 
electronic window on all publicly available (i.e., non- 
confidential) national statistics. This should be the infra- 
structure supporting all dissemination, from publications to 
Internet access. Second, behind a publicly available data 
base of aggregate statistics, we should create and maintain 
an internal micro data base that encompasses all survey 
holdings, is fully accessible to all internal staff, and which 
is well documented. Finally, I would favour all measures 
designed to place micro data in the public domain — of 
course, subject to confidentiality. Given the skewness of 
most of the relevant distributions, we have not found a way 
to release micro data from most economic surveys. But, 
after suitable treatment, we release most household and 
social surveys in this form. This facilitates their use by 
external researchers, including those in policy departments, 
as inputs to policy models. 

As mentioned before, a major determinant of organiza- 
tional flexibility is a planning system (Fellegi 1992). In turn, 
planning must be supported by a detailed project based cost 
accounting system. These two systems are indispensable to 
our ability to review regularly the cost structure of our 
products, to assess the current priority of each product, and to 
estimate the cost of adding or eliminating particular activi- 
ties. It would have been exceedingly difficult to manage 
effectively our response to the last fifteen years of regular 
budget cuts, punctuated twice by a major injection of funds, 
without the facility to assess regularly both the substantive 
and cost implications of modifying our product line. 
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Perhaps the single most important determinant of 
organizational flexibility is its human resource strategy 
(Statistics Canada 1997). Planning decisions invariably 
imply the reallocation of resources, and people invariably 
represent the largest single component of project expendi- 
ture. We lose the effectiveness of our planning system if we 
cannot successfully and easily redeploy them according to 
need. Statistics Canada, like most other statistical agencies, 
used to be characterized by narrow vertical career paths: if 
you started work in health, education, labour or manu- 
facturing statistics, it was highly probable that you also 
ended it in those same fields. 

About ten years ago we realized that, for a number of 
reasons, we simply could not afford to continue along the 
same path. 


— We could not afford the rigid allocation of resources 
that this implied. On the contrary, it was imperative that 
we should be able to adjust our programmes in line 
with client needs and with the available budget, but 
without the extra concern of having to redeploy people 
possessing non-transferable skills. 


— The regular reduction of budgets substantially reduced 
the opportunity for advancement, so we had to find an 
alternative way of maintaining interest and motivation. 
We found that, for most people, the opportunity and 
active challenge of new assignments worked well. 


— In spite a long series of budget reductions, we wanted 
the agency to have a degre of robustness enabling it to 
respond to new challenges. This could only be achie- 
ved by acquiring a well trained and flexible staff for 
which accepting new assignments is a way of life. 
During the last several years we have developed and 
implemented a thoroughly integrated training program. 
We also tripled our training expenditure: from about 
1% of total budget to 3%. 


Indeed, our organizational robustness is currently subjec- 
ted to a major test. We have received a substantial injection 
of new funds to carry out a major expansion of our econo- 
mic statistics program. The total new funds represent 10 per 
cent of our total budget but involve as much as doubling the 
staff in a few divisions. Furthermore, the new statistics are 
needed for the administration of a high profile government 
program and, as usual, needed urgently. We simply could 
not have mobilized the required staff in the short time that 
was available to us without the preceding ten years of staff 
rotation and large scale training program. 


7. IMPLICATIONS FOR STATISTICAL 
SYSTEMS: ELEMENTS OF 
AN EXTERNAL STRATEGY 


Just as important as the internal preparedness to meet the 
challenges ahead, statistical agencies need an “external 
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strategy” as well. Of course, the two sets of strategies 
interact closely and must be in harmony. 

The external strategy should have at least three pillars. 
The first one, which is so well understood that I will not 
discuss it here, involves our “core values”: maintaining the 
scientific integrity of the statistical system; safeguarding the 
confidentiality of identifiable statistical returns; respecting 
society's privacy norms; and minimizing reporting burden 
(particularly on small business) through the exploitation of 
administrative records, sampling, and other statistical 
techniques. 

The other two pillars of the external strategy are 
relevance and political independence. There is the potential 
for conflict between these two basic objectives: the closer 
the statistical system is to the policy process, the higher its 
potential for relevance — or so it is argued; but such close- 
ness can result in diminished political objectivity, or at least 
the perception of it. The best solution of this potential 
conflict depends on national circumstances. 


7.1 Achieving a High Level of Relevance 


Abstract goals like relevance are achieved through 
reliance on particular mechanisms. The following are the 
ones that are most important for Statistics Canada. 


(i) Close and Productive Interaction with the 
Highest Levels of the Bureaucracy 


I do not subscribe to the theory that official statistics 
should aim to satisfy only the needs of the national govern- 
ment, or even those of all levels of government. But I do 
believe that our priority should be to provide an information 
base for public policy. The open provision of objective 
information about public policy issues is of benefit not only 
to the government, but also to the opposition, to interest 
groups, indeed to the entire public. It is therefore very 
important to be well connected with the makers of govern- 
ment policy at the highest level in order to obtain the 
earliest possible indication of evolving concerns and future 
government priorities. 

The close and productive interaction that is needed does 
not occur by itself. It evolves over time in response to 
organizational arrangements and personal initiatives. For 
example, in Canada the Chief Statistician is a full member 
of the deputy minister (Permanent Secretary) community 
and participates in their regular weekly meetings, in 
periodic retreats designed to “brainstorm” the implications 
of government priorities, in numerous working groups 
formed to explore specific issues in depth. Membership in 
the “club” of deputy ministers opens opportunities to make 
issue oriented presentations based on statistical information, 
or to draw attention to important new insights as and when 
they are released. The primary objective is to ensure that the 
policy development process takes full advantage of insights 
that can be derived from statistical information. A not 
negligible secondary objective is to generate an awareness, 
at the highest level of the bureaucracy, that statistical 
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information is essential for the policy process and that its 
usefulness is enhanced, not diminished, by its non-political 
objectivity. 

While there is no substitute to the high level interaction, 
it is not sufficient. It is essential that, in addition, there 
should be a web of bilateral interactions (Fellegi 1996) with 
all major policy departments, as well as those who are 
guardians of significant administrative record systems of 
potential statistical interest — such as the customs and 
taxation authorities. 


(ii) Analytic Activities 


A strong internal analytic program contributes to an 
improved understanding of the needs of external analysts — 
in or out of government. Such an understanding is needed 
to identify priority data gaps, /.e., information which, if it 
were available, would make a signal contribution to the 
understanding of key public policy issues. Such insights are 
prerequisites of broad support for new initiatives. 

Good analysts have a strong personal motivation to 
explore issues and, more often than not, their explorations 
result in either data development or in the identification of 
important gaps. Either way, they will champion the cause of 
further improvement of information or of a more fruitful 
conceptual framework. 


(iii) A Wide Network of “Listening Posts” 


Priority setting is, in the final analysis, subjective. It is all 
the more important that our assessment be based on broad 
and balanced information, secured through a variety of 
formal and informal consultation. Given Canada’s federal 
structure, we have close consultative mechanisms with the 
provinces in all fields in which they are interested. External 
expert opinion is received from over a dozen advisory 
committees, each devoted to a specific subject. Additional 
views from the business community are sought through 
marketing efforts by our account executives appointed to 
work with major clients. Active liaison is maintained by 
major business organizations and with representatives of 
the small business sector. At the apex of consultative 
mechanisms stands the National Statistics Council — a blue 
ribbon committee of advisors. 


(iv) Partnerships with the Academic Community 


The academic community, through its analytic activities, 
can highlight significant insights derived from statistical 
data bases. It can also be a partner in building conceptual 
frameworks; call attention to the need for new information 
products, review plans for new surveys, serve on advisory 
committees, review analytic products, and so on. As with all 
other partnerships, keeping it productive involves some 
effort. We work with them closely to ensure that we can 
meet their particular needs for access to statistical data 
bases, we provide opportunities for some of them to spend 
sabbatical time with us, we co-author papers with them, 
participate with them in organizing and supporting 
scientific conferences, and so on. 
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Collaboration, over time, can make the academic 
community very highly knowledgeable about the statistical 
system. In turn, this enables them to be more effective in 
calling attention to emerging issues and trends. Some 
academics become natural contacts for the media on issues 
dealing with their specialization and it is usually helpful to 
Statistics Canada when they comment on significant new 
data or analytic releases. 


(v) Media Relations 


Relevance is determined not only by the potential useful- 
ness of the information produced by a statistical agency, but 
also by the extent to which the information results in a 
better understanding of issues. The media have a very 
influential role to play because it is through their reporting 
that most people, including many of our elected representa- 
tives, acquire statistical information. So frequent and 
informative media reporting of statistical information is in 
the public interest. It is also in the particular interest of the 
Statistical office since frequent and objective media 
references to its products have a positive cumulative impact 
on the public’s appreciation of the agency. 

The single most consequential aspect of media relations 
is to ensure that each statistical release is accompanied by 
a highly readable analytic summary of what significant new 
findings and insights it reached. Other measures involving 
the media might include: free access to all agency releases; 
the identification in all releases of a competent spokes- 
person; being proactive in calling attention to errors or data 
problems; responding in writing to erroneous or misleading 
articles; availability of senior staff for media interviews; 
provision of local area detail in releases where this would 
likely enhance coverage by regional media. 


7.2 The Issue of Political Objectivity and its 
Perception 


Public confidence matters because the value of statistics 
to society directly depends on confidence in their producers. 
Since few users can actually replicate official statistics, 
their readiness to use them is ultimately a reflection of their 
confidence in the professional integrity of statisticians and 
their ability to carry out their function free of harmful 
political interference (Fellegi 1991a). The fundamental 
importance of objectivity has become even more pervasive 
because of public skepticism about the political process, 
and the increasing substitution of “objective” statistics for 
judgement as a means of distributing a diminishing amount 
of government funds. 

I will single out for attention three basic issues and will 
leave aside such specific and useful techniques as pre- 
announced release dates for all major series, external review 
committees, and so on. 


(i) Institutional Arrangements 


I have discussed elsewhere (Fellegi 1996) the general 
arguments for and against a centralized statistical system. 
However, there is no doubt that centralization makes it 
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easier to maintain political independence. First of all, the 
protection of this independence is a prime responsibility of 
the head of the agency. The higher his or her standing in the 
bureaucracy, the more effectively this function can be 
carried out. This does not primarily derive from power as 
such, but rather from the fact that public visibility makes an 
implied threat of resignation of far greater consequence. 
Since it almost inevitably results in higher standing for the 
head of the statistical agency, centralization is preferable 
from the perspective of political objectivity. 

Another basic structural issue relates to the formal 
character of the relationship between the political process 
and the statistical system. Here, I believe, there is a poten- 
tially explicit trade-off between considerations related to 
relevance versus political objectivity. On the one hand, this 
paper argued strongly that the status of the chief statistician 
as a deputy minister (7.e., head of a government department) 
is of extraordinary importance in maintaining close and 
productive relationships with other departments — which, in 
turn, are key determinants of long run relevance. However, 
a deputy minister reports to a minister. In the Westminster 
model of government it is the minister who is responsible to 
Parliament, not the public servant. 

A reporting relationship to a minister can certainly lead 
to political interference. An alternative arrangement that 
also preserves the advantages of centralization involves the 
statistical office becoming explicitly an agent of Parliament, 
such as the national bank and government audit organiza- 
tion are in many countries. Such an arrangement represents 
the most secure way of isolating the statistical office from 
political independence, but raises the risk of increased 
isolation from the machinery of government, and hence of 
reduced relevance. 

In the case of Statistics Canada, the ministers responsible 
for the agency have always had a senior portfolio which 
was their primary policy responsibility. They maintain an 
arm’s length relationship to Statistics Canada on all issues 
of statistical policy and programs: all questions about 
technical issues and program priorities are either referred to 
the Chief Statistician or are answered with reference to the 
Chief Statistician. This tradition is reinforced and kept alive 
by the senior public service and the Privy Council Office 
(the department directly supporting the Prime Minister) 
who have a clear understanding of the public policy 
importance of having a credible statistical agency. 

Everyone is also well aware that by now there is such a 
strong employee tradition of political independence in 
Statistics Canada that the media would find out about any 
improper attempt to interfere. 

Given such favourable circumstances, the regular depart- 
mental status of a statistical office confers only advantages. 
But one might well come to different conclusions in other 
circumstances, particularly if the most senior levels of the 
career public service could not be counted on for their 
strong support of the political independence of the 
statistical system. 
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(ii) Budget Control 


Budget control is a basic aspect of non-political 
independence. If the government could target specific 
statistical programs through the budget process, this could 
certainly provide an opportunity to target politically 
embarrassing statistical programs. And even the possibility 
of such an event could influence behaviour — on both sides. 

Statistics Canada experienced repeated budget cuts 
during the past 12-15 years. However, the agency was 
allowed both professional and managerial freedom to 
implement the reductions. Of course, this meant that we had 
to be prepared to defend our choices. In fact, our manage- 
ment of the process gained us considerable professional and 
managerial credibility contributing to our subsequent 
success in obtaining additional funding for some major new 
initiatives. 

Is there a contradiction between budget control and 
seeking funds for specific initiatives? Not necessarily. The 
funding was for new activities that we identified, in 
partnership with others, as having top priority. Furthermore, 
once received, the funds became part of our regular budget. 
While we are obviously honour bound to use it for the 
advertised new programs, this is neither a formal require- 
ment nor is it in perpetuity. 


(iii) The Role of Substantive Analysis 


An objective and even-handed flow of analytic output 
contributes significantly to the image of professionalism 
and political independence that are so essential for 
statistical offices. Perhaps more than anything else, this 
helps to differentiate their public image from that of “the 
government”. 

Analytic output by Statistics Canada takes a variety of 
forms, the most visible being what we call our “flagship 
publications”. These provide monthly or quarterly high 
profile reviews of the economy, of labour market and 
income analyses, of the analysis of trends in both health and 
education, and so on. In addition to publishing a wide range 
of analytic reports, we have an explicit policy that all our 
statistical releases must be accompanied by a summary of 
highlights calling attention to significant economic and 
social developments. 

Both objectivity and relevance are important. Objectivity 
involves exploring all sides of an issue, avoiding policy 
advocacy, stating assumptions, highlighting major findings 
whether or not these reflect well on the government. 
Relevance relates to the choice of topics: they should deal 
with issues of clear importance — even though some of them 
might be controversial. Like our other publications, analytic 
studies must feature readable highlights and they are very 
widely quoted by the media. 

While a regular and visible flow of analytic output can 
make a very positive contribution to our image, such a 
program must be particularly well managed. The output 
must be subject to peer review so as to verify the scientific 
validity of the analytic approach. But it must also be subject 
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to what we call an “institutional review’, to ensure that the 
analysis is neutral, that it explores issues in an even-handed 
manner, and that it does not transgress the fine line 
separating analysis from advocacy. 


7.3 International Collaboration 


The last element of the external strategy that I want to 
touch upon is the need to participate in international work. 
I believe that the international arena is not an optional 
luxury. It takes at least the following three forms. 


(i) The Traditional International Functions 


Under this category falls the work well recognized by 
our profession for over 150 years: 


efforts to harmonize concepts and classifications, mutual 
professional stimulation, and learning from each other. In 
respect of harmonization, while always important, the need 
has already increased dramatically and will continue to do 
so. The requirement arises from a number of sources: 
transnational corporations, international negotiators, inter- 
national organizations who set fees and distribute benefits, 
researchers for whom international comparisons serve as 
natural benchmarks, and the general public which already 
has unprecedented ease of access to national data on the 
Internet. 


(ii) Pooling Intellectual Efforts 


While the category above encompassed collaboration, it 
related either to traditional professional interactions, or to 
work that could only be carried out by and under the aegis 
of international organizations (such as the development of 
international classifications and standards). In recent years, 
stimulated by the persistent conceptual complexity of 
certain problems (such as the measuring the outputs of the 
service industries sector), we formed a variety of informal 
but structured working groups which meet with some 
regularity and where the national “membership fee” is the 
contribution of conceptual/developmental work carried out 
between meetings. Many of these fora turned out to be 
productive. 


(iii) Transnational Dimensions 


There is a third category of international work whose 
dimensions are still fuzzy, but the need for which is clearly 
discernible. It relates to the looming problem of tracking the 
economic contributions and transactions of transnational 
enterprises. No national statistical office can take a proper 
account of their functioning since they truly operate in a 
borderless mode. Consider a manufacturer in Canada 
which, as part of a transnational car enterprise, produces 
brakes and exports them world wide for use by the same 
enterprise. This Canadian manufacturer would report export 
earnings, value added, profits, inventory, capital stock, and 
so on, all according to the book keeping conventions of the 
enterprise. In turn, these may well change over time in 
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response to their assessment of the benefits they can derive 
from differences in national tax laws. 

Furthermore, however complicated the problem of 
tracking might be in respect of goods, it is substantially 
more so with respect to services, many of which can cross 
international borders electronically, and go undetected. It is 
evident that any progress regarding this issue of increasing 
importance can only be made through the collaboration of 
national statistical offices in ways and through fora that are 
yet to be articulated. 


8. CONCLUSION 


As the millennium is drawing to a close, it is quite 
fashionable to try to peer into the future: identify emerging 
trends and provide erudite analyses of their consequences. 
My experience with similar exercises triggered by other 
excuses has not been favourable: in retrospect the most 
important trends turn out to have been different from those 
that were anticipated. High profile examples of mis- 
diagnoses abound. One of my favourites is the famous 
statement made by Lincoln Steffens, the American 
journalist, when he returned from a visit to the Soviet Union 
in 1919: “I have seen the future; it works...” 

Even when we correctly anticipate, our constraints in 
responding to them are typically quite different from what 
we might have expected. As a result, I chose to base my 
analysis on the scenario identified by a group of senior 
Canadian policy analysts, and so avoided putting forward 
my own favourites as to what the key policy challenges of 
the foreseeable future might be. 

I could have tried to create my own futuristic scenarios, 
e.g., about the impacts of involving computer-communi- 
cations and their impacts on society and the statistical 
office; I could have speculated about the withering away of 
nation states — or indeed the opposite (both perspectives 
were espoused in a recent 75th anniversary issue of Foreign 
Affairs, by no lesser authorities than Arthur Schlesinger, 
Peter Drucker, and Anne-Marie Slaughter (Foreign Affairs 
1997); I could have tried to discern trends about whether 
the recent retrenchment of the role of governments is a 
secular event or only the currently discernible movement of 
a giant pendulum. I chose to avoid all of that. I funda- 
mentally believe that it is not only possible but essential to 
pursue a robust strategy that does not depend intimately on 
our futurology, and I tried to outline the internal and the 
external elements of such a strategy. 

The main feature of the internal capacity is the develop- 
ment and maintenance, even in the face of budget cuts, of 
a strong professional and operational capacity capable of 
adapting to its environment. I outlined what I already per- 
ceive as major adaptations needed in a number of specific 
domains of major relevance to public policy. Most of these 
involve both conceptual and data issues, and J argue that 
these two issues must be addressed in parallel, in an 
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iterative manner, typically by starting with some conceptual 
frameworks and then fleshing out and refining them 
through new data systems. 

The key aspects of the external strategy are there to 
ensure that we have excellent receptors to pick up and filter 
the signals from our environment; that we place extremely 
high priority on the various approaches that we need to 
pursue in order to stay relevant (which means, among other 
considerations, trying to go beyond our traditional role of 
monitoring by striving to illuminate issues, including the 
role of “policy levers’); that we serve our society well — all 
major groups, and in a manner that is suited to their needs, 
not our convenience; and last but not least, by doing all that 
is necessary to preserve and strengthen our non-political 
and professional independence. 
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Cumulating/Combining Population Surveys 
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ABSTRACT 


Designs for and operations both of multipopulation surveys and of periodic surveys have become more common and 
important. The needed large resources, both financial and technical, have been organized only in recent decades, and the 
great values of both became recognized. For both types of designs the developments have concentrated on comparisons 
between surveys. Yet the coordination and harmonization needed for comparisons also makes the combinations of the 
survey statistics possible, desirable, and practiced. But the combinations of surveys have been achieved and presented 
largely without a theoretical/methodological framework, and often poorly. Here such a framework is attempted. Some 
closely related designs are also discussed: multidomain designs, rolling samples, combining experiments, and combining 


several distinct survey sites. 


KEY WORDS: Multipopulation design; Multidomain design; Periodic surveys; Rolling samples; Combining experiments. 


1. INTRODUCTION: 
MULTIPOPULATION MODELS 


A paraphrase of the standard model in all books on 
survey sampling goes roughly thus: “The aim of survey 
samples is to produce an estimate of the total Y (or the mean 
Y) for a variable Y, in a population of N elements.” Such 
statements are misleading because they fail to describe the 
actual purposes and practices of survey sampling. First, 
most surveys treat many variables, and second, survey 
results use diverse kinds of statistics; thus sample surveys 
are “multipurpose” on several dimensions (Kish 1988). But 
instead of discussing all the omissions of the standard 
model, I want in this paper to concentrate only on its insuf- 
ficiency and inadequacy because of its restriction to a 
single, finite population. Among the several examples be- 
low of multi-population expansions that are possible with 
a new and different model, I begin with two important 
examples of survey samples that achieve a variety of treat- 
ments and results on different dimensions. First is the 
emergence of multinational designs since 1965, best illus- 
trated by the World Fertility Surveys (section 3), which 
involve combinations across national spatial boundaries. 

- Second are combinations of periodic samples, best illus- 
trated by “rolling samples” (sections 4 and 5), which 
concern combinations across temporal dimensions. 

The designs and operations for periodic surveys require 
large resources and new methods. Those for multinational 
surveys are even more demanding. Both of these types of 
complex surveys are rather late arrivals among sample 
surveys and both types are growing in numbers and in 
importance. Furthermore, both types have been designed 
and used mostly for comparisons: temporal and spatial com- 
parisons, respectively. The concept of using them addition- 
ally for combinations and cumulations is new, and is often 
encountered initially with doubt and disbelief (sections 3, 
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4,5). For both types, the variations between the popula- 
tions are commonly affirmed as obstacles to combinations 
or cumulations, and thus are then used for restricting the 
sample estimates to single populations, because typically 
methods for combining them are unknown or unavailable. 
Or even when they are combined, only ad hoc methods are 
used, without justifying them. References to several papers 
indicate my concern for designs of multinational surveys 
and of rolling samples. In this paper the emphasis will be 
on combinations for multinational samples and on cumula- 
tions of periodic and rolling samples. 

You may notice that I use the terms “cumulating” and 
“combining” interchangeably and perhaps confusedly. 
“Combining” seems to fit the multipopulation and multi- 
domain situations better, whereas “cumulating” seems 
better for periodic and rolling samples. It would be better 
to have one word to cover both spatial and temporal combi- 
nations/cumulations, but neither seems to be exactly right. 
Also “combinations” serves uses other than joining popula- 
tions — the usage I wish to emphasize here. 

I am also not clear if it is better to consider the enlarge- 
ment of the scope of samples from one population to several 
as anew model or as a paradigm shift. Discussions with a 
few philosophers here left me confused about this choice. 
And my fellow statisticians probably do not care whether 
we write the word model or paradigm. In any case, a new 
model instead of the standard model of sampling from a 
fixed frame of a stable, finite population is the radical 
proposal J am pursuing in this paper. 


2. MULTIDOMAIN DESIGNS 


Statistics for national samples are commonly based on 
combinations of domains, and these are often quite diverse. 
But because these combinations are simple and familiar, 
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they can also serve as heuristic examples for the less 
familiar combinations I want to discuss, such as multi- 
national and multiperiodic statistics. The diversity of 
domains may be recognized within national sample designs; 
eé.g., provinces, which may number from 5 to 20 in most 
countries. In samples of smaller populations (cities, institu- 
tions, firms, efc.) similar partitions into major domains also 
are typical. But for smaller and more numerous domains 
(e.g., the 3,000 counties of the USA) deliberate sample 
designs are not feasible for most samples of limited size. 
For these small domains, methods of “‘small area estima- 
tion” have been developed (Kish 1987, 2.3; Platek, Rao, 
Sarndal and Singh 1987 pp. 267-271). There are great 
practical differences in both design and estimation between 
large and small domains, and it is careless to use the 
adjective “subnational” to cover both. Furthermore, these 
distinctions between large and small domains exist not only 
for national designs, but also for samples of smaller popula- 
tions also. It seems that the structured (nonrandom, grainy) 
natures of populations persist also on smaller scales. This 
conforms to the proposed new model of populations, and is 
supported with empirical analysis of multistage components 
(Kish 1961). 

Although practical for provinces, deliberate designs are 
not feasible for most domains, whether few and large or 
many and small, of the kind we call “crossclasses,” such as 
sex and age or occupation, social class, education, etc. 
These “crossclasses” are often important both for their 
relations (correlations) with the survey variables and for 
their great diversity. Thus samples of national (or other) 
populations are mosaics of domains that are diverse and 
often highly variable; and we must depend on the properties 
of large probability samples to yield reliable representations 
of them. In this sense we perceive that all population 
samples consist of combinations of subpopulations. 

Subclasses designate the representations in the entire 
sample of the domains that compose the whole population. 
Crossclasses are commonly the most common types of 
subclasses in survey analysis: partitions of the sample, for 
which deliberate selection designs are not feasible. For 
example, occupation and education classes, behavioral and 
attitudinal categories, and so on. These can be strong 
explanatory variables for survey analysis; yet we lack the 
data and resources not only for pre-stratification, but also 
even for post-stratification methods. From that extreme of 
lack of controls at one end, we can move to the other 
extreme of strong controls by separate samples, which can 
be designed for major provinces. 

For example, different methods of sampling can be used 
in the different provinces. But more common are designs 
that use different sampling rates; for example, higher 
sampling rates for small, or for especially important 
provinces. Sometimes equal sample sizes n,=n/H are 
designed for all H provinces in order to obtain (approxi- 
mately) equal precisions for all provinces, regardless of 
their sizes. This equal allocation results in sampling 
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fractions n,/N, that are inversely proportional to province 
sizes. But for fixed total sample size n the consequences 
are higher variances for the entire sample, as well as for 
crossclasses; see section 8 (Kish 1988). We assume here, 
that the statistics yp of the provinces (domains) get 
weighted with population weights W, = N,/)N,, for the 
overall statistics y,, = )’ W, y,, as is commonly practiced for 
national statistics. This serves as a useful introduction to 
the multinational statistics coming next. 


3. MULTINATIONAL SAMPLE DESIGNS 


National “representative” samples were started by Kiaer 
(1895) only in 1895 and, after much opposition, they 
became widespread only after 1945 (Kish 1995). Since 
then the efforts of the samplers were encouraged and 
supported by statistical agencies of the United Nations, 
especially the UN Statistical Office and the FAO. Their 
spread then led naturally to multinational comparisons of 
surveys; yet the deliberate design of multinational samples 
that could provide valid comparisons is recent, starting only 
around 1965 (Szalai 1972; World Fertility Surveys (WFS) 
1984; Kish 1994). The new demands for survey designs for 
multinational comparisons create many new difficulties: in 
resources — financial, institutional, cultural; and also in 
methods. Those difficulties encountered with comparisons 
reappear also in similar form for multinational combina- 
tions, our main concern in this paper. 

It is interesting to compare these difficulties with ones 
with which we are familiar in multidomain designs. From 
a theoretical perspective, combining the provinces of a 
country is similar to combining the nations of a continent. 
Indeed we should profit from those similarities by using 
metaphorical arguments from the familiar multidomain 
designs to the proposed multinational combinations. How- 
ever, from a practical view we find great differences bet- 
ween the two efforts because of five fundamental practical 
obstacles that make multinational designs much more 
difficult to achieve, discussed below. 


1. The centers of decisions reside in separate national - 
offices, both for setting policy targets and for obtaining 
funds. Further, within any nation the agencies for 
policy setting and for resource allocation may be 
distinct and separate; e.g., the Education Ministry may 
share participation in a school survey, but the 
Parliament or the Finance Ministry may fail to allocate 
funds. 


2. The needed technical resources reside in and are 
staffed and developed by separate national offices. 
These separate offices may have very different levels 
and types of technical development, as well as distinct 
organizational structures and _ different social 
connections. 
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3. The survey variables can vary immensely across 
national boundaries, due to different cultures, religions, 
economic and educational levels, legal and social rela- 
tions, etc. Achieving comparable results demands 
immense efforts — but the task is not impossible, as 
multinational surveys have shown. 


4. The crossnational translation of concepts and of ques- 
tionnaires, also of codes and analysis, are daunting 
challenges that need ingenuity, knowledge, and 
devoted effort. 


5. Separate samples must be designed and operated to 
meet distinct national conditions, with local resources, 
sampling frames, and field operations. This subject 
needs volumes; more discussion and study than is 
possible here. 


Multinational comparisons probably go back many 
years, based on diverse kinds of observations — by travel, 
wars, conquests, efc. But probability sample surveys of 
entire nations have become common over all continents 
only during the past half century. As the second phase of 
development, those national surveys soon led to multi- 
national comparisons. The third phase of deliberate multi- 
national designs dates only from 1965: the Time Use 
Surveys of 1965 (Szalai 1972); the World Fertility Surveys 
of 1972-82 (WFS 1984; Cleland and Scott 1987); the 
Demographic and Health Surveys since 1985 (DHS 1991); 
the Labour Force Surveys of the European Community 
(Verma 1992, 1999); see Kish (1994). Other multinational 
survey designs are also emerging, with the funding and 
technical resources increasingly meeting the growing 
effective demands. Iam heartened and amazed at the emer- 
gence of the International Surveys of Psychiatric Epidemio- 
logy, a field that I had feared was beyond the reach of pro- 
bability surveys in my lifetime! (Heeringa and Liu 1999). 

Now, for the new fourth phase, I propose deliberate 
designs for combinations of multinational surveys. Multi- 
national combinations of surveys are now being produced 
and published; e.g., European unemployment rates or birth 
rates; African or Sub-Saharan birth rates or death rates; 
world growth rates; and many other rates, means, and totals. 
The data for each nation may be based on probability 
samples (phase two), or even designed for multinational 
comparisons (phase three). But the methods used for 
combining them seem to be completely ad hoc; and current 
usage for the relative weights for combining national 
statistics seem to be in order of A, B, C, D, E from most 
common to the least. I made no actual counts, nor an 
empirical study, but glaring examples appear weekly. Very 
often the methods and weights for combining the national 
samples are not even mentioned in the media, even in 
respectable and scientific journals. To the contrary of the 
above order, our preferences may be almost in the reverse 
order of E, F, D, C, B, A— and very much depending on the 
situation, sample sizes, efc. 
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Allow me, with due modesty, to propose that phase five 
should be the development of solid theory for choosing 
among those preferences, and also others. But the need for 
methods for combinations cannot wait for the future better 
theory; and it is usual in statistics (and in the sciences) for 
practice and methods to develop before, and thus both to 
precede and to stimulate theory. Meanwhile, the discus- 
sions below may lead to some improvements in methods, 
even if they are not quite “optimal.” 

Here then follow six possible alternative ways and 
weights for combining national statistics. 


A. Do not combine: publish only separate national 
Statistics. This is the most common treatment for 
several reasons. 1. The authors have not thought of the 
possibility or need for combination, or rejected them. 
2. Perhaps they could not decide on the “best” method, 
and wanted to leave that to the reader, user, customer. 
This may be defended by “caveat emptor,” or 
“Bayesian” arguments. However, I reject them. The 
authors should do no worse in choosing than the 
average users — who in any case can reject the authors’ 
combination if the national statistics are also published. 
I believe that when the reader’s eye roves over the 
usual horizontal (or vertical) bars in graphs or over data 
in tables, it tends to yield a simple mean, hence this 
roving reduces Method A to Method C in effect. This 
tendency can perhaps be improved if the width of the 
bars is made proportional to population weights. 


B. Even in the absence of combining populations, designs 
for multinational comparisons should be “harmonized” 
in survey measurement methods, to allow for proper 
comparisons (Kish 1994). 


C. Use equal weights (1/H) for every country. This 
method is also common and also avoids (like A) the 
difficult questions of how to choose population weights 
W,, with A denoting country. Probably its use is 
seldom based on deep reflection, but is widespread 
mostly because it appears to be a “common sense” 
approach. Perhaps it would be justified with models, 
where the between-country variation is paramount, and 
the population sizes are not relevant. However, I have 
no faith in such models. 


D. Weight with sample sizes n,. Thus y, =) n, y,/).n,, 
which results automatically from simply cumulating 
sample cases from separate countries, or sites, or sur- 
veys. This is also done frequently, and can be justified 
when elements are drawn essentially from the “same 
population” or when per-element variance is the only 
(or prime) component of variation. It denotes “cumula- 
ting cases,” as distinguished from combining statistics 
(Kish 1987, 6.6). This approach can be extended to 
situations where there are serious differences of 
element variance due to “design effects”; and then 
“effective sample sizes” n,/deff, may be substituted 
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for the n,. The “effective sample size” may also be 
applied if the o, differ between populations in order to 
use weights with precisions n,/o, = 1/(6,,/n,). In most 
situations, however, the variations in sample sizes n, 
depend on arbitrary, haphazard factors; and C may be 
a worse choice than using equal weights 1/H for all 


countries (surveys, sites). 


E. Use population weights W,. Thus y=) N,y,/) N,, 
and W, =N,/)'N. This method has the most com- 
monly understood meaning when the N, represents 
total numbers of persons in population h. However, 
sometimes the population content may be quite differ- 
ent. For example, for grain (or wine) production it may 
be total number of farmers, or wheat (or grape) 
farmers, if those numbers are available, or can be 
estimated; these populations may yield potentially 
interesting meanings either for comparisons or for 
combinations. The population extent also needs to be 
determined; for example, all persons, or only adults, or 
only women, or only married women; only urban or 
rural, or both? Also the timing (date) of the surveys 
needs standardization, e.g., censuses are conducted in 
0 (or 9, or’ 1) years. Often the population weights are 
not persons, but acres of land, or tons of steel, or 
barrels of oil, and so on. 


F. Use post-stratification weights. Often in multipopula- 
tion situations we encounter the same problem as de- 
scribed later in section 7 for multiple sites. And we 
may consider the same hierarchy of alternative treat- 
ments, the last of which (F) is using “post-- 
stratification” weights. We may well have comparable 
surveys from several diverse countries of a continent 
(or the world), but neither all the countries, nor a 
probability sample of them. (For example, the African 
or South American countries in the World Fertility 
Surveys or the Demographic Health Surveys.) One 
may think of constructing “pseudo-strata” from which 
the available countries would be posed as “representa- 
tive selections.” Some one stratum could have only a 
single, available, large country. Another stratum could 
have 2 (or 3) countries, but with only one available 
representative that would get the weight of all 2 (or 3) 
countries. This artificial “pseudo-stratification” proce- 
dure may be preferable to simply adding up the avail- 
able countries into an artificial combination with 
W,,(E) or with 1/H(C). The rationale for this prefer- 
ence is not very different from methods of adjustments 
for nonresponses. 


Several questions and decisions remain concerning the 
choice among alternative weights. First: the choice should 
be made chiefly on substantive grounds. What must the 
combination represent mainly? My own preferences tend 
strongly toward D and E, and I deplore the prevalence of A 
and B that we encounter daily. However, I cannot support 
my preferences on technical grounds. Also I have faced 
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grave problems with the extremes posed by the giants China 
and India, each more like a continent, and neither solutions 
E or C seem adequate. I advise defying the geographer’s 
classification of Asia and leave both of them out of Asia, 
considering them as separate entities. For example, I have 
omitted all four countries greater than 200 millions in total 
population (including the USA and USSR) in my computa- 
tions in 1970 (Kish 1976, Table 4; Kish 1987, 7.3D). 

Second: Is the bias due to using incorrect weights 
important? This would be difficult to prove, as the bias is 
a function of correlations between the weights and specific 
survey variables. However, the proof should belong to the 
denial, as it does with the biases of nonresponses or of poor 
sampling methods. Ignorance of sources of bias does not 
imply their absence. I believe that using equal weights in- 
stead of population weights can often lead to important 
biases. 

Third: When samples are (roughly) equal-sized, 
weighting up to population sizes can greatly increase 
variances. These increases in variances due to unequal 
weights can be measured quite well (see section 8). They 
should be balanced against probable biases in models for 
reducing mean-square errors. In small samples the large 
variances may dominate the MSE. 

Fourth: It seems clear that the combination of population 
surveys into multipopulation statistics needs a good deal of 
research, both empirical and theoretical — and especially 
together. 


4. CUMULATING PERIODIC SURVEYS 


Periodic surveys have been designed and used mainly for 
measuring periodic changes, and also for “current” 
estimates, exploiting the advantages of partial overlaps. 
But here we shall explore their design and use for cumu- 
lated estimates. Furthermore, I include periodic surveys 
here in order to emphasize their basic similarities to surveys 
combined over space, such as multidomain and multipopu- 
lation surveys. We cannot enter here into the philosophical 
issues involved in repeated studies of the “same” popu- 
lation, except to note that the “stability” of any population 
differs greatly for diverse variables (Kish 1987, chapter 6); 
and the stability for any one variable will also differ greatly, 
depending on the length of the periods, which may be 
weekly, monthly, or quarterly. These are common and 
useful man-made periods. But there exist only two global 
“natural” cycles of variations: the diurnal and annual cycles, 
based on the earth’s rotation around its own tilted axis, and 
around the sun. 

I must note four practical, rather than theoretical, diffe- 
rences between cumulating periodic surveys and combining 
multinational or multidomain surveys. 


1. Periodic surveys are designed for the “same” popula- 
tion, which tends to retain some stability between 
periods. The “sameness” and “stability” are only 
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relative, and with many exceptions; e.g., epidemics in 
health data or fluctuations in stock prices. They differ 
greatly between variables and decrease for longer 
periods. 


2. These stabilities imply positive correlations between 
periods, encouraging designs with “overlapping” 
sampling units in order to reduce both unit costs and 
variances for estimates of change and of current values. 
These overlaps are not desirable for cumulations, so 
this conflict between the two designs must be resolved. 


3. Because similar methods and designs are feasible and 
generally preferred, they are used over all the periods; 
on the contrary, harmonization of methods is difficult 
to achieve between national samples. I emphasize here 
cumulating periodic surveys, but these aspects also 
apply to comparisons. 


4. Methods for periodic surveys for comparisons have 
been widely published, in contrast to the novelty both 
of multinational designs and of periodic cumulations. 


There now exist several cumulated representative 
samples (CRS) of national populations: samples designed 
for cumulations over large populations. These remain 
restricted within selections of primary sampling units in 
order to reduce field costs, whereas “rolling samples” 
(section 5) are spread deliberately over all sampling units in 
the population. The Health Household Interview Surveys 
(HHIS) of the USA are separate weekly samples of about 
1,000 households, cumulated yearly to 52,000 households 
(National Center for Health Statistics 1958, pp. 15-18). 
These samples are selected by the US Census Bureau 
within their large sample of PSUs. The yearly samples of 
over 150,000 persons constitute a remarkable example of 
multipurpose surveys, representing even rare diseases. The 
Australian Population Monitors have quarterly nonover- 
lapping samples that are cumulated to yearly samples, and 
these are also confined into primary sampling units 
(Australian Bureau of Statistics (ABS 1993)). The new 
Labour Force Surveys of the United Kingdom publishes 
each month the cumulation of three separate, nonover- 
lapping monthly samples (Caplan, Haworth and Steele 
1999). There are other examples as well, and the applica- 
tions of cumulative representative samples (CRS) are in- 
creasing in scope and diversity, although until now they 
have lacked a common name and literature. Nevertheless, 
I propose to differentiate the CRS from rolling samples for 
practical reasons (section 5). 

Two problems and methods associated with cumulated 
samples deserve brief mentions, but with references to more 
adequate treatments. Asymmetrical Cumulations refer to 
proposals and some actual practices of reporting large 
aggregates frequently, but reporting on small domains only 
after cumulating over longer intervals. For example, the 
HHIS above may report some national averages each week 
or monthly, but smaller regions, or specific diseases, only 
for annual aggregates (Kish 1990). 
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A serious conflict can arise if periodic samples are to be 
used (as they should) both for measuring periodic changes 
and current levels and for measuring cumulations over the 
periods. This double use has been proposed and practiced, 
although I do not yet know of any deliberate double de- 
signs. Most periodic surveys use partially overlapping 
samples with some kind of rotation design. One reason 
often given for these overlaps is the reductions in variances 
per sample element both for measuring changes between 
periods and for making current estimates. These reductions 
depend on positive correlations between the overlapping 
sampling units. Such reductions are well documented in 
sampling textbooks and articles since the original papers on 
this topic (Jessen 1942; Patterson 1954). But even greater 
reductions are possible in element costs, when the later 
interviews are much cheaper than the first contacts; for 
example, if the later contacts are by telephone. On the other 
hand, separate new samples will be much preferred for 
cumulations in order to avoid the positive correlations. One 
may imagine different compromises that may be efficient, 
when: (a) most of the positive correlations are not high; (b) 
reinterview costs are not much cheaper; and (c) reinterview 
response rates are discouraging. 

However, consider also a new design that I call a Split 
Panel Design (SPD) that adds a panel p to a parallel series 
of nonoverlapping samples a-b-c-d etc.; with the combina- 
tion then denoted as pa-pb-pc-pd etc. The panel replaces 
the overlaps of rotating designs and provides the useful 
correlations for measuring net (macro) changes. Further, it 
also serves to measure individual (gross) changes, which 
are lacking in the usual designs of overlapping sampling 
units, because of the mobility of persons and households. 
Including panels of individuals (persons, elements) would 
bring considerable advantages for SPD over all current 
overlapping samples, which usually use merely the same 
sampling units (Kish 1987, 6.5; Kish 1990). 

Another considerable advantage of SPD is that these 
overlaps would be based on the correlations from all 
periods, rather than only for the arbitrarily chosen periods 
for the rotation designs. How arbitrary are these? Some 
decisions use one-month groups, some three months, others 
12 months, efc., etc. It is most unlikely that these disparate 
overlaps are actually “optimal” for those countries. It 
seems most likely that the “optimal” overlap cannot be 
predetermined for any single variable, and a single optimal 
period is even less likely for multipurpose designs. 


5. ROLLING SAMPLES AND CENSUSES 


These should be considered as special types of the 
related cumulative representative samples (CRS); but rol- 
ling samples (RS) should be distinguished, because they are 
designed for different and specific functions. CRS have 
been confined to designs of PSUs. They are spatially re- 
stricted for cost reasons and for fitting the designs of labor 
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force surveys, and other surveys associated with them. 
However, RS designs must aim at a much greater spread in 
order to facilitate maximal spatial range for cumulations 
over time. Rolling samples must be designed specifically 
to readily yield good estimates for all small spatial units, 
when the periodic samples are cumulated into annual or 
decennial larger samples or censuses. 

First let us define a rolling census: it consists of a com- 
bined (joint) design of F separate (nonoverlapping) periodic 
samples, each a probability sample with fraction f = 1/F of 
the entire population, and so designed that the cumulation 
of the F periods yields a detailed census of the whole 
population with f’ = F/F = 1. Intermediate cumulations of 
k<F periods should yield rolling samples with f’ = k/F and 
with details intermediate between 1 and F periods. 

Imagine a weekly national sample, each designed with 
epsem selection rates of f= 1/520. The cumulations of 52 
such weekly samples would yield an annual sample of 
52/520=10 percent. Then ten of these annual samples 
would yield a census of 520/520. I have proposed in 
several papers to have these rolling samples replace both 
kinds of the most important forms of official statistics that 
are either used or planned in many countries: the monthly 
surveys of population and labor force and the decennial 
censuses. Even more important, these surveys could also 
provide annual detailed data, perhaps with 10 percent 
samples, which are badly lacking, and needed in many 
countries (Kish 1990, 1997, 1998). Providing spatially 
detailed annual statistics for a variety of economic and 
social variables, not a mere population count of persons, 
would be the chief aim of rolling samples in many coun- 
tries. These are needed even in countries that can provide 
fairly good estimates of population counts and a few simple 
statistics either from registers or with estimation methods. 
In countries without good frequent (monthly or quarterly) 
surveys of labor force and population, rolling samples could 
also serve them as efficient vehicles. 

I must admit that the above basic ideas provide merely 
the skeleton for any actual national design for rolling sam- 
ples. But such actual national samples have been recently 
designed — the largest and best of which is the American 
Community Survey (ACS) — now undergoing a 37-area 
pilot study by the US Census Bureau (Alexander 1999). 
This aims to provide monthly surveys of 250,000 house- 
holds and detailed annual statistics based on 3,000,000 
households, after year 2003; and also to provide quinquen- 
nial and decennial census samples later. The National 
Statistical Office of France is working on plans for a 
Census Continué (Isnard 1999). The Labour Force Surveys 
of the United Kingdom are now based on cumulated 
monthly surveys. Some other countries are examining 
different but generally similar possibilities. 

It is also proper to add references to two early publica- 
tions describing “rolling samples” of large sizes, although 
not national in scope (Mooney 1956; Kish et al. 1961). 
Others probably exist that I have not seen. 
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How to cumulate periodic surveys? This topic must 
receive serious technical consideration in the future, 
because so far they have been done only with ad hoc proce- 
dures. Perhaps for cumulating over a single year, epsem 
samples with the same sampling fraction f, and simple 
cumulation of cases may serve as a simple model: averaging 
over seasonal and random variations may outweigh secular 
trends. However, averaging annual statistics over 10 years 
may have to consider secular trends in population size. 


Consider several alternative sets of weights W, to be 
assigned to yearly means y, for a decennial mean y, = 
Y W,y, @ = 0,1,2,...,9) and ) W, = 1. 


a) Y,,=JY9, With W,=1 and the other nine W,=0, 
utilizing only the final year. This could be used for 
national and large domain estimates, and for highly 
fluctuating variables (unemployment, epidemics, stock 
prices), where the need for timeliness dominates 
sampling precision. 


b) y,=) W,y, with all ten W,=0.1. For variables 
without time trends, and for small domains, obtaining 
a stable average over time may be good strategy. 


c) y=) W.y, with W, <W,<W,<...<W,, monotoni- 
cally increasing (or nondecreasing) W,. The curve of 
increase may be determined with a model or with 
empirical data. Thus y,, and y,, may be viewed as two 
extremes of y,.. They all seem better than the present 
practice of giving full weight W, = 1 to a decennial 
census that may be from | to 10 years old and obsolete. 


Furthermore, with rolling censuses, the statistical office 
need not wait to publish only decennially. It can publish 
annually the results of the latest rolling samples, with 
several available alternatives from those above: either the 
latest year y,,; or y,, an average that favors the latest years. 
Or “asymmetrical cumulations” favoring y,, for smaller 
domains, but y,, for larger domains and totals. It could 
conceivably publish both y, and y,, and let the reader 
choose (perhaps publish electronically). Clearly technical 
research will be needed to search for “optimal” solutions to 
support the applications already appearing. 


6. COMBINING EXPERIMENTS 


A) This topic has been the subject of three early and good 
papers by Cochran and has also received attention from 
both Yates and Fisher at Rothamsted (Cochran 1937 
and 1954; Yates and Cochran 1938). These dealt with 
experiments relating crop yields (predictands) to fertil- 
izers (one or more predictors), conducted over different 
populations, fields, and years. They used ANOVA 
methods for statistical analyses and for combining the 
several independent experiments. 
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B) Fisher’s test for combined probabilities, from 2x2 
Chi-square tests of the “same” null hypothesis is even 
older. It can use entirely different populations, and 
even diverse variables, for testing the “same” null 
hypothesis. This well-known test can be found in most 
statistics textbooks. 


C) Methods of meta analysis are newer, and increasingly 
used. They combine experimental results from dif- 
ferent samples and populations for the same predictand 
(outcome) variable from one or more predictors 
(inputs). (Glass 1976, Hodges and Olkin 1985.) 


Methods for combining sample surveys are just 
emerging, much later than methods for combining experi- 
ments. The two fields, however, have many similar aims, 
which should be noticed, in order to see useful relations 
between the two distinct topics. Perhaps these relations can 
be best perceived by looking at the differences between the 
aims and the problems that have been the subjects of the 
two methods. There seem to be three main differences 
between the two methods, as they have been applied. 


1. Combining surveys (CS) needs a great deal of advance 
preparation, planning, and coordination. This is true of 
multinational surveys for both the comparisons, which 
have been already achieved, and for their combina- 
tions, which are new. For national multidomain sur- 
veys the coordination comes naturally, but for multi- 
national surveys the coordination of the separate 
national designs is difficult, but necessary (Kish 1994). 
On the contrary, a great virtue of combined experi- 
ments (CX) is that they can be performed on the reports 
of experiments already performed, as the name meta 
analysis signifies. That analysis is based on the rela- 
tions of the predictand/predictor pair of experimental 
variables. The Fisher test needs only the probabilities P, 
achieved by the tests of significance. 


2. The second difference between the two methods is 
related to the first. The CX are based on experiments, 
whereas CS concentrates on surveys. Thus CX empha- 
sizes experimental control through randomization of 
variables over subjects. However, CS are based on 
probability sampling with randomized selections of 
subjects — not variables — from defined populations. 
Usually these two kinds of randomizations are difficult 
to achieve in any research study and one must be sacri- 
ficed (Kish 1987, 1.1). The population base of CS is 
specified, whereas those for CX usually are not and 
cannot be. 


3. Third, CS involves a full statistical analysis, and even 
a full survey method, designed for similarity and 
comparability in order to facilitate the joint analysis. 
On the contrary, the methods of CX can use the very 
end of the statistical analyses, often even from pub- 
lished statistics. The extreme of this kind of abstrac- 
tion is shown by the combined Fisher test, based only 
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on the terminal P, values of the separate statistical 
tests. 


Because of the large, consistent and interrelated differ- 
ences between Combined Experiments and Combined 
Surveys, it may be best to keep the two methods separate. 
Some may propose that the gap between the two subjects is 
only an historical accident and that the gap can be closed 
sometimes. But I believe that it is more useful to maintain 
the separation of the two methods, even if sometimes a 
compromise may be usefully adopted. 

That still leaves open the question whether the three 
methods of combined experiments (A, B, and C above) 
should be called “Combined Experiments,” as Cochran, 
Yates and Fisher called them since the 1930s or if it is 
better to distinguish them all as “Meta-Analysis,” now a 
widely known and accepted joint designation. Happily we 
need not decide here, but perhaps meta-analysis is the best, 
provided we also recognize the earlier successes. 


7. COMBINING SEPARATE SITES 


Suppose that similar data have been collected in several 
sites of a combined population, but not in all of the sites, 
nor in a probability selection of them. The sites may be 
cities, provinces, or districts of one country. Or they may 
be institutions, such as schools, or hospitals, or factories. 
Or the sites may even be entire countries of a continent. I 
have seen a variety of such situations when the sites are 
either chosen arbitrarily, or are simply “volunteers.” Often 
the sample sizes per site are similar, though the population 
sizes of the sites vary greatly. Here follows a list of 
possible alternative treatments of the data. 


A. Separate survey estimates y, may be presented only. 
Usually this is all that is done, especially if the data 
have not been coordinated, or “harmonized.” Any 
comparisons and any combinations of the separate 
statistics are left to the readers, to use their own 
methods or resources. 


B. Comparisons between the separate sites require har- 
monization (of variables, measurements, timing, popu- 
lations) to render the differences (y, - y;) meaningful. 


C. Simple cumulations y, = )) y,/)\n, of all sample cases 
amount to assuming that the populations N, of the sites 
can be considered parts of the same population of ) N, 
elements. Note that the sample means y, are weighted 
by the sample sizes n,. Often these are nearly equal 
and then C approaches D. 


D. Equal combination )’ y,/k of k sites weight each of the 
sites equally, disregarding both the sample sizes n, and 
the population sizes N,. 


E. Weighted combinations y,, = LW, yfd W, weight the 
sites with some measure of their relative importance. 
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Population sizes N, seem reasonable, but others may 
be used. However, we may object to the combination 
of an arbitrarily selected set of sites. 


F.  Post-stratification weights W,« cpa N,, can save 
attempts to overcome the above objections by con- 
structing pseudostrata )’. Nij> composed of “similar” 
sites, from which the unit NV, may be considered a valid 
selection. Thus the total sample then is considered a 
sample from the larger population of total size 
»; »;Nj;- Such model building resembles the attempts 
to reduce nonresponse bias with nonresponse classes. 


Three sets of decisions must be made, and this order is 
chronological in activity, but not necessarily in planning. 
a) The allocation of sample sizes, especially whether equal 
sizes for the sites, or proportional to relative population 
sizes (W,). b) Whether the samples should be combined, or 
to merely accept alternative a). c) What weighting to use 
among alternatives b) to f). 

The above alternatives resemble those in section 3 and 
multinational combinations may be viewed as special cases 
of multi-site combinations, but a very special case, for the 
reasons given there. Furthermore, the alternatives listed 
above deal not with academic or idle speculation, but with 
many practical, actual problems. I have advised and argued 
on problems of every kind, and felt the need for and lack of 
dependable references on combinations and cumulations, 
whether technical and published or oral and authoritative. 
Some examples I have encountered: 


a) The World Fertility Surveys had national sample sizes 
without much (any) relation to population sizes. 
Should they be combined and how? I thought yes and 
with N.(E). 


b) Samples of several hundred households were selected 
in each of 12 large cities of the USA (which had “racial 
riots” in 1968). Should they be combined and how? I 
thought yes and with N.(E). 


c) In each of 13 counties of the USA samples of a few 
hundred 4-year-old children were selected for a study 
of preprimary learning situations. They were combined 
with method F. 


d) In 11 of China’s 30 provinces probability samples 
averaging 1,000 4-year-old children were selected for 
studies of preprimary learning situations. They were 
combined with method F. 


e) In 5 of Nigeria’s 30 states small urban and rural 
samples were selected for studies of preprimary 
learning situations of 4 year olds. After examining the 5 x 2 
small samples the sample cases were merged with 
Method C into urban and rural samples. 


f) Coordinated survey designs and university resources 
are being planned for 5 to 8 large cities of China. The 
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designs are planned both for comparisons and for 
combination, with either Method E or F. 


8. ERRORS, LOSSES, COMPROMISES 


The Mean Square Error of a weighted combination of 
means may be written as 


MSE ( W, 3) 
= Bias” () W,y,) + Var()) Wy,) 
5 De W EO) F Al Ss (> Ww; D; S; In,). 


This holds for distinct countries (i) and distinct domains 
like provinces. But for some domains there may also exist 
covariances (S.), positive or negative. The relative 
weights are W,, and Se and n, are element variances and 
sizes, with design effects D; * to compensate for the effects 
of complex designs. On any study all these values can 
differ greatly between variables. Note that the bias of the 
combined mean is the weighted average of the individual 
biases. For periodic samples these may be fairly constant. 
For multipopulation and multidomain samples this empha- 
sizes the need for reducing biases for the larger units, with 
large W,. The variances of means decrease in proportion 
to the number of units being averaged, and thus they 
decrease in importance relative to the biases. 
The situation is different for comparisons, where 


MSE(x - y) 
=Bias* (x -y) + Var@ - y) 
=[E(x -y )-(X -Y)P + Var(x) + Var(y) 
=[{ E@)-X } -(E@)-X }P +D, 87/n, +D) S2In,. 


Note that the biases of differences tend to vanish if the 
biases are similar, even when not small. The variance is the 
sum of two variances (and a small n, or n, can increase it), 
hence may dominate the bias term. When there are over- 


laps (in periodic surveys) the covariance term 
-2Cov (x,y )= -2D,,S,,n,/n,n, tends to decrease the 
variance. 


I have emphasized in some detail elsewhere the need for 
the utmost “harmonization,” for the coordination of survey 
methods: in variables, measurements, and in populations. 
On the other hand, there is great freedom to choose 
different sampling methods for the different populations, 
provided they are all based on good probability samples 
(Kish 1994), 

In multipopulation combinations, frequent and serious 
conflicts arise, because the relative sizes W, of the popula- 
tions (of countries or of provinces) often vary greatly; 
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ranges of 1 to 50 or more are common. But the sample 
sizes may be (roughly) equal for all H populations. Then 
weights k, may be introduced to adjust the combinations to 
the W;. These inequalities of sampling rates increase the 
variances of combinations by a relative factor 1 + L = 1 + 
ess : where L denotes relative loss (increase in variances) 
and Cc the coefficient of variation among the weights k,. 

Both are zero when all k, are the same, i.e., for proportional 
allocation of the n, to the W,. But then the average vari- 
ance of the populations and their comparisons suffer even 
greater losses than the sum. This conflict can be resolved 


with compromises, especially an “optimal” compromise 
with n <fcw? + 1/H*) (Kish 1976, Kish 1994). 

A good numerical example comes from the 10 provinces 
of Canada, whose total population (in 1991) of 27, 211,000 
with an epsem selection of f= 1:2721 would yield roughly 
these 10 values of n, in row 1 for a total of n = 10,000. 
You see that the largest province of 3,706 cases is about 75 
times greater than the smallest with 49. This range seems 
common for provinces within most countries. Also for 
multipopulation cases; e.g., in the European Union, 
Germany is about 200 times the size of Luxembourg. The 
proportions are W, = n,/ 10,000; and a proportional sample 
would yield an optimal value for )) W,y, of A y; In, 
hence a relative loss function 1 +L = 1 with loss L = 0. 
For simplicity and to concentrate, on weights, we can 
assume that element variances D; Se and costs c, are 
similar, or can be averaged out. However, these pro- 
portional n, values would result for average provincial 
means )’ y,/10 or for average comparisons of provincial 
values (y;- y,) Of Pea) We BO785S vior fa 
relative loss of 2.9785, a 300% increase in average vari- 
ances. These losses come mostly from the 6 small 
provinces (Derivations in Kish 1976). 


Row! 3,706 2,534 1,206 935 401 363 331 266 209 49 


Row 2 2,437 1,730 995 869 684 676 669 657 648 636 


Thus, some people (in Canada and in other countries too) 
ask for equal size samples, n,= 1,000, so that each 
province can provide the same precision. Then the means 
Y.y,/1,000 will all have variances )\ (1/1,000) and relative 
efficiency of 1+L=1, with loss L=0. However, the 
national mean will have a variance of } We /1,000, with a 
relative loss of 1 + ce =HYW, = 2.3003, or a 130% 
increase in variance. Eve must also remember that all 
crossclasses, such as those by age, education, occupation, 
etc., Will also tend to suffer similar losses. 

However, some remarkably good compromises can be 
had, and the best is a least-square solution with the 
n,«/(W, +H). These give the 1+L values of 
1 +L =1.2424 and 1+L=1.2630, for } W,y, and Yy,/H, 
respectively, only a 25% loss for each! The n, values in 
Row 2 show a “floor” between 600 and 700 for the n, for 
the 6 small provinces, and a roughly proportionate increase 
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(but below 10,000 W,) for the largest 4 provinces. This 
optimal allocation has in fact been used for some of the 
surveys of Statistics Canada (Tambay and Catlin 1995). It 
is interesting that the mathematical solution also makes 
good common sense (Kish 1976, 7.6, Kish 1987, 7.3, Kish 
1988). However, the mere common senses solutions of 
allocations proportional to WW; are less efficient than the 
optimal allocation. 
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Managing Data Quality in a Statistical Agency 


GORDON BRACKSTONE! 


ABSTRACT 


Confidence in the quality of the information it produces is a survival issue for a statistical agency. If its information 
becomes suspect, the credibility of the agency is called into question and its reputation as an independent, objective source 
of trustworthy information is undermined. Therefore attention to quality is a central preoccupation for the management of 
a National Statistical Office. But quality is not an easily defined concept, and has become an over-used term in recent years. 
Quality is defined here to embrace those aspects of statistical outputs that reflect their fitness for use by clients. We identify 
six dimensions of quality: relevance, accuracy, timeliness, accessibility, interpretability, and coherence. For each dimension 
of quality, we consider what processes must be in place to manage it and how performance can be assessed. Finally, we 
try to integrate conclusions across the six dimensions of quality to identify the corporate systems necessary to provide a 
comprehensive approach to managing quality in a National Statistical Office. 


KEY WORDS: Quality; Official Statistics; Relevance; Accuracy; Timeliness. 


1. INTRODUCTION 


Confidence in the quality of the information it produces is 
a survival issue for a statistical agency. If its information 
becomes suspect, the credibility of the agency is called into 
question and its reputation as an independent, objective 
source of trustworthy information is undermined. With this 
comes the risk that public policy debates become arguments 
about who has the right set of numbers rather than 
discussions of the pros and cons of alternative policy options. 

Therefore attention to quality is a central preoccupation 
for the management of a National Statistical Office (we will 
use the abbreviation NSO to refer to a generic government 
statistical agency that may go under different names in 
different countries). Current recognition of the importance 
of quality to NSO management is reflected in several recent 
events in the realm of official statistics. For example, 
Quality Work and Quality Assurance within Statistics was 
chosen as the theme for the May 1998 meeting of the heads 
of NSO’s in the European Community (EUROSTAT 
1998); several principles stressing the importance of rele- 
vance, professionalism and openness were included among 
the ten Fundamental Principles of Official Statistics 
approved by the U.N. (United Nations 1994); Performance 
Indicators (which includes quality as a critical dimension of 
performance) was chosen as the subject for substantive 
discussion at the 1999 Conference of European Statisticians 
(UNECE 1999). This journal through its 25 year history has 
carried many articles addressing quality issues and it is 
appropriate that in this anniversary issue we address the 
topic of quality management in statistical agencies. 

But quality is not an easily defined concept, so the first 
issue is what do we mean exactly by quality in this context. 
Quality has become an over-used term during the past two 
decades. The Total Quality Management (TQM) movement 
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and other management frameworks have broadened the 
concept of quality beyond the traditional statistician’s 
concepts of data quality as defined, for example, by the 
mean square error of an estimator. So our first challenge is 
to circumscribe the concept of quality as it relates to the 
work of a NSO. That is the object of section 2 of this paper 
in which we will suggest six dimensions of quality about 
which NSO’s need to be concerned. In the subsequent six 
sections we address each of these dimensions in turn, and 
consider for each: what exactly needs to be managed, what 
approaches might be used for managing it, and how might 
we measure performance in managing it. 

In section 9 we will attempt to integrate some of the 
conclusions across the six dimensions of quality, and to 
identify the agency-wide systems necessary to provide a 
corporate approach to the management of quality. In the 
final section we suggest some areas requiring further 
attention in order to manage quality more effectively. 


2. DEFINITION OF DATA QUALITY 


The difficulty for statisticians in defining quality as it 
applies to statistical information is that they thought that 
was something they had already done. Their whole training 
is concerned with optimizing the quality of statistical esti- 
mates, the fit of statistical models, or the quality of 
decision-making in the face of uncertainty. Using concepts 
such as standard error, bias, goodness of fit, and error in 
hypothesis testing, they have built up methodology for 
estimation and analysis in which the quality of data, as 
defined in a certain precise sense, plays a central role. 

But the term quality has come to take on a broader 
meaning in the management of organizations. The TQM 
movement and other management philosophies have 
focused on the fitness of final products and services for 
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users, have emphasized the need to build quality into the 
production and delivery processes of the organization, and 
have stressed the importance of employee involvement in 
process redesign and commitment to improvement of the 
final product or service. Statistical methods play an 
important role in these management approaches, but they 
are part of a larger picture. A question to consider is how 
this broader notion of quality applies to an organization 
engaged in the production and delivery of statistical infor- 
mation. The definition and management of quality in 
government statistics were discussed in several papers 
presented at the 1995 International Conference on Survey 
Measurement and Process Quality (Lyberg, Biemer, 
Collins, de Leeuw, Dippo, Schwarz and Trewin 1997, 
de Leeuw and Collins 1997, Dippo 1997, Morganstein and 
Marker 1997, Colledge and March 1997) and more recently 
in Collins and Sykes (1999). For an earlier approach see 
Hansen, Hurwitz and Pritzker (1967). 

If we accept that the needs of clients or users should be 
the primary factor in defining the activities, and assessing 
the success, of a NSO, we can define the concept of quality 
as embracing those aspects of the statistical outputs of a 
NSO that reflect their fitness for use by clients. But, since a 
NSO has many and varied clients, and each may make a 
variety of uses of statistical information, this does not 
provide an operational definition. However, it does allow a 
more systematic consideration of the most important dimen- 
sions of this broader concept of quality, a concept which 
clearly extends beyond the statistician’s traditional preoccu- 
pation with accuracy, the aspect of quality which most easily 
lends itself to rigorous mathematical development. 

The first aspect is whether the NSO is producing 
information on the right topics, and utilizing the appropriate 
concepts for measurement within these topics. Does it have 
information relevant to topical policy issues or is it still 
counting buggy whips? Does it utilize a definition of family 
that is pertinent to today’s society? Does its classification of 
occupations reflect the current labour market? These are 
examples of questions about the relevance of statistical 
information. 

Given that the NSO is measuring relevant topics using 
appropriate concepts, is it measuring them with sufficient 
accuracy? Exact measurement is often prohibitively expen- 
sive, and sometimes impossible, so the issue is whether an 
acceptable “margin of error” has been achieved. This is the 
traditional domain of statisticians with their concepts of 
standard error, bias, confidence intervals, and so on. We 
will refer to this dimension of quality as accuracy. 

The next two dimensions of quality relate to when and 
how statistical information is made available to clients. 
Accurate information on relevant topics won’t be useful to 
clients if it arrives after they have to make their decisions. 
So the timeliness of statistical information is another 
important dimension of its fitness for use. Timeliness to the 
day may be crucial for key monthly economic series, but 
less important for measures of slowly changing phenomena. 
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For statistical information to be useful, clients have to be 
able to determine what is available and how they could 
obtain it. It then has to be available to potential clients in a 
form that they can use and afford. Both searching facilities 
and statistical products themselves have to use technology 
that is available to potential clients. This collection of 
considerations will be referred to as accessibility. 

To make appropriate use of statistical information from 
the NSO clients have to know what they have and to under- 
stand the properties of the information. That requires the 
NSO to provide descriptions of the underlying concepts, 
variables and classifications that have been used, the 
methods of collection, processing and estimation used in 
producing the information, and its own assessment of the 
accuracy of the information. We will refer to this property 
of statistical information as its interpretability. 

Finally, as an extension of interpretability, clients are 
sometimes faced with utilizing different sets of statistical 
information derived from different sources and at different 
times. Appropriate use is facilitated if information can be 
validly compared with other related data sets. This facility 
is achieved through the use of common, or at least compa- 
rable, concepts and methodologies, across products and 
across occasions. The degree to which statistical informa- 
tion fits into broad frameworks and uses standard concepts, 
variables, classifications and methods will be referred to as 
its coherence. 

These six dimensions are summarized in Table 1. Clearly 
they are not independent of each other. For example, all of 
the other five have an impact on relevance. Accuracy and 
timeliness often have to be traded off against each other. 
Coherence and relevance can sometimes be in conflict as 
the needs of current relevance and historical consistency 
compete. Information provided to ensure information is 
interpretable will also serve to define its coherence. Despite 
these interactions, these six dimensions provide a useful 
basis for examining how quality in this broad sense should 
be managed within a NSO. 

It is worth noting that most of the important properties of 
statistical information are not apparent to users without the 
provision of supplementary information (or metadata) by 
the NSO. The accuracy of information cannot be deduced 
just by looking at the numbers alone — some comparisons to 
other sources may shed light, but the NSO, which alone has 
access to the underlying microdata and first-hand know- 
ledge of the methodology used, has to provide measures of 
accuracy. The relevance of information may not be apparent 
without information on the underlying concepts, classifi- 
cations and methods used. Only timeliness and accessibility 
are directly observable by users. 

It is also worth noting that relevance, accessibility, and 
coherence usually have to be considered across a whole set 
of outputs of a NSO, rather than for each output indivi- 
dually. The relevance of statistical information depends on 
what else is available and therefore needs assessment across 
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Relevance 


Accuracy 


Timeliness 


Accessibility 


Interpretability 


Table 1 
The Six Dimensions of Data Quality 


The relevance of statistical information reflects the degree to which it meets the real needs of clients. It is concerned 
with whether the available information sheds light on the issues of most importance to users. Assessing relevance is 
a subjective matter dependent upon the varying needs of users. The NSO’s challenge is to weigh and balance the 
conflicting needs of different users to produce a program that goes as far as possible in satisfying the most important 
needs and users within given resource constraints. 


The accuracy of statistical information is the degree to which the information correctly describes the phenomena it 
was designed to measure. It is usually characterized in terms of error in statistical estimates and is traditionally 
decomposed into bias (systematic error) and variance (random error) components. It may also be described in terms 
of the major sources of error that potentially cause inaccuracy (e.g., coverage, sampling, nonresponse, response). 


The timeliness of statistical information refers to the delay between the reference point (or the end of the reference 
period) to which the information pertains, and the date on which the information becomes available. It is typically 
involved in a trade-off against accuracy. The timeliness of information will influence its relevance. 


The accessibility of statistical information refers to the ease with which it can be obtained from the NSO. This includes 
the ease with which the existence of information can be ascertained, as well as the suitability of the form or medium 
through which the information can be accessed. The cost of the information may also be an aspect of accessibility for 
some users. 


The interpretabilty of statistical information reflects the availability of the supplementary information and metadata 
necessary to interpret and utilize it appropriately. This information normally covers the underlying concepts, variables 
and classifications used, the methodology of collection, and indications of the accuracy of the statistical information. 
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Coherence 


The coherence of statistical information reflects the degree to which it can be successfully brought together with 


other statistical information within a broad analytic framework and over time. The use of standard concepts, 
classifications and target populations promotes coherence, as does the use of common methodology across 
surveys. Coherence does not necessarily imply full numerical consistency. 


a whole program. By definition, the same is true of cohe- 
rence. Most statistical products are delivered through a 
common dissemination system for the whole NSO so that 
questions of accessibility are largely corporate too. On the 
other hand, accuracy, timeliness, and interpretability can be 
considered as properties of each statistical output, even 
though, here too, each output may make use of tools or 
approaches that are common across programs. 

We will next consider the management of quality within 
each of these dimensions. 


3. RELEVANCE 


Maintaining relevance requires keeping in touch with the 
full array of current and potential information users, not 
only to monitor their current needs but also to anticipate 
their future needs. Information needs are rarely formulated 
clearly in statistical terms. A major challenge is to translate 
expressions of interest in particular topics into likely 
information needs in the future. The relevance of a data set 
depends on what other data sets are available in related 
areas of interest. Relevance is therefore more meaningfully 
managed and assessed at the level of a “statistical program” 
rather than for an individual data set. 

To assure relevance three primary processes need to be 
in place: client liaison; program review; and priority 
determination. These are described in the next three 


sections, followed in section 3.4 by a brief discussion of 
how performance in the domain of relevance might be 
assessed. 


3.1 Monitoring Client Needs 


The NSO requires a set of mechanisms whereby it stays 
abreast of the current and future information needs of its 
main user communities. These mechanisms need to include 
an array of consultative and _ intelligence-gathering 
processes to keep the NSO tuned in to the issues and 
challenges being faced by major users and which could lead 
to new or revised information needs on their part. Examples 
of possible mechanisms are given by the following selection 
of mechanisms used at Statistics Canada (Fellegi 1996): 


— a National Statistics Council to provide advice on 
policy and priorities for statistical programs; 

— professional advisory committees in major subject 
areas; 

— special bilateral liaison arrangements with key federal 
government ministries; 

— participation of the Chief Statistician in policy and 
program discussions among Deputy Ministers, 
including access to proposals to Ministers so that the 
statistical data needs implicit in proposed decisions or 
new programs can be identified; 

— a Federal-Provincial Consultative Council on Statistical 
Policy, and subsidiary committees on specific subject- 
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matters, for maintaining awareness of provincial and 
territorial governments’ statistical needs; 

— special Federal-Provincial arrangements in the areas of 
education, health and justice to manage statistical 
development in these areas of largely provincial 
jurisdiction; 

— meetings with major industry and small business 
associations; 

— feedback through individual users and user enquiries. 


These mechanisms are designed to identify gaps in the 
statistical system — information required by users that is not 
currently available or good enough for the desired purposes. 


3.2 Program Review 


The client liaison mechanisms described above will 
generate user feedback on current programs in addition to 
information about new and future needs. But periodically 
some form of explicit program review is required to assess 
whether existing programs are satisfying user needs, not 
only in terms of the topics addressed, but also in terms of 
the accuracy and timeliness of information being produced. 
Such reviews would utilize information generated by the 
regular client liaison mechanisms, might also assemble 
additional data, and would certainly integrate and assess 
this information to provide a comprehensive picture of how 
well the program is satisfying client needs. 

There are several approaches to such an assessment. An 
independent expert may be commissioned to consult the 
user community and make recommendations on program 
changes. The program area itself may be required to perio- 
dically gather and assess the feedback information it is 
receiving, and prepare a report identifying possible changes 
to the program. Programs may be required to identify their 
lowest priority sub-programs so that these can be compared 
in importance with potential new investments in the same 
program or elsewhere. 

Centrally, the NSO may conduct user satisfaction 
surveys covering various components of the statistical 
program, and monitor sales or usage of statistical products. 
It may also, as a result of its own integrating analytic work, 
identify gaps or deficiencies in the NSO’s products. 

All of these approaches have the common feature that, 
periodically, they call into question, at least on the margins, 
the continued existence of current programs. They help to 
identify investment options, both disinvestment from pro- 
grams no longer relevant, and reinvestment to fill gaps in 
programs not keeping up with client needs. 


3.3 Priority Determination 


The final leg of the stool is the process for considering, 
and acting upon, the information gleaned from user consul- 
tations and program review. Since demands will always 
outstrip the availability of funds, this is a process that 
requires the exercise of judgement in weighing the diverse 
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needs of different user constituencies. An additional dimen- 
sion of this process involves recognizing and pursuing 
opportunities for obtaining new financing to meet high 
priority information needs, thus reducing the pressure on 
existing programs to yield resources for reinvestment 
elsewhere. 

At Statistics Canada, the regular annual planning cycle 
is the core of this process. In this process decisions may be 
made to invest in feasibility studies in preparation for filling 
recognized data gaps, to provide seed money to demonstrate 
how information could be produced with a larger invest- 
ment, or to invest in improvements to the accuracy, time- 
liness or efficiency of existing programs. The launching of 
major new data collection initiatives usually requires 
resources beyond the means of internal reallocation, so the 
planning cycle is supplemented by periodic exercises to 
obtain support and funding from key federal data users for 
addressing major data gaps (Statistics Canada 1998b). In 
determining priorities a balance has to be struck between 
the need for change and improvement, and the need to 
satisfy the important ongoing requirements served by the 
core program. In practice, changes from one year to the 
next are marginal compared to the overall program. 


3.4 Monitoring Performance 


Measures of performance in the domain of relevance are 
of two main types. Firstly, evidence that the processes 
described above are in place is provided by descriptions of 
the particular mechanisms used supported by examples, if 
not measures, of their impact. For example, the coverage of 
consultative mechanisms may be assessed by systematically 
considering each of the major client or stakeholder groups 
and identifying the means of obtaining information on their 
statistical needs. The operation of such mechanisms can be 
evidenced by reviewing records of their deliberations or 
consultations. From the program perspective, evidence of 
periodic evaluation of the current relevance of each 
program can be provided and the impact of the results of 
these evaluations can be assessed. 

Secondly, direct evidence of relevance may be provided 
by measures of usage, by client satisfaction results, and by 
high-profile examples of statistical information influencing 
or shedding light on important policy issues. Sales of infor- 
mation products and services provide a direct and con- 
vincing indicator of relevance. Usage of free products and 
services, including Internet hits for example, also reflects 
levels of interest, though the impact of price on usage can 
be complex and sometimes misleading. Pointing out and 
publicizing new analytic findings based on NSO data that 
shed light on important public policy issues can be espe- 
cially convincing in demonstrating relevance. More gene- 
rally, regular publication of analytic results in a readable 
form provides a continuing illustration of the relevance of 
a NSO’s output, especially when republished broadly in the 
daily press. 
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Finally, the real changes that the NSO makes in its 
programs from year to year are a visible reflection of the 
working of its client liaison and priority-setting processes. 


4. ACCURACY 


Processes described under relevance determine which 
programs are going to be carried out, their broad objectives, 
and the resource parameters within which they must 
operate. Within those “program parameters” the mana- 
gement of accuracy requires attention during the three key 
stages of a survey process: design, implementation, and 
assessment. 


4.1 Design 


The broad program parameters will not usually specify 
accuracy targets. They will often indicate the key quantities 
to be estimated, and the level of detail (e.g., geographical, 
industrial) at which accurate estimates are needed, but the 
definition of “accurate” will at best be vague. Nor will they 
deal at all with tolerable levels of nonsampling error. 
Indeed, given the multiplicity of estimates and analyses, 
planned and unplanned, that come from any survey 
program, it would not be feasible or even useful to try to 
specify, before design begins, target accuracy levels. The 
objective of survey design is to find an optimum balance 
between various dimensions of accuracy and timeliness 
within constraints imposed by budgets and respondent 
burden considerations. In this process options that result in 
different levels of accuracy at different costs, within the 
broad program parameters, may be considered. The output 
of the design stage is a survey methodology within which 
some accuracy targets or assumptions, at least for key 
estimates and key dimensions of accuracy, will often be 
embedded. For example, a sample survey may aim to 
achieve a sampling coefficient of variation for its key 
estimate below a given threshold at the provincial level, and 
assume a response rate not less than a defined level. A 
census design may aim at a specified overall coverage rate, 
with no key sub-group’s coverage falling below some lower 
specified rate. 

The purpose here is not to describe the techniques of 
survey design that assist in finding optimum designs - that 
is the subject of the survey methodology literature (amply 
illustrated by the contents of this journal over its first 25 
years!). Here we seek to identify some key management 
questions that need to be asked to ensure that accuracy 
considerations have received due attention during the 
design. We suggest eight primary aspects of design to 
which attention should be evident. 


1. Explicit consideration of overall trade-offs between 
accuracy, cost, timeliness and respondent burden 
during the design stage. The extent and sophistication 
of these considerations will depend on the size of the 
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program, and the scope for options in light of the 
program parameters. But evidence that proper 
consideration was given to these trade-offs should be 
visible. 


2. Explicit consideration of alternative sources of data, 
including the availability of existing data or adminis- 
trative records, to minimize new data collection. This 
issue focuses on the minimization of respondent burden 
and the avoidance of unnecessary collection. 


3. Adequate justification for each question asked, and 
appropriate pre-testing of questions and questionnaires, 
while also assuring that the set of questions asked is 
sufficient to achieve the descriptive and analytical aims 
of the survey. 


4. Assessment of the coverage of the target population by 
the proposed survey frames. 


5. Within overall trade-offs, proper consideration of 
sampling and estimation options and their impact on 
accuracy, timeliness, cost, response burden and 
comparisons of data over time. 


6. Adequate measures in place for encouraging response, 
following up nonresponse, and dealing with missing 
data. 


7. Proper consideration of the need for quality assurance 
processes for all stages of collection and processing. 


8. Appropriate internal and external consistency checking 
of data with corresponding correction or adjustment 
strategies. 


While these eight areas do not cover all aspects of survey 
design, and consideration of issues does not necessarily 
result in the “optimum” decision, evidence that these 
aspects have been seriously considered will be strongly 
suggestive of sound survey design. In the end, the strength 
of the survey methodology will depend on the judgements 
of survey design teams. However, this list of issues 
provides a framework to guide those judgements and ensure 
that key factors are considered. Smith (1995) and Linacre 
and Trewin (1993) illustrate the balancing of these 
considerations in theory and practice. 

Not included in the above list is a ninth area for 
attention: built in assessments of accuracy. This will be 
covered in section 4.3 below. 


4.2 Implementation 


But a good design can be negated in implementation. 
While a very good design will contain built-in protection 
against implementation errors (through quality assurance 
processes, for example), things can always go wrong. From 
the management perspective, two types of information are 
needed at the implementation stage . The first is information 
to monitor and correct, in real time, any problems arising 
during implementation. This requires a timely information 
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system that provides managers with the information they 
need to adjust or correct problems while the survey is in 
progress. The second need is for information to assess, after 
the event, whether the design was carried out as planned, 
whether some aspects of the design were problematic in 
operation, and what lessons were learned from the opera- 
tional standpoint to aid design in the future. This too 
requires information to be recorded during implementation 
(though not necessarily with the same fast feedback as for 
the first need), but it can also include information gleaned 
from post-implementation studies and debriefings of staff 
involved in implementation. 

Of course, information pertaining directly to accuracy 
itself may only be a small subset of the information required 
by operational managers. But information related to costs 
and timing of operations is equally important to the 
consideration of accuracy for future designs. 


4.3. Accuracy Assessment 


The third key stage of the survey process is the 
assessment of accuracy — what level of accuracy have we 
actually achieved given our attention to accuracy during 
design and implementation? Though we describe it last, it 
needs to be a consideration at the design stage since the 
measurement of accuracy often requires information to be 
recorded as the survey is taking place. 

As indicated earlier, accuracy is multidimensional and 
choices have to be made as to what are the most important 
indicators for each individual survey. Also each survey 
produces thousands of different estimates, so either generic 
methods of indicating the accuracy of large numbers of 
estimates have to be developed, or the indicators are 
restricted to certain key estimates. 

As with design, the extent and sophistication of accuracy 
assessment measures will depend on the size of the pro- 
gram, and on the significance of the uses of the estimates. 
Here we propose four primary areas of accuracy assessment 
that should be considered in all surveys (Statistics Canada 
1992). Other, or more detailed, assessments may be 
warranted in larger or more important surveys to improve 
the interpretability of estimates as discussed later. 


1. Assessment of the coverage of the survey in compa- 
rison to a target population, for the population as a 
whole and for significant sub-populations. This may 
mean assessing the coverage of a list frame (e.g., a 
business register by industry), the coverage of a census 
that seeks to create a list of a population (e.g., the 
coverage of a census of population by province or by 
age and sex), or the coverage of an area sample survey 
in comparison to independent estimates of the target 
population (e.g., the difference between sample based 
population estimates from a household survey and 
official population estimates). 


2. Assessment of sampling error where sampling was 
used. Standard errors, or coefficients of variation, 
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should be provided for key estimates. Methods of 
deriving approximate standard errors should be 
indicated for estimates not provided with explicit 
standard errors. 


3. Nonresponse rates, or percentages of estimates 
imputed. The objective is to indicate the extent to 
which estimates are composed of “manufactured” data. 
For skew populations (such as most business popu- 
lations), nonresponse or imputation rates weighted by 
a measure of size are usually more informative than 
unweighted ones. 


4. Any other serious accuracy or consistency problems 
with the survey results. This heading allows for the 
possibility that problems were experienced with a 
particular aspect of a survey causing a need for caution 
in using results. For example, a widely misunderstood 
question might lead to misleading estimates for a 
particular variable. It also allows any serious inconsis- 
tencies between the results and other comparable series 
to be flagged. 


The choice of how much effort to invest in measuring 
accuracy is a management decision that has to be made in 
the context of the usual trade-offs in survey design. But 
requiring that, at a minimum, information on these four 
aspects of accuracy be available for all programs ensures 
that attention is paid to accuracy assessment across the 
NSO. It also provides a basis for monitoring some key 
accuracy indicators corporately. For example, tracking 
trends in response rates across surveys of a similar type can 
provide valuable management information on a changing 
respondent climate, or on difficulties in particular surveys. 
Regular measures of the coverage of major survey frames 
such as a business register or an address register also 
provide information that is important both to individual 
programs using these frames, and to NSO management. 
More will be said about the provision of information on 
accuracy to users under interpretability in section 7. 


5. TIMELINESS 


Timeliness of information refers to the length of time 
between the reference point, or the end of the reference 
period, to which the information relates, and its availability 
to users. As we have seen, the desired timeliness of 
information derives from considerations of relevance — for 
what period does the information remain useful for its main 
purposes? The answer to this question varies with the rate 
of change of the phenomena being measured, with the 
frequency of measurement, and with the immediacy of 
response that users might make to the latest data. As we 
have also seen, planned timeliness is a design decision often 
based on trade-offs with accuracy — are later but more 
accurate data preferable to earlier less accurate data? — and 
cost. Improved timeliness is not, therefore, an unconditional 
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objective. But timeliness is an important characteristic that 
should be monitored over time to warn of deterioration, and 
across programs to recognize extremes of tardiness. User 
expectations of timeliness are likely to heighten as they 
become accustomed to immediacy in all forms of service 
delivery thanks to the pervasive impact of technology. 
Unlike accuracy, timeliness can be directly observed by 
users who, one can be sure, will be monitoring it whether or 
not the NSO does. 

As indicated under accuracy, the explicit consideration 
of design trade-offs is a crucial component of the manage- 
ment of timeliness in a NSO. Equally, measures described 
earlier under implementation (see section 4.2) are important 
in ensuring that planned timeliness objectives are actually 
achieved. But there are further measures that can be 
pursued for managing timeliness. 

Major information releases should have release dates 
announced well in advance. This not only helps users plan, 
but it also provides internal discipline and, importantly, 
undermines any potential effort by interested parties to 
influence or delay any particular release for their benefit. 
Achievement of planned release dates should be monitored 
as a timeliness performance measure. Changes in planned 
release dates over longer periods should also be monitored. 

For some programs, the release of preliminary data 
followed by revised and final figures is used as a strategy 
for making data more timely. In such cases, the tracking of 
the size and direction of revisions can serve to assess the 
appropriateness of the chosen timeliness-accuracy trade-off. 
It also provides a basis forrecognizing any persistent or 
predictable biases in preliminary data that could be removed 
through estimation. 

For ad hoc surveys and new surveys another possible 
indicator of timeliness is the elapsed time between the 
commitment to undertake the survey and the release date. 
This measure reflects the responsiveness of the Agency in 
planning and setting up a survey as well as its execution 
after the reference date. But its interpretation must take 
account of other factors that help to determine how quickly 
a new survey should be in place — faster is not necessarily 
better. 

For programs that offer customized data retrieval 
services, the appropriate timeliness measure is the elapsed 
time between the receipt of a clear request and the delivery 
of the information to the client. Service standards should be 
in place for such services, and achievement of them 
monitored. 


6. ACCESSIBILITY 


Statistical information that users don’t know about, can’t 
locate, or, having located, can’t access or afford, is not of 
great value to them. Accessibility of information refers to 
the ease with which users can learn of its existence, locate 
it, and import it into their own working environment. Most 
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aspects of accessibility are determined by corporate-wide 
dissemination policies and delivery systems. At the 
program level the main responsibility is to choose appro- 
priate delivery systems and ensure that statistical products 
are properly included within corporate catalogue systems. 

So the management of accessibility needs to address four 
principal aspects of accessibility. Firstly, there is the need 
to have in place well-indexed corporate “catalogue” 
systems that allow users to find out what information is 
available and assist them in locating it. Secondly, there is 
the need for corporate “delivery” systems that provide 
access to information through distribution channels, and in 
formats, that suit users. Thirdly, the coverage of statistical 
information from individual programs in corporate cata- 
logue systems and the use of appropriate delivery systems 
(corporate or in some cases program-specific) by each 
statistical program has to be managed. Finally, there have 
to be means of obtaining and acting upon usage and user 
satisfaction measures for the catalogue and delivery 
systems. 

Given the current rate of technology change, the nature 
of both catalogue and delivery systems is evolving fast. The 
traditional printed catalogue that was almost always out of 
date has given way to on-line catalogues of statistical 
products, whether printed or electronic, linked to metadata 
bases in which characteristics of the information can be 
found. A thesaurus that helps users search for information 
without necessarily knowing the precise terms used by the 
NSO is also a crucial component of a catalogue system. 
Access to the catalogue system can be through the Internet, 
and users who find what they want can immediately place 
an order to request the desired information. It is also 
essential that the NSO’s catalogue inter-operate with 
external bibliographic systems so that users searching 
outside the NSO are directed to it. 

In addition to the structured and exhaustive approach of 
the catalogue, there are at least two other potential entry 
points for discovering what data are available. The NSO’s 
official release mechanism in which all newly available data 
are announced, The Daily in the case of Statistics Canada, 
can provide links to catalogue entries for related products 
and to sources of more detailed information and metadata. 
The NSO’s main public statistical presentation on its 
Internet site, known as Canadian Statistics in the case of 
Statistics Canada, can also include similar links to related 
information and metadata. While these components are not 
yet fully operational and integrated in many NSOs, this 
outlines the nature of catalogue systems for the near future. 

The Internet is changing the face of delivery systems and 
promises to become the hub and entry point of such systems 
for the coming period. But the traditional delivery system of 
printed publications is still valued by many users, while 
electronic products on diskette or CD-ROM meet some 
needs. On-line databases continue to be a central 
component of a NSO’s information delivery systems, 
whether accessible via the Internet or directly. Among all 
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this hi-tech turmoil, the NSO has to make sure that the 
public good information needs of the general public 
continue to be met whether through the media, through 
public libraries, or through the Internet. The special needs 
of analysts who require access to microdata present an 
important set of delivery challenges which are being 
addressed in several NSOs (see SSHRC and Statistics 
Canada 1998 for example) but which we will not deal with 
here. 

Increasingly, organizations outside the NSO, both public 
and private, are playing important roles in improving the 
accessibility of information produced by the NSO. These 
organizations may act simply as distributors of data, or may 
add context or value to NSO data by integrating them with 
other information or using them in ways that go beyond 
those that would be appropriate for a NSO. To maximize 
accessibility, the NSO must be open to opportunities for 
partnership with such organizations, but must also ensure 
that its identity as the source of data remains visible and, 
where appropriate, encourage linkages back to the original, 
and usually more detailed, data sources held by the NSO. 

An important aspect of the accessibility of information 
is the pricing policy that governs its dissemination. 
However well-endowed the NSO, resources are limited and 
the option of providing unrestricted free access to all 
potential information is not viable. Nor is it desirable 
because it would destroy a most valuable source of user 
feedback: measures of real demand for products. A pricing 
policy needs to balance the desire to make certain basic 
information freely accessible in the public domain, while 
recovering the costs of providing specific products, more 
detailed information, and special requests. Such a policy 
can promote accessibility, provide a valuable source of 
information on relevance, and ensure that the resources of 
the NSO are properly balanced between collecting and 
processing new data on the one hand, and servicing 
demands for information from existing data on the other. 

Finally, in the process of moving information from 
Statistical programs into the hands of users we have to 
guard against the introduction of error. At this last hurdle in 
the process, the wrong information can get loaded into 
electronic databases; the wrong version of tables can find 
their way into publications; and enquirers can be given the 
wrong information over the telephone. Since the potential 
for these errors occurs at the delivery stage, we include 
them under accessibility rather than accuracy. Quality 
assurance systems that minimize the possibility of such 
errors are a necessary component of these systems. 

Since users are the main judge of accessibility, 
systematic user feedback on catalogue and delivery systems 
is crucial. This feedback may be derived from (a) automated 
usage statistics for the various components of these 
systems, (b) surveys of user satisfaction with particular 
products, services, or delivery systems, and (c) voluntary 
user feedback in the form of comments, suggestions, 
complaints, or plaudits. 
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Descriptions of cataloguing and delivery systems used by 
some NSOs can be found in Podehl (1999), Boyko (1999) 
and by visiting the websites of particular NSOs. 


7. INTERPRETABILITY 


Statistical information that users cannot understand, or 
can easily misunderstand, has no value and may have 
negative value. Providing sufficient information to allow 
users to properly interpret statistical information is therefore 
a responsibility of the NSO. Information about information 
has come to be known as metainformation or metadata. 
Managing interpretability is primarily concerned with the 
provision of metadata. 

The information needed to understand statistical data 
falls under three broad headings: (a) the concepts and 
classifications that underlie the data; (b) the methodology 
used to collect and compile the data; and (c) measures of 
accuracy of the data. Essentially these three headings cover 
respectively: what has been measured; how it was 
measured; and how well it was measured. Users clearly 
need to know what has been measured (to assess its 
relevance to their needs), how it was measured (to allow 
appropriate analytic methods to be used), and how well it 
was measured (to have confidence in the results). Since we 
can rarely provide a profile of all dimensions of accuracy, 
the description of methodology also serves as a surrogate 
indicator of accuracy — it allows the user to assess, if they 
wish, whether the methods used were scientific, objective 
and carefully implemented. Under each of these headings, 
more detailed lists of topics can be formulated (Statistics 
Canada 1992). 

There are close relationships between these three 
headings and other dimensions of quality. The underlying 
concepts and classifications used are also a prime 
determinant of coherence (see next section) and the degree 
to which they conform with national or international 
standards should be apparent from the metadata. They are 
also important for the systems that allow users to find out 
what information is available as described under 
accessibility (section 6). The description of methodology 
will reflect the kind of design decisions described under 
accuracy (section 4.1) and the use of common tools and 
methods will be relevant to coherence (section 8). The 
measures of accuracy should reflect the considerations 
outlined in section 4.3. 

That information needed to understand statistical data 
must be comprehensible is a tautology worth stating. The 
NSO has to make a particular effort to ensure that the 
information provided under these headings is written in the 
users’ language and not in its own internal jargon. 
Otherwise it fails on interpretability twice over. 

To manage the interpretability dimension of quality, we 
suggest three elements need to be in place. The first is a 
policy on informing users of the basic information they 
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need to interpret data. This policy would prescribe what 
information should be provided with every release of data, 
and in what form it might be provided. The second element 
is an integrated base of metadata that contains the 
information needed to describe each of the NSO’s data 
holdings. Typically, this metadata base would contain more 
than the minimum required by the policy. Thirdly, there is 
a need for direct interpretation of the data by the NSO. With 
each major release, there should be some commentary that 
focuses on the primary messages that the new information 
contains. Directed particularly at the media, such commen- 
tary increases the odds that at least the first level of inter- 
pretation to the public will be correct. Conversely, the NSO 
should answer or refute serious misinterpretation of its data. 

Interpretability is perhaps the one dimension of quality 
where the NSO should aim to do more than the user is 
asking. There is an element of user education in the provi- 
sion of metadata. Spreading the message that all data should 
be used carefully, and providing the information needed to 
use data with care, is a responsibility of the NSO that goes 
beyond simply providing what users seek. 

The assessment of success in the area of interpretability 
requires measuring compliance with the policy proposed 
above, and seeking user feedback on the usefulness and 
adequacy of the metadata and analysis provided. 


8. COHERENCE 


Coherence of statistical data includes coherence between 
different data items pertaining to the same point in time, 
coherence between the same data items for different points 
in time, and international coherence. The tools for mana- 
ging coherence within a NSO fall under three broad 
headings. 

The first element is the development and use of standard 
frameworks, concepts, variables and classifications for all 
the subject-matter topics that the NSO measures. This aims 
to ensure that the target of measurement is consistent across 
programs, that consistent terminology is used across 
programs (so that, for example, “educational level” means 
the same thing whether measured in a Census of population 
or from school records), and that the quantities being 
estimated bear known relationships to each other. The 
realization of this element is normally through the adoption 
and use of frameworks such as the System of National 
Accounts and standard classification systems for all major 
variables. The issue of international comparability is 
addressed by considering the adherence of the standards 
adopted to international standards where these exist. 
Policies are required to define program responsibilities for 
ensuring that data are produced according to the standards 
adopted. 

The second element aims to ensure that the process of 
measurement does not introduce inconsistency between 
data sources even when the quantities being measured are 
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defined in a consistent way. The development and use of 
common frames, methodologies and systems for data 
collection and processing contribute to this aim. For 
example, the use of a common business register across all 
business surveys ensures that differences in frame coverage 
do not introduce inconsistencies in data (there are other 
reasons for using a common business register too); the use 
of commonly formulated questions when the same variables 
are being collected in different surveys serves to minimize 
differences due to response error; the use of common 
methodology and systems for the various processing steps 
of a survey, especially edit and imputation, helps to ensure 
that these operations do not introduce spurious differences 
in data. All of these arguments apply across occasions of a 
particular survey, as well as across surveys. 

With the first two elements we attempt to ensure that we 
do not build into the design or implementation of statistical 
programs any unjustified inconsistency. The third element 
deals with the results of this attempt and focuses on the 
comparison and integration of data from different sources. 
Some integration activities are regular and routine, e.g., the 
integration of data in the national accounts, benchmarking 
or calibration of estimates to more reliable control totals, 
seasonal adjustment of data to facilitate temporal compa- 
risons. Other activities are more exploratory and ad hoc. 
The confrontation of data from different sources, and their 
subsequent reconciliation or explanation of differences, is 
an activity that is often needed as part of pre-release review 
or certification of data to be published. Feedback from 
external users and analysts of data that point out coherence 
problems with current data is also an important component 
of coherence analysis. Some incoherence issues only 
become apparent with the passage of time and may lead to 
historical revisions of data. 

To assess success in achieving coherence one can 
identify three broad sets of measures corresponding to the 
three elements described above. The existence and degree 
of use of standard frameworks, variables and classification 
systems; the existence and degree of use of common tools 
and methodologies for survey design and implementation; 
and the incidence and size of inconsistencies in published 
data. Within this latter category, one might include, for 
example, monitoring the residual error of the national 
accounts, the closure error in population estimation, or the 
size of benchmarking adjustments in major surveys. 


9. OVERALL MECHANISMS 


In reviewing each dimension of quality we have identi- 
fied mechanisms which we believe to be important for the 
management of quality within a NSO. Some of these 
mechanisms lead to measures that have to be taken or 
followed by each individual statistical program within the 
NSO. Others lead to corporate-wide systems which all 
programs use, or to which they contribute information. In 
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this section we extract what we consider to be the five 
major components or subsystems of a quality management 
system within a NSO. 

The user liaison subsystem consists of the series of 
mechanisms that serve to keep the NSO in touch with its 
primary user groups. It provides information about current 
and anticipated information needs, adequacy of current 
products, and advice on priorities. It plays a key role in 
assuring the relevance of the NSO’s output. 

The corporate planning subsystem takes the information 
coming in from the user liaison system, together with 
assessments and internal knowledge of program strengths 
and weaknesses, to identify where program reductions or 
investments should be made. It sets the program parameters 
for all programs, and therefore has a direct impact on the 
relevance, accuracy and timeliness achievable by statistical 
programs. Through its funding decisions on infrastructure 
programs, it also influences directly the accessibility, inter- 
pretability and coherence of statistical outputs. It must be 
overseen by the NSO’s senior management committee. 
Funding decisions depend on a robust cost reporting system 
that accurately captures the component costs of statistical 
programs. 

The methods and standards subsystem establishes the 
policies and guidelines that govern the design and imple- 
mentation of statistical programs, including both content 
and documentation standards, and standards for the metho- 
dology and systems used. It is key to achieving coherence 
and interpretability across statistical outputs, and to the 
optimization of accuracy and timeliness within programs. 
Its management must involve senior representation from 
across the NSO through a management committee. 

The dissemination subsystem establishes the policies and 
guidelines, and puts in place the corporate systems, for deli- 
vering information to users. This includes the management 
and delivery of the metadata needed by users to search and 
access the NSO’s data holdings. It is the key determinant of 
the accessibility and interpretability of the NSO’s data. Its 
management too must involve senior representation from 
across the NSO. 

Last but not least is the program reporting subsystem. 
Whatever the level of corporate emphasis on quality, it is 
within the individual statistical programs that quality is built 
in to the products. Within the constraints and guidance 
provided by corporate policies and guidelines, individual 
programs have to make informed trade-offs and decisions 
that will influence quality in all its dimensions. Within 
programs, evaluation and analysis of data provides a first 
assessment of the accuracy and coherence achieved. It is 
individual programs that have to defend their accuracy and 
timeliness records to users. A system for regular reporting 
by programs to management on their achievements in the 
different domains of quality provides an essential manage- 
ment input, not only for current monitoring, but more 
importantly as an input to the corporate planning subsystem 
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where decisions on future investments are made. 

Diagram 1 provides a simplified sketch of the 
relationships between these five subsystems, or key 
functions, necessary to the management of quality in a 
NSO. The subsystems are not organizational units. Indeed, 
the nature of most of them is that they must involve a cross- 
section of staff from across the NSO in order to build a 
corporate consensus on the appropriate policies and 
standards to be followed. 
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Speaking of staff, the diagram omits the crucial role of 
staff in all of these subsystems. A NSO is heavily depen- 
dent on a strong cadre of “knowledge-workers” covering a 
wide range of disciplines. As we have seen, professional 
expertise and judgement are required in many aspects of the 
design, analysis and evaluation of statistical programs. 
Competent staff are required to execute all phases of 
Statistical programs with attention to the assurance of 
quality. Surrounding the subsystems described, we should 
envisage a human resources subsystem that aims to ensure 
that the NSO has at all times a well-trained, motivated and 
versatile staff capable of meeting the challenges facing the 
NSO. In particular, they need to have an appreciation of the 
importance of satisfying client needs through the 
management of all dimensions of quality. For one approach 
to a human resources subsystem see Statistics Canada 
(1997). 
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10. CONCLUSION 


One object of this paper has been to put the statistician’ s 
traditional concern for accuracy into a broader context. 
Accuracy is important, but without attention to other dimen- 
sions of quality, accuracy alone will not satisfy users. Nor 
for many users is it the most important consideration. 
Trying to look at quality from a user perspective may help 
in solving the inevitable trade-offs between accuracy and 
other dimensions of quality. 

This broader view of quality also helps to link together 
several key activities within a NSO as contributors to the 
management of quality. Training activities within the NSO 
can take advantage of this linkage to develop a broader 
understanding among employees of how different activities 
within the NSO fit together or complement each other - and 
particularly of why their own work is so important. 

This broader view also helps to reinforce the importance 
of analysis within a NSO. Analysis has been mentioned as 
a means of demonstrating relevance, as a means of check- 
ing accuracy, as a means of improving interpretability, and 
as a means of testing coherence. And that list excludes the 
basic role of analysis in adding to the information content 
of statistical outputs. 

For the future, more can be done to refine the concept of 
quality in a NSO and to improve quality management. 
Within the narrower domain of accuracy, there is still more 
room for work on the control and measurement of non- 
sampling errors. With the increasing reliance on administra- 
tive data, more systematic study of the attributes of data 
from these sources will be required. The growing interest in 
longitudinal surveys, sometimes linked with administrative 
data, raises the need to manage accuracy issues arising in 
such surveys. Finally, the growing emphasis on the combi- 
nation of data using integrating frameworks calls for more 
attention to the quality attributes of data resulting from such 
manipulations. 
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Administrative Records and Census Taking 


FRITZ SCHEUREN' 


ABSTRACT 


The shift in the use of administrative records from an incidental role in census applications to an essential one is now well 
along in many European countries. The challenges are greater in Canada and the U.S., as this paper discusses. Progress in 
the U.S. in developing a modified administrative census paradigm is dealt with in some detail and contrasts made to what 
has already been done elsewhere, notably in Canada. A research agenda is set out and some connections made across a 
whole gambit of U.S. census-connected statistical programs — including current surveys, intercensal estimates, and the 
measurement of the census undercount. Privacy concerns are prominent among the issues that are addressed. The role of 
low cost computing and advanced record linkage software also are given their due. The changing status of central statistical 


agencies as the information age advances is also touched on. 


KEY WORDS: Record linkage; Privacy; Surveys and intercensal estimates. 


1. INTRODUCTION 


The use of tax and other governmental administrative 
records in census-taking turns out to be quite old, even 
though most of the real advances have occurred in the last 
25 years or so — that is, roughly during the same time span 
as the publication of Survey Methodology. 

The introduction of modern sampling — or the repre- 
sentative method, as Kiaer called it (Bellhouse 1988) — was 
tied, it seems, to the matching of samples of Norwegian tax 
records to the census of 1890 in Norway (Johnson and Kotz 
1997). Of course, the mathematics of Kiaer’s approach, 
rather than the particular application, was the focus of much 
of the later work (and remains the usual focus in Survey 
Methodology). This was appropriate, given that administra- 
tive records were often inaccessible and hard to use. 

Over time, though, there has been legislation (like the 
Canadian Statistics Act) that has made access to admini- 
strative records routinely possible by Central Statistical 
Offices in many countries. Advances in computing and 
recordkeeping in government and elsewhere, while bringing 
new problems, have certainly also made administrative 
records easier to use for statistical purposes and this trend 
seems likely to continue or even accelerate (e.g., Kenessey 
1994). 

Traditional censuses have been replaced in whole or in 
part in some of the Nordic countries by administrative 
records (e.g., Myrskla 1991; Thomsen and Holmoy 1998). 
This has not occurred in Canada or United States — partly 
because of the nature of the administrative records available 
and partly because of the sheer size and complexity of the 
undertaking. In fact, even in one of the most ambitious 
North American administrative record census (ARC) 
proposals (e.g., Alvey and Scheuren 1982), the complete 
elimination of conventional census-taking was not advo- 
cated. Rather a mixed mode approach was suggested. 


The current paper attempts to recount briefly the “state 
of the play” on administrative record census proposals (See 
Steffey and Bradburn 1994 for an additional perspective). 
The paper focuses mainly on the U.S. but with Canadian 
parallels (Leyes and Elsl-Culkin 1994). In some respects 
this is a follow-on or update to a piece in Survey 
Methodology ten years ago (Scheuren 1990). 

Before going into details, it may be worth providing a 
context to the changes needed to achieve some form of an 
administrative record census. First, it may make sense to 
discuss the nature of scientific revolutions generally. 
Bellhouse (1988) cites Kuhn (1970) in this regard relative 
to sampling itself. Scheuren (1990) also drew independently 
on Kuhn concerning ARC ideas. 

For example, it was not really until the paper by Neyman 
(1934) — aided by Sukhatme (1935) and, through Deming’s 
advocacy, plus the all important paper by Hansen and 
Hurwitz (1943) — that Kiaer’s randomization-based 
approach to the representative method might be argued to 
have been accepted. 

At least in North America, ARC ideas may not yet have 
found their Neyman. Still, there have been many hard-won 
successes to celebrate and with the fuller emergence of 
enabling technologies (like record linkage and low-cost 
computing), the shape of the future can be characterized as 
encouraging. 

Organizationally, the present paper is divided up into 8 
sections, beginning with this introduction (section 1). 
Section 2 sets out some ARC background and section 3 
develops a few assumptions about issues that go beyond the 
operational feasibility of an ARC. The rest of the paper 
consists of suggestions in four areas: the 2000 U. S. Census 
(section 4), the intercensal population estimates program for 
the coming decade (section 5), the current surveys program 
(section 6), and the planning for the 2010 U.S. Census 
(section 7). There is also a concluding section (section 8) 
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that discusses priorities. Finally, some references are 
provided. 


2. BACKGROUND ON ORIGINAL 
ARC PROPOSAL 


In Europe, several countries are quite far along in 
developing administrative record censuses, having begun 
back in the 1970’s (e.g., Jensen 1983; Jabine and Scheuren 
1987; Redfern 1989; Blum 1999). Those countries are 
much smaller and differ in many other ways from the U.S. 
or Canada — especially in the social contract that underlies 
census-taking. What they have done, therefore, is hard to 
apply directly. Still, their pathbreaking efforts have much to 
teach. 

The original idea for a partial ARC in the United States 
was first made publicly at an American Statistical 
Association meeting in 1982 (Alvey and Scheuren 1982). 
The work of John Leyes and Doug Norris at Statistics 
Canada was one of the inspirations for that proposal. 
Basically, the paper advocated research on how — 


To link U.S. Internal Revenue Service (IRS) 
tax return data to wage and retirement earn- 
ings, unemployment compensation records, 
and U.S. Health and Human Services (HHS) 
administrative files to obtain a “bare bones” 
population census. 


The key element here was researching a partial replace- 
ment for a conventional census — not to completely replace 
it. The administrative records were, moreover, limited to 
those already legislatively available in whole or in part to 
the U.S. Census Bureau. Speculations were offered that 
some administrative system changes might be possible to 
accommodate an ARC use; even so, this proposal never 
contemplated “content-wise” that the resulting ARC would 
be much more than a bare bones population count. 

The anticipated coverage of an ARC was believed, 
however, to be good but not treated as perfect. In fact, the 
ARC proposal always assumed some form of sampling to 
adjust the population for completeness. The prediction was 
made that the proposed ARC would cover well over 95% of 
the population covered in a conventional census. The 1993 
and 1998 papers by Sailer and his colleagues confirmed this 
conjecture (Sailer, Weber, and Yau 1993; Czajka, Moreno, 
and Schirm 1997; Sailer and Weber 1998). 

The bare bones aspect might be best illustrated by the 
fact that no provision was made for the housing census that 
is conducted along with the current U.S. population census. 
Housing would have to be dealt with in some other way. 
Among the weaknesses of the proposal, acknowledged at 
the time, was the quality of the race data in administrative 
records and the problem of having mailing rather than 
actual residential addresses. 
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Considering these limitations, why proceed? Well, the 
ARC originally proposed not only would reduce the cost 
and burden of a decennial census, but has the potential for 
producing a total population count more frequently than 
every 10 years. It also might provide improved coverage 
for some of the populations traditionally undercounted in a 
decennial census. Moreover, Bye’s 1997 work (Bye 1997), 
plus his recent detailed look at Social Security Admi- 
nistration data on race and ethnicity (Bye 1998a and 
1998b), put these weaknesses into perspective and go a 
long way to suggesting how they could be overcome or at 
least lived with (See also Bye 1999.) 

The most important point about the proposal was that it 
advocated research towards a potential ARC 10 or even 20 
years down the road. Implementing an ARC was not 
proposed, although some of the reaction raised this concern. 
Privacy and confidentiality aspects were prominently 
mentioned in the proposal as also requiring research. 

There is no need here to carry the story forward in detail 
from the original Alvey and Scheuren paper until now. 
That has been done elsewhere (Scheuren 1995a). What is 
important to mention is the shift in the tone of the research 
over the years, from “proving” an ARC could not work to 
trying to find ways that it might. Bye, for example, in his 
excellent report to the Census Bureau (Bye 1997), fully 
spelled out a way to implement such a census. While it has 
many researchable elements, Bye’s approach demonstrates 
that the idea is operationally feasible. 


3. ASSUMPTIONS 


Certainly the technology of record linkage and the wide- 
spread availability of massive fully-computerized record 
systems make the creation of alternatives to conventional 
censuses possible outside the U.S. Federal sector. State 
governments have incentives to be sure that every resident 
is counted (Biskupick 1998) and certainly could construct 
partial ARCs using their own record systems. The 
motivation to challenge the Census Bureau monopoly is 
definitely present with the devolution of Federal activities 
to the states and the financial incentives involved in Federal 
grant programs. Nearly $200 billion in Federal aid is 
distributed annually based on population. 


3.1 Massive Data Sets 


The mass marketers and telephone survey organizations 
also have extensive data systems that might be tapped into. 
Private data sources unheard of a few years ago (e.g., even 
from grocery chains!) are expanding rapidly and extensive 
statistical use of these private sources is already occurring 
(National Academy of Sciences 1996). With the worldwide 
revolution in electronic recordkeeping practices, there will 
be many new entrants in the emerging information 
industries. The “hurdle” price has been lowered and the 
value of information has been growing. 
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Some recent work done for the State of Connecticut 
might be worth illustrating the general points just made. In 
White, Mulrow and Scheuren (1999), the authors describe 
an effort commissioned by the State of Connecticut to use 
state administrative records to improve Connecticut’s jury 
selection system. It is important to note at the outset that 
the goal of that work was not to do an ARC. Still the 
exercise has a lesson in it about the ease with which a 
partial ARC could be developed for a state. 

Formerly, Connecticut employed voter registration and 
motor vehicle files with a labor-intensive process to undup- 
licate the two systems, so as to form a list from which to 
draw potential jurors for duty. The new effort, described in 
White et al. (1999), involved employing probability-based 
linkage technologies (Jaro 1989) with four state-level files: 
the two mentioned already, plus the State’s income tax file 
and the State’s unemployment file. The files were all 
created in early 1998. 

To evaluate the Connecticut linked data, a comparison 
was made to 1996 Census Bureau population projections by 
township, brought forward to 1997. The administrative 
record population coverage obtained by the combined file 
was surprisingly good, given that an ARC was not the goal. 
In fact, the linked administrative record counts by township 
were highly correlated with population projections. The 
simple correlation was p = 0.946. When four of the 169 
townships are removed as outliers, the correlation went up 
Lo pa {0.97 7: 


3.2 Privacy Considerations 


Of course, privacy assumptions bear on direct use of 
administrative lists and on linkages across them. Obviou- 
sly, ARC considerations about personal privacy will impact 
linkages of data from different sources for census purposes. 
In 1985, early results of the privacy research on linkage 
issues were presented (Scheuren 1985), followed by a great 
deal of other work, notably by the Census Bureau — 
reported on, for example, by Gates and Bolton (1998), 
Gates (1999) and Singer (1999). 

It looks reasonable, despite concerns, such as those in 
Scheuren (1997), that a careful introduction of greater and 
greater linkage will succeed in gaining wide acceptance as 
a policy. In fact, Statistics Canada is already experimenting 
with this now through their Survey of Financial Security, 
where respondents are given an opportunity to authorize 
access to tax and pension records instead of responding to 
selected survey questions (Statistics Canada 1999). In that 
survey, they are finding very high acceptance of the idea. 
This reference is just an example of the success that has 
already been achieved in direct uses of administrative 
records in Canadian surveys. For example, the option of 
accessing tax records has been standard in the Canadian 
Survey of Labour and Income (SLID) since May 1995. 
(See Statistics Canada 1993-1996.) 

While, in the United States, perhaps a sixth of the 
population will object, their views may not be listened to. 
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Despite this, it appears likely that there will be no outcry 
and the “taking” of these privacy rights will proceed with 
little incident. Fellegi (1997), in his opening address at the 
1997 International Record Linkage Conference, gave a 
sound analysis of this possibility. 


3.3 Access Considerations 


For the Census Bureau to do an ARC would require new 
legislation to mandate cooperation by various government 
agencies with the Bureau. Currently, except for the IRS, 
the Bureau may receive administrative data if other 
agencies choose to provide them; but, unlike the Statistics 
Act in Canada, there are no laws that require agencies to 
cooperate. Continuing this arrangement, of course, would 
be untenable if the Census Bureau were to try an ARC. 

The development and enactment of such legislation 
would provide the opportunity for a public debate on ARC 
ideas, something that must occur before an ARC could be 
done. In any case, legislation is required that would 
mandate cooperation with ARC research; otherwise, the 
Bureau may never get to do the required preparatory work. 
This suggests legislation “now,” if the Census Bureau is to 
prepare for an ARC in 2010. 


3.4 Technological Advances 


The assumption is that there will also be continuing 
advances in record linkage techniques, led by Bill Winkler 
at the U.S. Census Bureau and Martha Fair, among others, 
at Statistics Canada. The data mining “craze” can be antici- 
pated to lead to a very wide dissemination of these tech- 
niques. Large privately-held data sets will be increasingly 
combined and in an increasingly statistically satisfactory 
way. Tied to this growth will be a realization, as in 
Scheuren and Winkler (e.g., 1993 and 1997), that the goal 
of linkage is not mainly the matched data, but a way to 
combine disparate sources to produce information other- 
wise unattainable because of cost. 

There will continue to be an expansion of access to and 
uses of improving Geographic Information System (GIS) 
software, especially in small area estimation applications, 
both within and outside of Central Statistical Offices. We 
are entering a new “‘data-dense” world, where the amount 
of information available geographically is exploding. Much 
of this will be estimated, but the overall quality will be 
superb. Increasingly, isolated estimates (as in Schaible 
1996) will be replaced by sets of interlocked covariates that 
are coherent together. In all likelihood, market forces will 
drive this. The impact of cheaper and more powerful 
computing will mean that the handling of very large files 
and burdensome computations will not be seen as barriers, 
even in government — albeit there will be a lag in the public 
sector. 

If these scenarios happen, the world of high cost data 
gathering (like a conventional census) will increasingly be 
replaced by a world of frugal reuse of data — often 
automatically obtained (e.g., as predicted in International 
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Statistical Institut (1994). Widespread reuse applications 
will spur even better techniques and, combined with 
competition and cheap computing, will reduce greatly the 
power of data producers, including Central Statistical 
Offices. 


4. CENSUS 2000 SUGGESTIONS 


To develop an administrative record census, much 
research is clearly needed. This section sets out suggestions 
for administrative record research to be done as part of the 
2000 Census in the United States. These are grouped into 
process (section 4.1) and content (section 4.2) suggestions. 


4.1 Process Observations 


The 2000 Census “kicks off’ a decade of potential 
activity in getting ready for Census 2010. The observations 
made here on these possible activities fall under four 
headings: acquiring more administrative data, strengthening 
the safeguards on use, building cooperative arrangements 
for staff exchanges, and establishing a precedent of 
modifying existing administrative systems to enhance their 
information uses. 


4.1.1 Data Acquisition 


There certainly is a history of greater cooperation at 
census time by other government agencies. While there 
were many complications, it is no coincidence that the first 
IRS Individual Master File extract that the U. S. Census 
Bureau received was obtained for income year 1969 of 
returns filed in the decennial census year 1970. The 
occasion of the 2000 Census should be used (and has), 
therefore, to advance the 2010 agenda, by acquiring data 
and exploring how to use them to develop an ARC. 

The Census Bureau’s recent precedent in obtaining the 
full Social Security Number (SSN) application or Numident 
file from the Social Security Administration (SSA) is a 
particularly important example of the kind of acquisition 
needed, since the file contains age and other demographic 
data items on all persons who have SSNs. As Prevost and 
Leggieri (1999) discuss, there are many efforts underway 
which have led to the Census Bureau obtaining still more 
Federal record systems. 

Obtaining pilot access to state program records for the 
medically indigent (Medicaid) should be a priority; this is 
so despite the quality issues that such systems have. Make 
no mistake, however; a wholesale acquisition policy could 
be perceptually dangerous (i.e., violating the privacy 
assumption mentioned in section 3). Only systems for 
which there are clear, sustainable research objectives (and 
financial support) should be sought. 

It is important to point out that a census requires not only 
a full count of the population but must include correct 
geographic location at a point in time. For apportionment, 
state-level geography is required; for redistricting, geo- 
graphic location well below the state-level is required. The 
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implication of this for data acquisition is twofold. First, the 
administrative record files must attempt collectively to 
cover the “entire” population. Second, the files must 
provide good information on low-level geographic location 
at chosen points in time. Sometimes, even, files should be 
obtained just because they provide better geographic 
location for some part of the population (see Bye 1997 for 
more details.). 

IRS acquisitions might be of two types: small incremen- 
tal additions, as well as acquisitions of full-scale tax files 
already being received by the Census Bureau. The small 
additions are technical and procedural, involving working 
level staffs; the larger acquisitions have policy elements and 
need a different approach — with involvement at the highest 
level. 

Regularly since 1969, the Census Bureau has obtained 
an extract from the IRS Individual Master File system. Late 
returns, not filed in time for that extract, are becoming 
increasingly important and might be added to the data from 
IRS. Second, the prior year returns should also be obtained 
and introduced into the longitudinal samples recommended 
in sections 5 and 6 below. Marginally increasing item 
content to include more types of income is also suggested. 
Obtaining all or a large sample of information master file 
documents electronically is recommended. Getting all 
wage and social security information records, as has been 
done, is an exceedingly good start and certainly seems a 
plausible compromise for 2000, but interest and dividend 
records are important too. 

In any case, a major effort should be made to provide 
budget support in non-census years for sustaining this 
system — a problem that the administrative records program 
at the Census Bureau has had historically. It can be argued, 
until recently in fact, that the Bureau already has had more 
administrative record data than it had resources and people 
to use fully. 


4.1.2 Physical and Perceptual Security 


Clearly enhanced physical security of administrative data 
goes hand in hand with more data acquisitions. The Census 
Bureau recently established a secure restricted access 
environment for its demographic administrative records 
(Clark and Gates 1999). However, the Census Bureau must 
not stop there. An outside auditing firm should be hired to 
test the new physical security. In fact, such efforts should 
be an ongoing part of the Census Bureau’s new data 
steward role for administrative records. Assuring protection 
of the data is critical to the success of an ARC. It is 
important to recognize that linked administrative record 
databases are inherently more valuable than individual 
agency files; employees are subject to more temptation or 
at least the suspicion of being vulnerable. In fact, violations 
by IRS employees which came to light several years ago 
(see Scheuren 1995b), led to anti-browsing legislation 
specific to tax data. The Census Bureau must take every 
precaution to enforce such rules for all of its administrative 
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records. There is also a need to keep up public opinion 
survey research and conduct more focus groups with the 
various stakeholders and the general public, as well as with 
the Bureau’s own employees. The cost of maintaining 
massive administrative record systems involves both 
physical and perceptual maintenance of data security. And 
neither of these comes with a small price tag. 


4.1.3 Building Cooperative Arrangements for Staff 
Exchanges 


Human capital improvements are also key to any admi- 
nistrative record initiative. Professional statisticians outside 
the administrative agency too often think of just the data 
products they obtain rather than the system as a whole. 
Some would argue that the unfortunate phrase, “exploiting 
administrative data,” grows out of this narrow (and deni- 
grating) view. Whether the phrase is unfortunate or not, it 
reflects the hunter-gather phase in the use of administrative 
records for statistical purposes. That age is ending. 

The real (or new) goal should be to turn “administrative 
systems into information systems” (Scheuren and Petska 
1993). This means we need to move, continuing the ana- 
logy, to the next or agricultural stage in the use of 
administrative records. 

One way this new phase might be speeded up would be 
through something like an American Statistical Association 
fellows program. A sabbatical might be paid for by the 
Census Bureau and offered to operating administrative 
agency staff — perhaps from around the world. This could 
involve having IRS, SSA, and other administrative record 
stewards in residence at the Census Bureau for short 
periods. Among the goals would be to give them an under- 
standing of the importance of the information services that 
their administrative systems made possible. A by-product 
would be the invaluable insights the administrative agency 
staff could provide regarding assumptions about and use of 
their data for statistical purposes. 

More important still could be the reverse exchange — 
Census Bureau staffers going to work at the operating 
agency for an extended period of time. Unlike in Canada, 
which has a great deal of professional migration into and 
out of Statistics Canada to administrative agencies, the U.S. 
has very little. Anyway, more is needed. Think of the 
stimulus that this could give the statistical imaginations of 
the individuals sent. Deming talked about the need for 
systems thinking (Deming 1986). How better for people to 
obtain such thinking in connection with administrative 
systems than by such an experience, repeated periodically 
every few years. 


4.1.4 Establishing a Precedent for Modifying 
Existing Administrative Systems to Enhance 
Information Uses 


Improving the statistical data products derived from 
administrative systems can be achieved in many ways. One 
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is to add an item (and the associated burden) to an existing 
administrative system. Naturally, this is a two-edged sword. 
Obtaining residential addresses on tax returns, for example, 
as was done in 1981, would be an obvious example; how- 
ever, see Bye (1997), where another — and perhaps better — 
approach is advocated that would involve a direct followup 
for addresses that are clearly not residential. 

Another potential addition to the tax return might be a 
conventional (or landline) residential telephone number. 
While the growing use of cellular phones may make such 
numbers of only temporary value, they still might be worth 
obtaining. In the U.S. at least the shift to cellular has not 
been accompanied by the abandonment, yet, of earlier 
technologies. In any case, it can be predicted that the 
administrative uses of these numbers could more than pay 
for their value as a Statistical tool in record linkage during 
the census and later on in an ongoing survey program. 
Moreover, for listed numbers, there would be a valuable 
check on the address. 

While probably very hard to accomplish, changing third 
party wage reports (IRS Forms W-2s; T-4s are the Canadian 
counterpart) so that they have the date of the last pay period 
on them, would be an enormously valuable addition from an 
ARC perspective. The addition of the date of the last pay 
period covered could remove much of the ambiguity 
associated with multiple addresses on such documents. Of 
course, accessing the quarterly unemployment system wage 
records, through the U.S. Bureau of Labor Statistics, might 
be even better and would not increase existing burden. 

These suggestions, while perhaps feasible, will require 
a great deal of work to implement, since there are many 
other stakeholders and costs to consider. One observation, 
which Bye included in his 1997 report on a possible ARC, 
is to obtain from the U.S. Social Security Administration 
the mailing address files that are used by them to send SSNs 
back to the parents of newborns. Here the burden is slight 
and the value sizable, since it would give access to current 
addresses for families with new borne children. 

Clearly, some tradeoffs are easier to make than others. It 
is essential, whenever possible, is to find ways that better 
join an information purpose to an existing administrative 
one — thereby obtaining something of value for everyone. 


4.2 Research Suggestions 


There are many worthy research ideas that could be 
recommended. Two important ones are (1) obtaining SSNs 
on the post-censal quality check samples to be drawn, so 
that a triple-systems estimate can be obtained of the under- 
count; and (2) producing a limited ARC estimate during 
2000 for cross-checking with the official “counts.” For 
these to be fully effective the results from both are needed 
on the same schedule as the official Census Bureau counts 
and undercount adjusted estimates — due in December 2000 
and March 2001 respectively. 
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4.2.1. Triple Systems Estimation 


It has long been advocated (e.g., Scheuren 1995a) that a 
triple-systems estimate be attempted (Zaslavsky and 
Wolfgang 1993). The three systems would be the quality 
check sample, the census itself, and an amalgam of 
unduplicated administrative records. For triple systems 
estimation to succeed, all the matching needs to be of high 
quality. Without SSNs obtained in the quality check post- 
enumeration survey, the matching to administrative records 
will be a lot harder and, for doubtful cases, perhaps fatally 
ambiguous. People with multiple addresses and common 
names would be particularly challenging in the absence of 
SSNs. 


4.2.2 Concurrent Partial State Level ARC 


Even without attempting a triple systems approach, a 
concurrent limited ARC has potential in any post-census 
review. The need to have an immediate check on the 
statewide counts could be accomplished using the methods 
employed twice now by Sailer, Webber and Yau 1993 and 
Sailer and Weber 1998 and could be done quickly, if given 
a high enough priority. The needed IRS administrative 
records are expected to be essentially in place by the early 
fall of 2000 and could be processed by the Census Bureau 
on a flow basis. 

Specifically, it is recommended that the Census Bureau 
receive its normal IRS Individual Master File extracts 
monthly, so matching can begin early. Information docu- 
ments on wages earners and social security recipients could 
also be received on a flow basis from the Social Security 
Administration (even before being compiled at IRS). Many 
of the decennial census misses that are in the IRS data bases 
could well be earned income tax credit (EITC) recipients 
who may move. Continuous matching and sample checking 
will be key for finding such individuals. Certainly those 
EITC filers who use refund anticipation loans will need 
extra attention, if followup is going to be successful. 

There are, of course, many other worthy 2000 Census 
research ideas that might lay the groundwork for an 
eventual U.S. Administrative Record Census (see Prevost 
and Leggieri 1999). The two mentioned above seem, 
however, far and away the most important. For a recent 
paper on the use of administrative records in the Canadian 
Census, see Carter and McClean 1996. 


5. INTERCENSAL IMPLICATIONS 


Paradoxical as it may sound, to make revolutionary 
advances in the use of administrative records an evolution- 
ary approach is needed — especially in the intercensal 
estimates program. 


5.1 Annual Administrative Record Portion of ARC 


First of all, the Census Bureau should continue annually, 
on at least a sample basis, the ARC estimation of state totals 
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mentioned in section 4.2. Eventually, depending on data 
acquisitions and funding, these could be enlarged and 
deeper geography obtained. 


5.2 Large Longitudinal Administrative Sample 


Second, large longitudinal administrative record samples 
should be mounted. Following the Canadian example, the 
Census Bureau could begin with a straightforward longi- 
tudinal sample of tax return records, matched to the U.S. 
Social Security Administration’s Numident file, containing 
demographic information for all those with SSNs. Statistics 
Canada has long had a 10% longitudinal sample of T1 
returns (Leyes and Elsl-Culkin 1994), which in the U.S. 
would translate into a 1% sample, given relative country 
sizes. In fact, tying this longitudinal sample to the U.S. 
Social Security Administration's 1% Continuous Work 
History Sample (CWHS) could give it a very long (time) 
footprint, indeed. 

Eventually, this longitudinal sample might be extended 
across other Federal administrative systems (at IRS and 
SSA, but perhaps elsewhere too). A caution, though. The 
chore of matching changing administrative units over time 
may require more resources and patience than might be 
anticipated and so should proceed incrementally with 
smaller efforts, say the 0.1% CWHS for example — as has 
already been partially implemented (Czajka and Walker 
1989). 


5.3 Integrated Administrative Statistical Sample 


Scheuren (1979) has a much more ambitious 20-year old 
proposal for a set of interlocking administrative samples. 
Perhaps this should be re-examined and updated. His ideas 
involved both standalone efforts and efforts potentially sup- 
portive directly of traditional intercensal and current survey 
programs. Unlike the basic ARC concept, they would have 
expanded item content as their main objective, rather than 
complete or near-complete population coverage. They 
could also be used as starting points for various current 
survey efforts, as is the case now in the dual frame Survey 
of Consumer Finances (SCF) mounted by the Federal 
Reserve Board (Kennickell and Woodburn 1997). 


5.4 Transaction-Based System 


Fourth, for the long term, the current intercensal admini- 
strative records program should move, to the extent it can, 
from annual data systems with year by year matches 
towards direct transaction-based adjustments of the admini- 
strative counts. Consider, for example, an effort to follow 
a sample of SSNs over the decade. This clearly would be 
a move towards a partial population register. Despite 
possible public concerns about massive databases, having 
a statistical population register as a goal might be a good 
way to rationalize and prioritize intercensal activities. The 
goal of a household address register, updated transac- 
tionally, seems evident already in the work that the Census 
Bureau is undertaking with its improving Master Address 
File (MAF) system. 
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These ideas for decennial uses of administrative records 
can be intertwined with suggestions regarding the Census 
Bureau’s current survey program, as we will discuss below. 
In any case, much greater coordination (and positive 
synergy) between these two separate efforts is needed than 
has been true traditionally. See Alexander and Chand 
(1999) for the kind of effort that could really pay off. 


6. CURRENT SURVEY IMPLICATIONS 


The introduction of administrative records into the 
design and estimation of the Census Bureau’s continuing 
surveys seems a natural step towards an ARC. Some 
examples of how this can be done include: 


6.1 Sampling Frame Uses 


The American Community Survey (ACS) might be a 
natural starting point for an effort to use administrative 
records in a multiple frame context. ACS’ use of the 
Master Address File could be supplemented, for example, 
with tax return addresses and, potentially, Social Security 
recipient addresses — and for more than just updating 
addresses. 


6.2 Matching Poststratified Samples 


Some time ago Scheuren (1980) advocated that the CPS 
might be routinely matched to administrative records and 
that administrative controls be used as poststratifiers. The 
pilot for this was the 1973 Exact Match Study. The 
approach would be much more workable today. Work, like 
that of Thomsen and Zhang (1999), might form an 
up-to-date prototype. A related approach is found in 
Kennickell and Woodburn (1997). 


6.3 Linking Current Survey Program to Intercensal 
Goals 


Whether you start from an administrative frame or match 
back to an administrative list, each effort will provide 
information on coverage weaknesses in the administrative 
records that will make it possible for them to be better used 
in the intercensal period. Also, such joint operations will 
point out where to concentrate coverage research for 2010. 

An ongoing program embedded in the current survey 
effort to enhance already excellent demographic methods is 
essential (and seems to be under consideration by Prevost 
and Leggieri 1999). Resistance to adjustment can be worn 
down by repeated and open experiments over the decade, 
accompanied by continuous coverage and content impro- 
vements. A goal should be set to develop an annual fully 
projected ARC beginning no later than 2005. Funding for 
a large enough sample to supplement administrative records 
ought to be sought, perhaps through the American 
Community Survey. Frankly, though, this budget strategy 
may require that the Census Bureau promise to make major 
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savings in 2010 — a risky proposition but necessary 
psychologically and fiscally. 


7. ADDITIONAL 2010 RESEARCH 
IMPLICATIONS 


Specific suggestions for additional 2010 research are 
hard to make, since much will depend on how successful 
the Census Bureau is in making their other administrative 
record uses serve multiple purposes. Nonetheless, two 
observations may be worth highlighting in any case, since 
they are not mentioned above. 


7.1 Tracing Sample from 2000 Census 


A large tracing sample should be followed over the 
decade. The starting point might be the post-censal quality 
check sample, after matching it to administrative records 
and augmenting it with cases, to the extent feasible, found 
only in the census or only in an administrative record. The 
kind of administrative steps outlined above would be 
followed, plus the actual use of tracing methodologies in at 
least a subsample. Fieldwork would be necessary to sort 
out all the problems in “cross-footing” satisfactorily from 
one census to another. Most of the work would be done by 
matching in successive waves of administrative records (in 
a manner similar to that touched on in section 5.2). Again, 
a big issue would be privacy concerns (as set out already in 
subsection 3.2). 


7.2 Special Censuses 


To prepare for 2010, there will be a need to conduct 
special censuses that begin with administrative records and 
attempt to complete them using sampling. In structure, 
these would not be very different from the pretests done 
before every census. However, because the ARC paradigm 
is new, there would need to be more tests and, especially, 
more testing time. The first 2010 tests should be built into 
the 2000 Census and should continue uninterrupted through 
the decade. Early on, general feasibility issues need to be 
addressed. For example — 


7.2.1 Developing a way to efficiently use an administra- 
tive amalgam of addresses and individual names as a frame, 
so that addresses not on the administrative list are over- 
sampled. 


7.2.2 Developing a way to efficiently handle multi-unit 
dwellings, since the administrative addresses usually do not 
have apartment numbers. (It may be that some of the samp- 
ling will have to be independent of the lists, as in the census 
quality check sampling, then matched-in after the fact.) 


7.2.3 Developing an approach for dealing with problem 
populations (e.g., low-income minority children) will need 
special attention (Medicaid data, mentioned earlier, might 
be of help here but this is unclear). 
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7.2.4 Developing a means to deal with problem locations 
in the 2000 Census (e.g., inner city neighborhoods) may 
need to be looked at individually. 


The notion of designing these special censuses as a 
rolling sample (e.g., Kish 1990) would allow — say, by the 
end of 2005 — a way to obtain a “gold standard” for 
evaluating the ARC approach that evolves. Note, there is no 
reason that two or more methods cannot be tried simulta- 
neously to speed up the process of testing. Indeed, it may 
turn out that the 2010 Census should employ multiple 
approaches simultaneously — including sampling. Given 
the diversity of circumstances that exist, multiple 
approaches may prove inherently better than any single 
approach. 


8. A SUMMARY AND SOME POSSIBLE 
PRIORITIES 


The U.S. Census Bureau’s major efforts (e.g., Prevost 
and Leggieri 1999) to research an administrative record 
census are deserving of applause. Even though the Census 
Bureau is now well underway in its ARC research, it still 
might be of value to reiterate key points and priorities. 


8.1 Constancy of Purpose 


Deming, in setting out his famous 14 points, lists 
“Constancy of Purpose” or, in the words of the old Negro 
spiritual, “Keep your eyes on the prize.” With all the extra 
challenges of running a census in 2000, keeping focused on 
the future may be the hardest task facing the excellent staff 
assembled. Temptations to cut budgets or reassign key 
people must be avoided. After the decennial census, 
separate budgeting should be sought and the sums involved 
will need to be large. Thinking that the big efforts are 
connected with the 2000 Census and could then slack off 
for a while is just flat wrong. The research effort will need 
to grow and grow. 


8.2 Environmental Scan 


While the responsibility for the official census count will 
not change any time soon (if ever), census-taking will no 
longer be the monopoly it has been. Ways to integrate inde- 
pendent information sources will be essential to how the 
Census Bureau’s success is measured. Levels of account- 
ability can be predicted to increase. The Connecticut case 
study, discussed in section 3, is just one example. 

What is crucial to see is that, ironically, central statistical 
agencies — including places like the Census Bureau — could 
well be left behind in the information age. Census Bureau 
market share in the information sector has been falling for 
decades and, ceteris paribus, a steeper drop is quite likely 
during the next ten years, given the slow pace of change 
inherent in a government agency. The Census Bureau’s 
administrative record research and its continuing emphasis 
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on being the leader in key information technologies could 
mitigate this trend, but probably not reverse it. 


8.3 Assumptions 


The privacy assumptions are the ones to worry about the 
most, as leaders at the Bureau, like Gates, have long been 
saying. Careful watching and listening are needed. The use 
of an advisory Institutional Review Board, not mentioned 
earlier, might be considered — to provide independent over- 
sight with the public’s interest in mind, especially on record 
linkage. Alternatively, now that there is a Census Moni- 
toring Board, the Board might be the natural place to focus 
advice on handling privacy concerns and in doing priority 
setting. 

The real concern is not that the Census Bureau will pro- 
ceed rashly, but that it might be too timid. To quote 
Emerson, “Be bold, be bold, be not too bold.” Certainly the 
Census Bureau should seek legislation like the Statistics 
Act in Canada, in order to assure the cooperation of admini- 
strative agencies in providing data for an ARC. As already 
noted, the development and enactment of such legislation 
would provide the opportunity for a public debate on ARC 
ideas, something that must occur before an ARC could be 
done. 


8.4 Suggestions for 2000 Census 


The inclusion of the SSN question in the quality check 
sample for 2000 is crucial to building the bridge from old to 
new. The suggestion to produce a simultaneous partial 
ARC estimate will help not only in testing an approach that 
will be needed in 2010, but also in validating both the ARC 
and the census itself. Regarding other administrative record 
research, carpe diem — seize the moment — especially the 
opportunity to acquire key files (an effort already well 
underway according to Prevost and Leggieri 1999) and to 
strengthen long-term partnerships that build human capital. 


8.5 Intercensal Steps 


Creating a greater positive synergy between the current 
monthly and annual survey programs and the intercensal 
estimates program is key too. Transforming the intercensal 
estimates effort to one that 1s transaction-based, rather than 
essentially cross-sectional, would be the other major 
priority. Integrating special census results would also be 
crucial. 


8.6 Current Survey Steps 


The opportunities for administrative record applications 
in the American Community Survey are excellent, if they 
continue to be grasped quickly enough. However, the time 
from inception to results for new census surveys is often too 
long. Censuses have cycle times that extend arguably over 
more than ten years. The introduction of a new frame in the 
Current survey programs has been growing. Whatever is 
done after the next census, it needs to be a lot quicker than 
after the last. 
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8.7 Additional Possible Steps 


Of the two suggestions in the last section, the tracing 
sample has the most appeal as basic research. The 
Canadian experience can help here, but payoffs are un- 
certain. Tracing would help in addressing immigration 
flows, both legal and illegal. Obviously, as proof of con- 
cept and to make the ARC operationally feasible, special 
censuses will be critical. The budgeting will have to be a 
lot heavier in the early years of the decade than historically 
has been the case for the census pilots and dress rehearsals 
done in the 1980’s and 1990’s. Planning for the continuing 
research after 2010 should be a priority, as well, and might 
begin now and be revisited at least annually. 


In the March 26, 1999, issue of Science (Cohen 1999), 
there is a news item entitled “The March of Paradigms.” It 
tracks the growing number of scientific papers that use the 
phrase “new paradigm” in their titles or abstracts. It goes 
on to state that — 

Many of these claims, however, may not be quite the 
kind of developments science philosopher Thomas Kuhn 
had in mind when he made the term new paradigm famous 
with his paradigm-shifting 1962 book, The Structure of 
Scientific Revolutions. 

Despite this caution, the change to a partial ARC does 
qualify as a paradigm-shifting event and should be studied 
from that perspective. In this connection, compliments are 
due to all those who have already attempted and achieved 
it around the world. Best wishes to the U.S. Census Bureau 
in their research on it now. 
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A New Look at Confidence Intervals in Survey Sampling 


V.P. GODAMBE and M.E. THOMPSON’ 


ABSTRACT 


In survey sampling, as in other areas of statistics conventionally, confidence intervals for a parameter are often obtained 
by inverting the distribution of some approximate pivotal quantity, {(estimate — parameter)/(estimated variance)’*}. 
Alternatively, estimating function theory suggests a more direct method of constructing a pivotal quantity and hence 
confidence intervals. These alternative confidence intervals perform much better than the conventional ones in simulation 


studies. 


KEY WORDS: Confidence intervals; Estimating functions; Optimality; Stratification; Survey sampling. 


1. HISTORICAL INTRODUCTION 


The topic of confidence intervals was first discussed in 
Neyman’s (1934) well-known paper read before the Royal 
Statistical Society. The paper was on survey sampling. Yet 
Neyman’s discussion did not arrive at the actual construc- 
tion of confidence intervals for a survey sampling setup. 
This may have been due to the fact that at the time the 
distinction between the parameters of a survey population 
on one hand and a hypothetical population on the other was 
far from clearly understood (Deming 1950, Godambe 1976, 
Godambe 1997, Smith 1997). In hindsight, one can say that 
Neyman’s discussion of confidence intervals related prima- 
rily to the parameters of a hypothetical population. A subse- 
quent publication of Neyman (1937) explicitly demon- 
strated how confidence intervals could be obtained from a 
pivotal quantity, a function of observations and the para- 
meter of interest having a fixed (known) distribution. The 
availability of such “‘pivotals” (or of approximate pivotals) 
for certain hypothetical populations characterized by a few 
scalar parameters can be easily demonstrated. On the other 
hand, to characterize a survey population of size N one 
needs a parameter of N dimensions (Basu 1958, Hajek 
1959). Under this condition, in general, no nontrivial 
function of the observations and the parameter of interest 
can be exactly pivotal under the distribution induced by a 
probability sampling design. 

Section VI of Neyman’s 1934 paper is entitled 
Appendix. In addition to other things, the Appendix 
contains Note I, dealing with confidence intervals, followed 
by Note II, “The Markoff Method and Markoff Theorem on 
Least Squares”. The “Theorem” mentioned here, using 
modern terminology, is the Gauss-Markoff theorem on 
unbiased minimum variance estimation. Now it is true that 
the “variance” of an unbiased estimator, if known, can 
enable one to construct an approximate confidence interval 
by assuming an approximate normal distribution for the 
estimator: (estimator — parameter)/(variance)” is an approxi- 
mate pivot. This however is of no avail, for the “variance” 


| 


just mentioned is never known in a survey sampling situa- 
tion. A common practice, as seen from publications on the 
subject (e.g., Chaudhuri and Vos 1988), is to substitute an 
“estimate” for the unknown variance. Here the basic 
question, generally not discussed in the literature, is: which 
of the many estimates of the variance would provide a pivot 
(or approximate pivot) leading to a set of plausible confi- 
dence intervals? This problem for a hypothetical population 
with an underlying parametric model is resolved utilizing 
the observed Fisher information (Efron and Hinkley 1978). 
A generalization of the observed Fisher information, for a 
semiparametric model, provided by the theory of optimal 
estimating functions (Godambe 1985, Godambe and 
Thompson 1986) leads to an answer to the question just 
raised, within the context of survey sampling. 

So far the topic of “confidence intervals in survey 
sampling” has been considered within the framework of 
“estimating functions” in only a couple of papers. Histori- 
cally, Woodruff (1952) presented an earliest demonstration 
of confidence intervals for “position measures” of a survey 
population, utilizing estimating functions informally. This 
argument has been commented on in detail by Godambe 
(1991). The second paper is by Binder and Patak (1994). 
The first author, in an earlier publication (Binder 1983), 
made informal use of estimating functions for complex 
surveys. There, however, the confidence intervals pre- 
sented were of more conventional type. Both the paper by 
Binder and Patak (1994) and the present paper are based on 
the theory of estimating functions. The basic difference 
between the two is that the latter, in an essential manner, is 
tied to the optimality criterion of estimating functions. This 
optimality criterion relates present survey populations to a 
semiparametric superpopulation model, albeit very flexibly. 
This relationship, as the present paper demonstrates, 
provides guidance in the choice of estimating function and 
the implied confidence intervals to be used for a given 
problem. Apart from this reference to a superpopulation 
model, the confidence intervals presented in this paper are 
design-based. Again, both papers, Binder and Patak (1994) 
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and the present one (section 5), discuss the important case 
of “nuisance parameters”. However the problems treated in 
the two papers are different and there is no overlap in the 
results. 


2. MODEL-ROBUST CONFIDENCE 
INTERVALS 


We begin the discussion by talking about the estimation 
of a single parameter 8 of a superpopulation model. 
Suppose that, under the model, the observations y, for i in 
the sample s are independent, with 


RGN als) Wen Va NRG 


eg, (y,,0) =9,,i€s, (2.1) 


where the g, are elementary estimating functions. 
We can obtain “‘model-robust” approximate confidence 
intervals for 8 by inverting 


{x OLE dopo)" 


tes bes 


wes (2) 


where z is a percentile of the M(O, 1) distribution. 

A very general version of (2.2) was put forward as an 
approximate pivotal, in a framework of stochastic pro- 
cesses, by one of the authors (Godambe 1985). Previous 
versions of (2.2), by Fisher (1925), Efron and Hinkley 
(1978) and Royall (1986), all used the numerator (estimate 6- 
parameter 9); the denominators in all three cases were the 
square roots of different estimators of the variance of 
(8 — 0). For an early investigation of properties of (2.2), see 
Mach (1988). A later study was carried out by Vinod 
(1998). 

There are several parts to the rationale for the use of 
(2:2): 


(ayy ae g; (y,,9) is a model-unbiased estimator of 
Var()),., 8;(9;, 9)), regardless of the form of fo. 


(b) being analogous to the observed information, 
Ying; (9) can be thought of as conditionally 
unbiased, given important aspects of the sample 
structure; more specifically, Yc 8, (9; 9) is the 
“variance” of the numerator “conditional” on the same 
partitioning which underlies the optimality of the 
numerator (Godambe 1985; Godambe and Thompson 
1986); 


(c) if the model is misspecified, Ye y,, 9) will 
incorporate to some extent the bias of the estimating 
function as well as its variability; 


(d) if y,,i€s are iid. N(0, 0°) then 


ye (YG) 


és 


A oy, Oey 


is closer to M(O, 1) than is the t-statistic, since Var(t) = 1, 
and the kurtosis of t is 3-6/(n + 2); confidence intervals for 0 
based on inverting |t| =z are 


BS (2.3) 


n=1 ZS, 
jae in 


where s\ is the sample standard deviation. 

Suppose now that @ is a vector-valued parameter, and 
that y(@) is a scalar parameter of interest. Suppose that the y, 
are independent under the superpopulation model, that 
g,(y;, 9) has the same dimensionality as 9, and that the 
unbiased estimating equation system 


yore. 0) 0 


1€s 


ve (2.4) 


(2.5) 


arises from the minimization of a scalar objective function 


De) G;(y;, 9). 


i€s 


(2.6) 


Estimation of y(®@) could proceed by “profiling”, that is 
by finding @(y) which would minimize (2.6) for a fixed 
value y(@) = y. Then the estimating function for y would 
be one which found to minimize 


Y G0, 0(y)). 


i€s 


The vector form of the system for finding 8 (y) would be 


oy 
ne ., 9) -~rA— =O, 
X 7 eke) 
where A is a (scalar) Lagrange multiplier, together with the 
constraint that y(®) = y. There is a one-to-one correspon- 
dence between wy and A, with A being 0 when y is ty. The 
estimate ) will solve 


(25h) 


Y 8,60; (y)) = 0 (2.8) 
1és 
or a linear combination of its components. 
If a is a vector with the dimension of 8, and 
a*)) 8,(y,,8(y)) =0 (2.9) 


i€s 


is a (possibly suboptimal) estimating equation for Wj, it 
seems reasonable to obtain approximate confidence inter- 
vals for y by inverting 
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i€s 


rer 1) 


Y 8,(5;, 8 (y)) g/ (y;, 9(W)) 


iés 


ae a 


Remarks: 

(i) The estimating equations (2.8) and (2.9) are only 
approximately unbiased, and their terms are only 
approximately independent. Thus the use of (2.10) will 
be more easily justified theoretically for large samples. 


(ii) Even if the system (2.5) does not arise from the 
minimization of an objective function (2.6), the process 
of estimation of y through (2.7), (2.9) and (2.10) can 
still be carried out, and is still meaningful. 


(111) When @ (y) and y (y) are finite population parameters 
analogous to @ and wy, the same process can be carried 
through, with (2.10) replaced by 


a’) £0018 WO)| 
2. 


i€és 


Fit) 
v(x, 9 (w(y))) 


where y= O20 ss is a sample, ce 
{(i, y,):1€s}, and the denominator is a suitable 
estimate of the standard deviation of the numerator. 
(See section 3 and 7 for notation and elaboration.) 


Indeed, the purpose of this paper is to explore the 
adaptation of (2.2) and (2.10) and their rationale to the 
survey sampling context. For example, suppose we have a 
finite population of size N, that ips Vee dN care qeiecls 
N(®,6°), and that we wish to estimate, or equivalently 
“predict”, the finite population mean Y =)", y,/N from the 
observations in a sample. The same distribution theory as in 
(d) above establishes that 

E n“*b(y -Y) 
i == (2.12) 
(n-1)s° +b?(y - YY 
where b=(l/n-1/N)*, is approximately (0, 1). 
Inverting |t| =z gives rise to “prediction” intervals for Y 


of form 
2 | 1 n-1 
see SS 9 2 : 
n N ' n-2z- 


Under the assumed model, these will have improved 
prediction properties over the usual simple random 
sampling based confidence intervals 


ok) 


(2.14) 
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When the sampling design is simple random sampling, 
a sampling unbiased estimator of the sampling variance of 
n”’b(y -Y)is 


N as 
—— Fela) Did5 
a » 0, -Y) (2.15) 
When N is large, the pivot t of (2.12) is approximately 
n”’b(y -Y) 
‘ie a 
a ar V 
qrmgess Owed 


which is approximately 
y QO; - Y) 
bes ; 
n ers ME (y.-Y/ 
ee ah : 


i€s 


(2.16) 


Thus, in summary, the pivot of (2.12) takes a form 
similar to that of (2.2), with @ replaced by the finite 
population parameter Y. The pivot of (2.12) has both a 
prediction interpretation and a design based (simple random 
sampling) justification. 


3. OPTIMAL ESTIMATING FUNCTIONS FOR 
SURVEY POPULATIONS 


Quite commonly, estimation for survey populations is 
design based as well as model based. Godambe and 
Thompson (1986) have proposed the following framework 
for optimal estimation of finite population quantities which 
correspond to superpopulation parameters. 

Let 0 be a superpopulation parameter and let @,, ..., Py 
be independent elementary estimating functions such that 
EQ: (;, Oy = Ofori Ls eve Let iy =Ays, -2. Vy) be the 
population vector of responses, and let @(y) be the finite 
population parameter which is the solution in @ of 

N 
Y 9,(5;,9) = 0. (3.1) 
i=l 

We think of 6 and 8(y) as being associated parameters, 
one of the superpopulation and one of the finite population. 
We take them to be real for simplicity. 

Suppose p ={ p(s), s€S} isa sampling design, or proba- 
bility function on S, the collection of samples or subsets s of 
{1,...,N}. The sampling design p induces a distribution on 
the outcome x , = {(i,y,):1E 5}. Let E, denote expectation 
under the sampling design. A sample estimating function is 
a function g(7,,0), and an estimating function strategy 
(g, p) is taken to be unbiased if 


N 
E,8,(%9) = D9, 8) (3.2) 
i=l 
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for all y,®. Point estimation for 6(y) proceeds by finding 
the solution 0. of 


2.00) —«: 


Among unbiased strategies (g, p)(p fixed), strategy (g *, p) 
may be taken to be optimal if 


N 
cE, (8. (Xe OMe yo (Yj 0))? 
i=] 


(3,3) 


(3.4) 


is minimal. It was shown by Godambe and Thompson 
(1986) that the optimal estimating function is given by 


2) (VO ae ey On) 


i€s 


(3:5) 


where g; (y,,8) = 9,(,,9)/a, and a, is the probability 
(under p) that 7 is included in the sample. Note that the 
optimality of g, in this sense is independent of the variance 
structure {eo? (y,, 9)}. The unbiasedness constraint (3.2) is 
a very strong one, but also an important one in the survey 
sampling context. 

Suppose now that we have a sampling estimating 
function g (x, 9) = )),.,8;(;, 9) which satisfies (3.2), and 
which may or may not be optimal for point estimation of 
Q(y) under criterion (3.4). Because g (x, 9) is also an 
estimating function for 8, the inversion of (2.2): 


Done 0) 


i€s 


soe 2 0,8) 


should provide confidence intervals for @ with good 
coverage, under the superpopulation model. 

When 0(y) is the object of inference, it is tempting 
again to take a prediction approach, and to consider 
inverting 


St 


Ee 8(y)) 
ith in eee (3.6) 


Vn (Xg2 9) 


where 


age (X > 0(y)) a ( De 8s 8») (57) 


ies 


Alternatively, we may take a design-based, inverse testing 
approach, and consider inverting 


D 8,0, 8(y)) 
1ES =z (3.8) 


Vp (X59) 


where 


EV (%,9) =E,) 5 Bie 8) — 9-098) G8) 


(es i€s 


For a well chosen design which corresponds. with 
appropriate elements in the model, these two approaches 
should give results which are close to one another; and the 
intervals for 8(y) will be different from the intervals given 
by (3.6), by an amount which takes into account the 
finiteness of the population. 

Similar considerations apply for a multidimensional 
parameter 9(y). However, in the next section we will 
illustrate the general approach with a one dimensional 
parameter, in the somewhat artificial situation of strata with 
a common mean. 


4. STRATIFIED SIMPLE RANDOM SAMPLING 


We follow the usual notation. The labelled population 
of N individuals (units) is denoted by P = {7:7 = 1,...,N}. 
The population ‘P is divided into k nonoverlapping strata P 
of sizes NioJ =1,...,k. A variate of study defined for the 
population ‘P is y, assumed to be scalar for simplicity. For 
the individual i, y= y,,i = 1,...,N. The population vector 
y =(),,+-yy). To obtain an estimate for the population 
mean Y = ee y,/N a sample s of size n is drawn from P, 
with a stratified simple random sampling without replace- 
ment design. The samples from different strata P, are 
denoted by s., s,| = Nid =1,...,k; ¥n.=n. Further, Y, and 
y, denote the means of y in stratum P. and sample s 
respectively, j = 1,...,k. Thus 


k 

ee X N, YIN. (4.1) 
Analogously we define 
k 

we » N,¥,IN. (4.2) 


If the components of the population vector y = (),, ..., Yy) 
are assumed to have been drawn independently from a 
superpopulation with acommon mean €(y,) = 0,7 = 1,...,N 
but possibly different variances €(y, - 0), i = 1b serial 
if we regard Y as the solution of yr @;(y,, 9) = 0, where 
9; (y,, 9) = y, - 8, then the optimal estimating function for 
estimating the population mean Y in (4.1) is given by 


(4.3) 


(Godambe and Thompson 1986; Godambe 1995). This g 
has the form of g, (x,,9(y)) where g, is given in (3.5). 
Thus the optimal estimate of Y is given by y, the solution 
in Y of the equation g =0. We will call superpopulation 
models defined only by first few moments, such as the 
model just mentioned defined by e(y,) = 0,1 =1,...,N, 
semiparametric, in contrast to the fully parametric models 
specified by the density functions. 

The “optimum estimating function” for a semiparametric 
model has many statistically important properties in 
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common with the “score function” for a parametric model. 
Hence in the semiparametric model the optimum estimating 
function is called a quasi-score function. (Godambe 1985; 
Godambe and Heyde 1987; Godambe and Thompson 
1989). For a parametric model, one can construct confi- 
dence intervals using the Fisher information (defined as the 
variance of the score function), or its natural estimate the 
observed Fisher information. Similarly in case of a semi- 
parametric model the confidence intervals can be obtained 
from the quasi-score function i.e., the optimum estimating 
function, and its estimated variance. In the survey context, 
although the optimality criterion is tied to the super- 
population model e(y;)=6, the properties of the 
confidence intervals given below are mostly if not entirely 
design-based. 

The design-induced variance of the optimum estimating 
function g in (4.3) is given by 


2 A fees 
Vig) =) | —-—|—— © 6, -Y,)”. 
x oe Nj a 


(4.4) 


Further, since our parameter of interest is Y, the 
unobserved y,’s and the stratum means Y, in (4.4) are 
nuisance parameters. The superpopulation model under- 
lying the estimating function g in (4.3), namely 
e(y,;) =8,1=1,...,N, suggests that for large strata sizes N, 
we may ignore the differences Y,= Y, and replace % by 
Y j=1,...,k in (4.4). (Models for which the differences 
Y.= Y cannot be ignored are discussed in section 7.) With 
this replacement, an estimate of the variance V(g) in (4.4) 
can be given by 


DES ee) 945) 


(N, - ay N; ies, 


ea. 


Yo; 3 R=V,+R (4.6) 
(n; zy 


where yj is the mean of the sample Sp ,J =1,...,k asin (4.2). 
In the right hand side of equation (4.6) the first term is 
O(1/n)) while the second term R is O(1/n, ar Hence for 
large samples, ignoring the term R, V in (4. 5) reduces to the 
conventional estimate V,.. This leads to the conventional 
confidence intervals for Y based on the inversion of the 
distribution of {g/ (V, )7}. However when the sample sizes 

NJ = = 1,...,k are not very large, estimating function theory 
suggests confidence intervals for Y based on the N(O, 1) 
asymptotic distribution of {g/(V)?}. 

For a stratified simple random sampling design, let the 
estimating function g in (4.3) be written as 


=) 8; (4.7) 


1és. 
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where as before s denotes the sample (of individuals drawn 
from all strata). Then, for large n, and N., ignoring the 
finite stratum correction, and replacing (n; =1)' by 
Ni»J =],...,k in (4.5), we have 


5 _ a 
V(g)= Ve) =a -L wae Ye (48) 


HES nj 1€s 


It is easy to see that in view of simple random sampling 
from each stratum (again for reasonably large n, and 
NI = =1,...,k) the sampling distribution and the super- 
population distribution of the quantity {g/(V, )*} would 
tend to be the same, namely approximately N(O, 1). We 
have already identified the optimum estimating function g 
with the quasi-score function. Further, just as for a para- 
metric model the inversion of the distribution of {score 
function/(observed Fisher information)*} provides asymp- 
totically the shortest confidence intervals, for the semi- 
parametric model {g/ (V, )*} provides asymptotically 
shortest confidence intervals (Wilks 1938; Godambe and 
Heyde 1987). 

The above analysis can be easily extended to include a 
covariate. Suppose for the population ‘P = {7:7 = 1, .., N} 
in addition to the variate y under study is defined a 
covariate x, again for simplicity assumed to be a scalar like 
y. For the individual 1, x =x, is known, i = 1,...,N. The 
superpopulation model e(y, - pe =( underlying the fore- 


going discussion is now extended to 
e(y, - Ox,) = 0,7 = 1, ..., N. Along the lines of (4.1) and (4.2) 
we define 
= k —_— 
X=)) N.XIN (4.9) 
Jel 
and 
k — 
x= )) Nx/N (4.10) 


where X, and x. are the means of x in stratum ‘P. and 
sample s. respectively. For estimating Y/X, the solution of 
a Lop Qx,) = 0, the optimal estimating function g in 
(4.3) is now replaced by 


(4.11) 


As before, the solution of the equation g = 0 provides the 
optimal (or approximately optimal) estimate for Y. Again, 
the superpopulation model e (y, - 0x,) =0,1=1,...,N, 
suggests taking 
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when the stratum sizes N; are large, and ignoring the 
differences 


(4.11): 


V(g) = 

2 oH PN Ly Y ) 
a — y; =X; é ‘ 

fi NB ling, WPAN eb eee ih Ka') POE 


(Models for which the differences Y,- (Y/X)X, cannot be 
ignored are discussed in section 7.) Note that (4.12) reduces 
to (4.6) if x, =constant, 7 = 1,...,N. Again, according to 
estimating function theory, the confidence intervals for Y 
can be obtained by inversion of the sampling distribution of 
the (approximate) pivot g/{ V(g)}%, the distribution 
asymptotically is N(0,1). 


5. STRATIFIED CLUSTER SAMPLING 


In this section we assume the whole population of 
individuals (units) is divided as before into a number of 
nonoverlapping strata. But now, in addition, each stratum 
is divided into a number of nonoverlapping clusters of 
individuals. The first stage sampling consists of drawing 
from each stratum a small number of clusters with simple 
random sampling. Next, from each selected cluster a 
sample of (ultimate) individuals is drawn, possibly with a 
multistage “sampling design”. This sampling design is 
“specific” to the “cluster” and does not depend on what 
other clusters have been selected at the first stage of 
selection. 

To accommodate the above situation in our framework 
we use the following extension of the previous notation. As 
before 7 denotes the “individual”. A “cluster” is denoted by 
c. The elements of strata P., 7 = 1, ..., k are now clusters c; 
the stratum ‘P. consists of N. clusters, j = 1,...,k. A sample 
of individuals from cluster c is denoted by s © and the set of 
clusters selected from the stratum P. is denoted by Sis with 
|s,| =n, and |P| =N,,j7=1,...,k. Otherwise we use the 
same notation as before. Again, the superpopulation model 
as before is €(y, - Ox) = 0 for all individuals 7 in the 
population. 

Now suppose the sampling design for the cluster c is 
such that (once the cluster is selected) the probability of 
including an individual icc in the sample is ;. Hence if 
the cluster ceP., the unconditional inclusion probability of 
Lis 1; (n,/N;)- Thus if the population means of y and x are 
denoted by Y and X respectively, the optimal estimating 
function for Y or (Y/X), with respect to the super- 
population model just mentioned, is given by replacing g in 
(4.11) by 


6:1) 


Further, if Y, and X, denote the cluster means of y and x 
respectively the optimal estimating function (Godambe 


1995) for estimating Y. or (Y,/X_) is obtained from (5.1) as 


(5.2) 


LDS Se |p 


ies © 


Now we assume that for each cluster c, the sampling design 
is calibrated; that is for each sample s‘° of non zero 
selection probability, 


where Xx. is the cluster total of x. For such calibrated 
sampling designs, if ¥- denotes the corresponding estimate 
of Y , the cluster total of y, then from (5.1) we have 


63) 


kN, pai 
ge Sys Se r-(2} x1. 

N j=l nN. ces x 

J 3 
With fairly straightforward algebra it can be shown that the 
variance of g in (5.3) satisfies 
2 
“)}43) 
N 


eee N? , 
ve) EE Tk 
iN? Je hw ces, 
J 
(See Appendix.) Hence if all strata sizes N; are large 
enough we have 


jt ene P 
N° j=1 


nj ces ij 


<i] ~< 


2 
x, (5.4) 


><| <I 


A natural estimate of the variance V(g) in (5.4) is given by 


(5.5) 


the confidence intervals for (Y/X ) or Y can be obtained as 
before, by inverting the sampling distribution of the appro- 
ximate pivot g/y{V(g)} ; asymptotically the distribution is 
N(O, 1). 

The confidence intervals discussed above do not require 
the knowledge of the sampling design for any cluster, 
provided at the cluster level the estimates Y, of Y . are 
available for ceés.,j=1,...,k. These confidence intervals, 
though valid, cannot be expected to be as efficient as the 
ones based on the entire data, if and when available. 
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It is important to distinguish the estimates W(g) in (4.5), 
(4.12) and (5.5) (of the variances V(g) of the estimating 
function g) from conventional estimates of estimator 
variances. The former generally in an essential way contain 
the parameter of interest Y or Y. The latter by definition 
must be free of the parameter. We might conjecture that the 
distribution of g/¥{V(g)} would generally tend to its limit 
faster than the corresponding distribution of 


(¥- Y)/ {estimate of the variance of y}%. (5.6) 


For unlike the {estimate of the variance of Y} in (5.6), Vig) 
would be a sum of independently distributed random 
variates, and would be stabler. 

The estimate VW(g) in (5.5) depends on the sample 
variates only through the estimates of the cluster totals or 
means; a property also shared by the traditional estimate of 
the variance of Y in (5.6). In connection with the latter, 
early references can be traced back to Mahalanobis’ inter- 
penetrating samples in the thirties, while more recent 
examples are Sarndal, Swensson and Wretman (1992), 
Yung and Rao (1996). 


6. BOOTSTRAP VARIANCE ESTIMATION 


In this section we present bootstrap versions of the 
estimates of the variance Wg) given in (4.5), (4.12) and 
(5.5). We illustrate the method in the case of (4.12) in some 
detail; the estimates (4.5) and (5.5) could be obtained as 
special cases. 

Our bootstrap method is different from the usual in the 
sense that we obtain the bootstrap variance of the estimating 
function g in (4.11), holding the parameter value (Y/X) in 
it fixed. As before our data consists of (y,, x; ): lES,, foe ts Cy 
The stratified resampling is done as follows. A number n. 
of draws are made with replacement from 
): 1ES; ,jJ=1,...,k. If q denotes a generic draw, a 
generic bootstrap value g,, of the estimating function g is 
given by 


(6.1) 


Denoting by E, and V, the bootstrap expectation and 
variance respectively, we have 


Be ,) = 8: 
And 
V,(8,) = E_(@,) ~ {Eg(g,)}? =Eg(ep)-8? (6.2) 
In (6.2), 
E,(g,)=A+B+C (6.3) 
where 
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=] =] 
stratum j stratum j’ 


k N2 ss y _)? 


Now because of the assumption that the variates y, are 
drawn from a superpopulation satisfying e(y,- 9x,) = 0, 
C= eee, NG inthe ma expression for (B + C), yj = (Y/X) 
oe fp Sky * Therefore in(63): for large 
n,j=l, 


E,(g,)=A +82. 


That is in (6.2) 


k a y) 
Va cs A 
Va(8p) = 4-yo ere 5 [5 z “| Ws) (6.4) 
=] n, IE, 
in (4.12). 
The variance estimate V, (g) in (4.8) is obtained as a 
special case of (6. 4) when x. = 1,/ = 1,..., NM. Similarly the 


variance estimate Me) in (5. 5) is Beeied by replacing in 
(6.4) individual “7” by a cluster “c” and correspondingly 
replacing y, and t by Yc and X_ respectively. 
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7. STRATA WITH DIFFERING MEANS 


The optimality of the estimating functions g in (4.3), 
(4.11), and (5.3) depends in an essential manner on the 
superpopulation condition ¢€(y, - Ox;) = (0) 0 = Msc, Gie 
that it is the finite population parameter that is of interest, 
the optimality of g is not affected by the superpopulation 
variances €(y,-9x,)*, i= 1,...,N(Godambe 1995). 

In the case where x, = | it is interesting to note that the 
optimality of the Tee. function 


aY 
ae yo uo = 5 (yer) 

in (4.3) continues to hold even when the superpopulation 
model e(y, - 8) = 0, 1€ P is replaced by the extended model 
E(y; -6,) =0, ieP., j =1,...,k. That is, now € y, is allowed 
to vary. from stratum to cai (Godambe 1995), The 
optimality continues to hold because be 1 (N. /N) 
(0, -¢Y) =0. However, now the variance of g cannot be 
approximated by replacing the stratum mean i by the 
population mean Y in (4. 4). The earlier approximation and 
the subsequent estimate Wg) in (4.6) were based on the 
assumption that (for large strata) the differences Y,- 8 or 
Y\- Y,j =1,...,k could be ignored. With @ replaced in the 
stratum P. by, 0, the terms Y.- Y are no longer ignorable, 
J =1,...,k. Here we note that the practice of stratifying the 
population so as to make each stratum “internally” homoge- 
neous tends to enlarge the differences Y,- Y,j = 1,...,k. 
The title of this section is intended to reflect this aiieont 

To obtain an estimate Wg), under the extended model 
SV 0;) = (0, we note that 


and set out to estimate the nuisance parameters or 
ge j=l,...,k holding Y fixed. Note that this problem of 
estimation is is entirely different, conceptually and also mathe- 
matically, from that of the estimation of the variance of y in 
(4.4). The procedure is the one established in section 2, 
where w(y) is Y and @(y) consists of Y,,j=1,...,k. 

The problem of estimating y sf Sask SUDICCT LO 
holding the population mean Y fixed, can be solved follo- 
wing the usual Lagrange multiplier technique. We make the 
working assumption that the model variances, namely 
Ee 0.) =0., are constant (o”) for all iP. For varia- 
tions of ne ,J =1,...,k, find a critical point of the function 


k = ONG = 
Sept ofb48)-aA an 
f=1 165; j=l 


j=l tes 


where A is the Lagrange multiplier. This technique of 
estimation has intuitive appeal even without reference to the 
superpopulation model just mentioned. It is easy to check 
that (7.1) is minimized for the estimate i of Y, where 


ny as before being the sample sizes from stratum 
J,J =1,..,k. Note that when strata sizes N. and sample 
SIZES n, 2 are “proportional”, that is (n; LN ie =(n/N),j =1, 
., k, the equations (7.2) reduce to 
Mey cat aca! jth llanec ke (7.3) 
This simple relationship can also be used when strata sizes 
and sample sizes are not exactly proportional but are only 
approximately so. Note, with reference to (7.3), that the 
estimating function War y; )-(Y¥ -y)is design-unbiased. 
The above discussion ‘also suggests estimation of the 
stratum means Y, when there is a non-constant covariate x. 
The superpopulation model underlying the estimating 
function g in (4.11), as noted before, was e(y, - 9 x,) = 0, 
for all individuals ie€‘P, with a common parameter 0. 
Suppose this model is to be replaced by a more flexible and 
realistic model where the parameter 0 is allowed to vary 
from stratum to stratum. That is DON EQN - 0; m=O; 
ieP., P. as before denoting the j" stratum, j = =e ake 
As in (4), the stratum means Y, enter the variance Vig) of 
the estimating function g in (4.11): 


Ses lethal 
v=» | —-— 
als 


dal 


(7.4) 


——— -¥)-=(x,-X, 
Rak. {0 2 a I: 
X,j =1,...,k as before denoting the stratum means of x’s. 
The estimate Vg) in (4.12) was obtained by ignoring the 
terms Y,= Y/X X. assuming large stratum sizes N. and the 
superpopulation model, €(y, - 9x,) =O for all individuals 
i€P, with a “common” parameter 0. ah the new, more 
we model é(y, - 0, a) UP ieP. J = -, k, ie terms 

= abe x, cannot be. ignored any co The appropriate 
Gian namely Vig), of the variance V(g) in (7.4) is 


given by 


(7.5) 


1 te =i \2 
ete -Y¥)-=(x,-X)}. 
A E {0 D-Z >| 


However now the usual confidence intervals for (Y/X) 
obtained by ie the distribution of the approximate 


pivot {g/VW%g)} contain nuisance parameters Y,, 
j=1,...,k, assuming the covariate stratum means 


7 Cs ha =],...,k, are known. 
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As before we have to estimate the nuisance parameters, 
namely the stratum means Y,, j = 1, ..., k, holding the popu- 
lation mean Y fixed. Note that the underlying superpopu- 
lation model specifies e(y, - - 8; ie, ieP, if al peagk. 


Further genetng the superpopulation’ variances 
Eye Oe Nae o Suey and assuming as before, the strata 
sizes IP] =N ..k to be large, we replace the 


function 0 in Nod 1) sn 


k : eral 
ep Dp Da i eee Ne 
jal ies, x, 
Sel wp ne 
i i 
r X +N.X,| -NY ?, (7.6) 
ne WO 


d as before being the Lagrange multiplier. In formulating 
wy in (7.6) we make the working assumption that for the 
superpopulation model with le ~ 0;x,) = 0, the variance 
functions ¢€(y, - 6,x,)* = oO =0°X, cP. That is, o, is 
proportional to the covariate value x, ic¢P. As stated in the 
beginning of this section, the working assumption just 
mentioned is primarily for simplicity and is of no important 
statistical consequence (Godambe 1995). It is easy to check 
that the values (estimates) iG of i which optimize in (7.6) 
are given by 


lens 
Je wig 
x; x 
k yy, # k (N.X.)*|| N. 
See -n7/ > ae su +/+, (7.7) 
rae "yj au nx 2x, 
Wit BREA 


Now for the estimating function g in (4.3), the variance V(g) 
is given by (4.4). Further if V (g) is the estimate of V(g) 
based on the estimates Y. of Y,,7 = 1,...,k given by (7.3), 
then in analogy with (4.5) (but taking into account that 
since Y, is estimated, the sum of squares has fewer than nj 
degrees of freedom) 


A BNE Late 4 1 
V(g)= > 4]—-—]. 
j=l N n, N, n,- 1 


a a, 7.8 

DP Gee) ( ) 
1ES; 

The confidence intervals for Y are obtained by inverting the 

distribution of the approximate pivot [g/{V,(g)}71; 

asymptotically, 


e/{V(9)}*- NO, 0. (7.9) 


Similarly in case of a covariate, for the estimating function 
g in (4.11), if V,(g) denotes the estimate of the variance 
V(g) in (7.4) based on the estimates Y, given by (7.7), then 
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where 
A, = Ww; N(yp- YIN,» 
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However, a less complicated form which is still a function 
of Y; only through Y/X is 


ale 


V,( 
g)= eee G1 


ire 


2 
(7.10) 
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Again, the confidence intervals for Y are based on the 
inversion of the distribution of [g/{V,(g)}71; asymptoti- 


cally 
g/{V,(2)}* - N(O,1). (7.11) 


8. EMPIRICAL PROPERTIES 


In the preceding section we have provided construction 
of confidence intervals when the superpopulation model 
€(y, -9) = 0 or €(y; -9x;) = 0, witha “common” value of 0 
for all individuals i¢€‘P, is replaced by the model 
€(y, —9,) = 0 or €(y, -8;x;) = 0, 1€ Pj = 1,...,k. Thatis, 
now 0 ‘can vary from Stratum to stratum. Generally, in 
practice, one cannot be sure if for the survey population at 
hand, the parameter @ has a “common” value for all indi- 
viduals 1€P. Theoretical as well as numerical investiga- 
tions clearly indicate that the performance of the confidence 
intervals computed on the assumption of a common value 
of @ (e.g., the ones based on the pivots [g/{ V(g)}7] of 
section 4) is very susceptible even to “small deviations” of 0, 
from stratum to stratum. Of course it typically happens that 
in stratifying a population, a prior assessment of the mean 
values 9 for different individuals leads to construction of 
strata ‘P. with differing mean values 0,7 =1,...,k. 

For the reasons given above we propose the ieeneral use 
of confidence intervals based on the pivot (7.9), when there 
is no covariate; and confidence intervals based on the pivot 
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(7.11) for a covariate case. In the following illustrations the 
above confidence intervals are compared with conventional 
confidence intervals: These are obtained, in the case of no 
covariate, from the approximate (0, 1) pivot 


> 
Y, 


set tat haga elon, 
dl NY? 
Bi hee (,-¥,) (8.1) 
> 2 nj N, GD oy ’ 
in case of a covariate the approximate N(0, 1) pivot is 
Ni i, 
J 
SS y= or kN 
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(Cochran 1977). In general we will refer to (7.9) and (7.11) 
as the new pivots and (8.1) and (8.2) as the conventional 
pivots. 

Extensive simulation experiments were conducted to 
compare confidence intervals based on the new and the 
conventional pivots. However the results reported below are 
primarily for small samples. Here we have sixteen survey 
populations, each of which is divided into four strata; 
samples of sizes 2, 3, 4, 2 are drawn from the respective 
strata. Such samples of (total) sizes as small as 11, can 
bring out best, as in Tables 1 and 2 to follow, the superior 
performance of the new pivots over the conventional ones. 
To a lesser degree than for the small size samples just 
mentioned, the superiority of the new pivots over the 
conventional ones continues to hold for moderate size (25) 
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samples, as in Table 3 and 4. Our unreported simulation 
studies included populations divided into 16 strata each, 
with total sample size of about 50. Even for such large 
samples the new pivots appear to perform better than the 
conventional ones. Eventually, of course, for very large 
sample sizes, the distinctions in performance between the 
two pivots, the new and the conventional, tend to disappear. 

The sixteen survey populations (1) — (16) in Tables 1 and 
2 below, except for populations (7), (8), are of sizes 1,000 
each; populations (7), (8) are of sizes 2,000 each. Each one 
of the sixteen populations, as said before, is divided in 4 
strata. Tables 1 and 2 each have six columns (i), (11), ... (vi). 
Column (1) gives the population number (-). Column (ii) 
provides, corresponding to the four strata of the population 
(-), the superpopulation distributions from which the strata 
have been drawn. The distribution can be Chi-square (C), 
Normal (4), or Uniform (U). When there is no covariate as 
in Table 1, column (ii) refers to just the distribution of the 
variate y; on the other hand in Table 2, it refers to the 
distributions of both the variate y and the covariate x, with 
y (conditional on x) having mean 6x. Column (iii) gives the 
sample sizes from different strata. Column (iv) shows the 
nominal coverage probability. Columns (v) and (vi) provide 
the actual coverage probabilities attained and the average 
length of the confidence intervals, under 4,000 simulations. 
Thus a typical horizontal line in Table 1, starting with (6) 
say, is to be read as follows. The four strata of the 
population (6) are drawn from the superpopulation distribu- 
tions Normal, Chi-square, Normal, Chi-square respectively; 
the sample sizes from different strata are (2, 3, 4, 2) 
respectively. The interpretation of the columns (iv), (Vv), 
(vi) is straightforward. Unlike the populations (1) — (16) 
above, the populations (17) and (18) in Tables 3 and 4 are 
divided into 8 strata each, the population (17) being without 
a covariate and (18) with a covariate. 


Table 1 
(i) (ii) (iii) (iv) (v) (vi) 
Population Superpopulation Sample Nominal coverage Actual coverage probability Average length 
distribution y sizes probability pivot (7.9) pivot (8.1) pivot (7.9) pivot (8.1) 

(1) {NEG SUC} (2,3,4,2) oe) 967 .86 19.83 ess 
(2) {N,C,U,C} (2,3,4,2) 90 90 .80 1S yo) 
(3) {N,N,N,N} (2,3,4,2) 90 90 807 4.85 3.07? 
(4) LORUAUAU} (2,3,4,2) 90 90 817 4,90 355 
(5) {N,C,N,C} (2,3,4,2) YS 946 82 34.34 19.62 
(6) {N,C,N,C} (2,3,4,2) 90 866 76 Pras 16.46 
(7) {N,U,C,N} (2,3,4,2) 95 S/ .869 20.76 11.80 
(8) {N,U,C,N} (2,3,4,2) 90 908 81 13.69 9.96 


In the populations numbered (1) - (4) below the mean value @ is held fixed from stratum to stratum, 8 = 100, the 
standard deviation varies between 2.0 and 200.00. For the remaining populations, (5) to (8), the mean value @ varies 
from stratum to stratum, between 8 = 100 and 6 = 400 
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Table 2 
(i) (ii) (iii) (iv) (v) (vi) 
Population Superpopulation Sample Nominal Actual coverage Average 
distribution Sizes coverage probability length 

x, y probability pivot (7.11) pivot (8.2) pivot (7.11) pivot (8.2) 
(9) LULOHU UICC ECC ye (2734.2) .90 879 ev Dili 54.12 
(10) (ULWSULUN TE CC CC} C5742) OS 926 .876 113.49 64.49 
(11) {U,U,U,U} {N,N,N,N} (2,3,4,2) .90 88 84 12.21 6.85 
(12) {C,C,C,C}  {N,N,N,N} (2,3,4,2) .90 .83 83 7.07 6.84 
(13) (\C GEC Cl, (ECC 3.4.2) 2D) .926 87 113.53 100.10 
(14) (CEC CCHHNECE CC) RO3'42) .90 .869 .84 35.89 33.01 
(15) (CCC CHC Ee ECE 2354-2) 195) 92 .89 42.88 39.34 
(16) {CCC} {UC CUls 23.4:2) 195 BY) 909 Shel 7 26.68 


In the Populations numbered (9) - (12) below the regression coefficient 8 is held fixed for all strata, 9 = 3. For the 
remaining populations (13) - (15), the regression coefficients 6 varies from stratum to stratum, between 9 = 2 and 0 =4 


Table 3 
(i) (ii) (iii) (iv) (v) (vi) 
Population Superpopulation Sample sizes = Nominal Actual coverage Average 
distribution y coverage probability length 
pivot (7.9) pivot (8.1) pivot (7.9) pivot (8.1) 
(17) {N,U,C,U,C,N,U,U} (2,3,4,2,3,4,3,4) OS 193 889 12.76 10.94 


In the population numbered (17) below, the mean value @ varies from stratum to stratum between @ = 100 and @ = 800 


Table 4 
(1) (ii) (iii) (iv) (v) (vi) 
Population Superpopulation Sample sizes Nominal Actual coverage Average 
distribution coverage probability length 
pivot (7.11) pivot (8.2) pivot (7.11) pivot (8.2) 
TRI ETE (EX CKCEXCHE) 
(18) (2,3,4,2,3,4,3,4) AS)5) O37 .90 22.80 20.89 


y: {N,U,N.C.C.CCN} 


In the population numbered (18) below, the regression coefficient 8 varies from stratum to stratum between 0 = 3 and 0 =6 


9. CONCLUSIONS 


The following conclusions are based on the theoretical 
investigations of the preceding sections and the simulation 
results reported in section 8, as well as many other simula- 
tion results, as mentioned earlier, not reported in this paper. 

The situation when there is no covariate seems to be 
fairly clear from Tables 1 and 3 of section 8. For small 
samples the conventional confidence intervals, that is the 
ones based on the pivot (8.1), can be very misleading: The 
“asserted” probability of coverage can be very different 
than the “actual” one. Further, this gap between asserted 
and actual coverage probabilities for the conventional 
confidence intervals seems to increase as the variation in 
the stratum means increases. Interestingly, as noted in 
section 7, this increased variation in the stratum means can 
often be a result of stratifying a population into (internally) 
homogeneous strata for efficient point estimation. The 


confidence intervals based on the new pivot (7.9), as it can 
be seen from the Tables | and 3 of section 8, perform much 
better than the ones based on the conventional pivot (8.1). 
From our simulations, based on three distributions, namely 
Normal, Chi-square and Uniform, it seems that the 
comparison between performance of the new pivot (7.9) 
and the conventional one (8.1) depends on the distributions 
mostly through their variations of the mean values from 
stratum to stratum. Particularly, the comparison is not 
much affected by the variances or the forms of the distri- 
butions. This is to be expected from our underlying 
semi-parametric model, e(y, - 0;) =O Pee] = Lys ks 
This thus extends the conclusion previously drawn in the 
beginning of section 8. We emphasize here that the 
optimality of the estimating function g in (4.3) continues to 
hold even when 8 varies from stratum to stratum. 

For large samples, according to our simulation results 
mentioned earlier (unreported here) the difference between 
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the two sets of confidence intervals, one based on the pivot 
(7.9) and the other on (8.1), tend to diminish. This also is 
in line with the theory. 

Tables 2 and 4 of section 8 provide results concerning 
confidence intervals for populations admitting a covariate. 
Here a comparison of the performances of the new pivot 
(7.11) and the conventional one (8.2) is rather subtle. We 
consider two situations: One, when the regression 
coefficient 9, is the same for all strata; Two, when @ varies 
(though not very much) from stratum to stratum. Only in 
the former situation is the estimating function g in (4.11) 
optimal. For this situation (i.e., same @ for all strata), 
which is mostly of academic interest, the pivot given at the 
end of section 4, a sour simulation studies (unreported here) 
show, performs very well. Situation two, above, is more 
realistic. Hence it is practically very important to study the 
performance of the estimating function g, that is the perfor- 
mance of the confidence intervals based on the new pivot 
(7.11), when 8 varies from stratum to stratum. Under this 
situation, it is clear from Tables 2 and 4 that the confidence 
intervals based on the new pivot (7.11) provide “actual” 
coverage probabilities closer to the “asserted” ones than the 
confidence intervals based on the conventional pivot (8.2). 
Also under situation one, i.e., the same @ for all strata, as 
Table 2 indicates, the performance of the new pivot (7.11) 
is at least as good as the conventional pivot (8.2). The 
phenomenon seems to be more striking as more variation in 
the covariate values is introduced. Actually, as the covariate 
values within each stratum tend to be uniform the difference 
between the performances of the two pivots, the new (7.11) 
and the conventional (8.2), tends to diminish. The diffe- 
rence also diminishes as the sample sizes go on increasing. 

A referee has suggested that, since for a single stratum 
case our new pivot (7.11) closely resembles Fieller’s pivot, 
referred to by Cochran (1977), we comment on Cochrdn’s 
observations: for some parametric distributions (for 
example bivariate normality of (x, y) with one of the means 
close to zero), the confidence intervals for the ratio of 
means based on Fieller’s pivot may have undesirable 
properties (concerning probability of coverage and interval 
length) in comparison to the confidence intervals based on 
the conventional pivot (8.2). In the survey sampling context 
such circumstances would be exceptional, as indicated by 
our simulation results. Moreover, our new pivot (7.11) has 
“validity” for a semi-parametric model; underlying this is a 
large class of parametric models. 
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APPENDIX 


The variance of the estimating function g in (5.3) namely 
V(g), is E(g*) since E(g) = 0. Further 
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where E, ., denotes the expectation holding the clusters 
c,c’ fixed. Now as stated in the beginning of section 5, the 
sampling designs for different clusters are independent. 
Further, the second term in the r.h.s. of “A” is equal to 
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where eee Y./N, and X= 


LN GE le 
The term B in E(g?) simplifies as 


ceP; 


kK Nf _ Va= LS INGE = Y= 2 
Be —| Y.-—Xx -) —|Y,-—X 
al x8) Ral 94 
k 2 2 
es “fy,-4 | 
j=) N? x (IV) 
Note that because of the superpopulation model 


&(y, - 8x.) = 0, i€ P in (IID) and (IV) the term 


2 
[y,- £3) iG) haa [eae bere 
hes Sat N. 

e 
It can thus be shown that second term of A and the term B 
are both of order O(1/N), while the first term of A is of 
order O(N?/n3). Hence from (I) — (IV) for large strata 
sizes N., 7 = 1, ..., kK we have approximations to the variance V(g) 
and its estimate V(g) as in (5.4) and (5.5). These approxi- 
mations are valid, regardless of the superpopulation model 
just mentioned, provided the sample sizes n; in addition to 
the strata sizes N,,j = 1,...,k are sufficiently large. 
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Some Recent Advances in Model-Based 
Small Area Estimation 


J.N.K. RAO! 


ABSTRACT 


Small area estimation has received a lot of attention in recent years due to growing demand for reliable small area estimators. 
Traditional area-specific direct estimators do not provide adequate precision because sample sizes in small areas are seldom 
large enough. This makes it necessary to employ indirect estimators that borrow strength from related areas; in particular, 
model-based indirect estimators. Ghosh and Rao (1994) provided a comprehensive review and appraisal of methods for 
small area estimation, covering the literature to 1992-1993. This paper supplements Ghosh and Rao (1994) by covering the 
literature over the past five years or so on model-based estimation. In particular, we cover several small area models and 
empirical best linear unbiased prediction (EBLUP), empirical Bayes (EB) and hierarchical Bayes (HB) methods applied 
to these models. We also present several recent applications of small area estimation. 


KEY WORDS: Empirical Bayes; Hierarchical Bayes; Small Area Models. 


1. INTRODUCTION 


Sample surveys are used to provide estimates not only 
for the total population but also for a variety of subpopula- 
tions (domains). “Direct” estimators, based only on the 
domain-specific sample data, are typically used to estimate 
parameters for large domains. But sample sizes in small 
domains, particularly small geographical areas, are rarely 
large enough to provide direct estimates for specific small 
domains. For example, the U.S. Third National Health and 
Nutrition Examination Survey was designed to provide 
direct estimates with acceptable precision for domains clas- 
sified by race, ethnicity and age. But, to have a large enough 
sample to support reliable direct estimates for, say, all states 
is seldom possible, and for all subareas like counties is 
almost never possible. In this example, states/counties may 
be regarded as “small areas” because the area-specific 
sample sizes are small (or even zero). In making estimates 
for such small areas it is necessary to “borrow strength” 
from related areas to form “indirect” estimators that 
increase the effective sample size and thus increase the 
precision. Such indirect estimators are based on either 
implicit or explicit models that provide a link to related 
small areas through supplementary data such as recent 
census counts and current administrative records. Indirect 
estimators based on implicit models include synthetic and 
composite estimators, while those based on explicit models 
incorporating area-specific effects include empirical Bayes 
(EB), empirical best linear unbiased prediction (EBLUP) 
and hierarchical Bayes (HB) estimators. 

Ghosh and Rao (1994) presented a comprehensive 
overview and appraisal of methods for small area esti- 
mation, covering the literature to 1992-1993. We refer the 
reader to Schaible (1996) for an excellent account of the 
use of indirect estimators in U.S. Federal Programs. 


Ghosh and Rao (1994) provided a list of symposia and 
workshops on small area estimation that have been organized 
in recent years. We update that list by the following: (i) 
Conference on Small Area Estimation, U.S. Bureau of the 
Census, Washington, D.C., March 26-27, 1998; and (ii) 
International Satellite Conference on Small Area Estimation, 
Riga, Latvia, August 20-21, 1999. Short courses have also 
been organized: (i) “Small Area Estimation” by J.N.K. Rao, 
W.A. Fuller, G. Kalton and W.L. Schaible, organized by the 
Joint Program in Survey Methodology and the Washington 
Statistical Society, Washington, D.C., May 22-23, 1995; and 
(ii) “Introduction to Small Area Estimation” by J.N.K. Rao, 
organized by the International Association of Survey 
Statisticians, Riga, Latvia, August 19, 1999. In addition, 
numerous invited and contributed sessions on small area esti- 
mation have been organized at recent professional statistical 
meetings, including the American Statistical Association 
Annual Meetings and the International Statistical Institute 
bi-annual sessions. 

Singh, Gambino and Mantel (1994) discussed survey 
design issues that have an impact on small area statistics. In 
particular, they presented an excellent illustration of compro- 
mise sample size allocations to satisfy reliability require- 
ments at the provincial level as well as sub provincial level. 
For the Canadian Labour Force Survey with a monthly 
sample of 59,000 households, optimizing at the provincial 
level yields a coefficient of variation (CV) for “unemployed” 
as high as 17.7% for some Unemployment Insurance (UI) 
regions. On the other hand, a two-step allocation with 42,000 
households allocated at the first step to get reliable provincial 
estimates and the remaining 17,000 households allocated in 
the second step to produce best possible UI region estimates 
reduces the worst case of 17.7% CV for UI regions to 9.4% 
at the expense of a small increase in CV at the provincial and 
national levels: CV for Ontario increases from 2.8% to 3.4% 
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and for Canada from 1.36% to 1.51%. Preventive 
measures, such as compromise sample allocations, should 
be taken at the design stage, whenever possible, to ensure 
precision for domains like the UI region. But even after 
taking such measures sample sizes may not be large 
enough for direct estimates to provide adequate precision 
for all small areas of interest. As noted before, sometimes 
the survey is deliberately designed to oversample specific 
areas (domains) at the expense of small samples or even no 
samples in other areas of interest. 

This paper supplements Ghosh and Rao (1994) by 
covering the literature over the past five years or so on 
model-based small area estimation; in particular, on empi- 
rical best linear unbiased prediction (EBLUP), empirical 
Bayes (EB and hierarchical Bayes (HB) methods and their 
applications. 


2. SMALL AREA MODELS 


It is now generally accepted that when indirect 
estimates are to be used they should be based on explicit 
models that relate the small areas of interest through 
supplementary data such as last census data and current 
administrative data. An advantage of the model approach 
is that it permits validation of models from the sample 
data. Interesting work on traditional indirect estimates 
(synthetic, sample-size dependent efc.), however, is also 
reported in the recent literature (see e.g., Falorsi, Falorsi 
and Russo 1994; Chaudhuri and Adhikary 1995; Schaible 
1996; Marker 1999). 

Small area models may be broadly classified into two 
types: area level and unit level. 


2.1 Area Level Models 


Area-specific auxiliary data, x,, are assumed to be 
available for the sampled areas i (= 1, ..., m) as well as the 
nonsampled areas. A basic area level model assumes that 
the population small area mean i _or some suitable 
function 0. = 2%); such as 0. = log(Y,), is related to x, 
through a linear model with random area effects v,: 


0X Bry Pol tt (2.1) 


where B is the p-vector of regression parameters and the 
v,’S are uncorrelated with mean zero and variance o.. 
Normality of the v, is also often assumed. The model (2.1) 
also holds for the non sampled areas. It is also possible to 
partition the areas into groups and assume separate models 
of the form (2.1) across groups. , 

We assume that direct estimators ye of Ve are available 
whenever the area sample size n, > 1. It is also customary 
to assume that 


A 


6,=0,+e. (2.2) 


where 6, = g(¥,) and the sampling errors e; are 
independent N(O, ,) with known ,. Combining this 


sampling model with the “linking” model (2.1), we get the 
well-known area level linear mixed model of Fay and Herriot 
(1979): 

6, =x) PB +v,+e,. (2.3) 
Note that (2.3) involves both design-based random variables e, 
and model-based random variables v;,. In practice, sampling 
variances Wy; are seldom known, but smoothing of estimated 
variances W, is often done to get stable estimates y; which 
are then treated as the true y,. Other methods of handling 
unknown WJ, are mentioned in section 3.4. An advantage of 
the area-level model (2.3) is that the survey weights are 
accounted for through the direct estimators 0,. 

The assumption E(e,| 8,) = 0 in the sampling model (2.2) 
may not be valid if the sample size n; is small and 0; is a 
nonlinear function of the total Y;, even if the direct estimator 
Y, is design-unbiased, i.e., IO Y,) = ¥,. A more realistic 
sampling model is given by 


¥=V.+e7 (2.4) 


with E (e; | Yor Ore. i is design-unbiased for the total Y,. 
In this case, however, we cannot combine (2.4) with the 
linking model to produce a linear mixed model. As a result, 
standard results in linear model theory do not apply, unlike 
in the case of (2.3). Alternative methods to handle this case 
are needed (see section 4.1). 

The basic area level model has been extended to handle 
correlated sampling errors, spatial dependence of random 
small area effects, vectors of parameters 0, (multivariate 
case), time series and cross-sectional data and others (see 
Ghosh and Rao 1994). We discuss some of the recent models 
for combining cross-sectional and time series data. Suppose 9, 
denotes a parameter of interest for small area i at time t and 0, 
is a direct estimator of 8... Ghosh, Nangia and Kim (1996) 
assumed the sampling model 0,|6,, ae N(O,,, W,,) with 


known sampling variances ,,, and the linking model 
/ 7, 2 
6,,[u, ~ N(x B +Z,U,,6,) (2.5) 


and 


Ue Cs YN) (2.6) 


with known auxiliary variables X;, and Zin they have 
actually studied the multivariate case 0. Note that (2.6) is 
the well-known random walk model. The above model has 
the following limitations: (i) Independence of 8..’s over t for 
each i may not be realistic because estimates are typically 
correlated over time. (ii) The linking model (2.5) does not 
include area-specific random effects. As a result, it is likely 
to produce oversmooth estimates. Rao and Yu (1992, 1994) 
proposed more realistic sampling and linking models. They 
assumed the sampling model 

Is ind 

OF Od N (ORE) (2.7) 
with known sampling covariance matrix ,, and the linking 
model 
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0,=x, B+v,+u, (2.8) 


iid. 
with v, ~ N(0, a.) and independent of u;,s which are 
assumed to follow an AR(1) model: 


Ui, = PU,» +&q» [P| <1 (2.9) 

iid. ‘ F A 
with ¢,~ N(0,0*), where 6,=(0,,,...,0,,)’ and 
6.= (0,, ..., 0;,)’. Models of the form (2.7)-(2.9) have 


been extensively studied in the econometric literature, 
ignoring sampling errors, i.e., treating 0, as 0,. The 
above sampling model permits correlations among 
sampling errors over time and the linking model (1.9) 
includes both area-specific random effects v, and area by 
time specific random effects u,,. Datta, Lahiri and Lu 
(1994), following Rao and Yu (1992), used the same 
sampling model (2.7) but assumed the following linking 
model: 

8;,| ¥;.U, ~ N(x; By +; + 2, U,, 0; ) (2.10) 
where B,’s and o;’s are random and u, follows the 
random walk model (2.6). This model allows area-specific 
random effects v, and random slopes B,, but does not 
contain area by time specific random effects u,,. Datta, 
Lahiri and Maiti (1999) used the Rao-Yu sampling and 
linking models (2.7) and (2.8) but replaced the AR(1) 
model (2.9) by a random walk model given by (2.9) with p = 1. 
Datta, Lahiri, Maiti and Lu (1999) considered a similar 
model but added extra terms to x;,, B + v, to reflect sea- 
sonal variation in their application to estimating unem- 
ployment rates for the U.S states. Singh, Mantel and 
Thomas (1994) also used time series/cross-sectional 
models, but assumed that the sample errors are 
uncorrelated over time. 

Area level models have also been used in the context of 
disease mapping or estimating regional mortality and 
disease rates, as noted by Ghosh and Rao (1994). A simple 
model assumes that the observed small area disease counts 
y; | 9; 2! Poisson P(n,0.) and 9) gamma G(a, b), 
where Q, is the true incidence rate and n, is the number 
exposed in area i. Maiti (1998) used B, = log0;~ 
Niu, 0”) instead of gS G(a, b). He also considered a 
spatial dependence model for f,’s, using conditional 
autoregression (CAR) that relates each B, to a set of 
neighbourhood areas of area i; see also Ghosh, Natarajan, 
Kim and Walker (1997). Lahiri and Maiti (1996) modelled 
age-group specific area disease counts Vig» using Clayton 
and Kaldor’s (1987) approach. They assumed that 
yj. = Dl 9; *< P(e,0,) and 0,'“" G(a,b), where 
Ge Lv iny is the expected number of deaths in area /, Wy; 
is the j-th group effect assumed to be known and n,, is the 
number exposed in the j-th age group and area i. N andram, 
Sedransk and Rickle (1998) assumed that, y, | 8; a 
P(n, 9) and log 0,=x/B+v, with v, ~ NCO, @”), 
where 0, is the area/age-specific mortality rate and x; is 
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a vector of covariates for age group j. They also considered 
random slopes f, in the linking model. 


2.2 Unit Level Models 


A basis unit level population model assumes that the unit 
y-values Vig» associated with the units 7 in the areas i, are 
related to auxiliary variables X through a one-way nested 
error regression model 


y, =X; Bt; +e; Nae aN pi leus, i a) 


where v; Ly (0, a7) are independent of e; Ly (0, 02) 


and N, is the number of population units in the i-th area. The 
parameters of interest are the totals Y, or the means Y,. 

The model (2.11) is appropriate for continuous variables 
y. To handle count or categorical (e.g., binary) y-variables, 
generalized linear mixed models with random small area 
effects, v,, are often used. Ghosh, Natarajan, Stroud and 
Carlin (1998) assumed models of the form: (1) Given 0, *S, 
the y;,’s are independent and belong to the exponential 
family with canonical parameter Oi (ti) Linking model 
g(;) =x; B +v. where v, =n, o,) and g(-) is a 
strictly increasing function. The linear mixed model (2.11) 
is a special case of this class with g(a) = a. The logistic 
function g(a) = log [a/(1-a)] 1s often used for binary y (see 
e.g., Farrell, McGibbon and Tomberlin 1997) although 
probit functions can also be used and offer certain 
advantages for hierarchical Bayes (HB) inference (Das, Rao 
and You 1999), 

The sample data {y.XjoJ = tay eS ae eS 
assumed to obey the population model. This implies that the 
sample design is ignorable or selection bias is absent which 
is satisfied by any equal probability sampling method within 
areas. For more general designs, the sample indicator 
variable, a,,, should be unrelated to y,,, conditional on x,... 
Model-based estimators for unit level models do not depend 
on the survey weights, Wij so that design-consistency as n, 
increases is forsaken except when the design is self- 
weighting, i.e., W,,= Ww, as in the case of equal probability 
sampling. The area level model (2.3) is free of these 
limitations but assumes that the sample variances , are 
known; if w,’s are assumed unknown the model becomes 
nonidentifiable or nearly nonidentifiable leading to highly 
unstable estimates of the parameters. The unit level model is 
free of the latter difficulty and survey weights can also be 
incorporated using model-assisted estimators; see the para- 
graph containing equation (3.8). 

Various extensions of the basic unit level models have 
been studied over the past five years or so. Stukel and Rao 
(1999) studied two-way nested error regression models 
which are appropriate for two-stage sampling within small 
areas. Following Kleffe and Rao (1992), Arora and Lahiri 
(1997) studied unit level models of the form (2.11) with 
random error variances 0; such that 0, a G(a, b); Kleffe 
and Rao (1992) assumed the existence of only mean and 
variance of o;, without specifying a parametric distribution 
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on oF. Datta, Day and Basawa (1999) extended the unit 
level model (2.11) to the multivariate case y,,, following 
Fuller and Harter (1987). This extension feds to a multi- 
variate nested error regression model. Moura and Holt 
(1999) generalized (2.11) to allow some or all of the 
regression coefficients to be random and to depend on area 
level auxiliary variables, thus effectively integrating the 
use of unit level and area level covariates into a single 
model. You and Rao (1999a) also studied similar two-level 
models. 

Malec, Davis and Cao (1996, 1999) and Malec, 
Sedransk, Moriarity and LeClere (1997) studied the binary 
case, using logistic linear mixed models with random 
slopes to link the small areas. Raghunathan (1993) speci- 
fied only the first two moments of y,,’s conditional on 
small area means 0,’s and the first moment of 0, as 
Tt. = h(z, B) for known inverse “link” function h(-) and the 
second moment of 9, is allowed to depend on 1,. 

Many of the small area linear mixed models studied in 
the literature are special cases of the following general 
linear mixed model with a block diagonal covariance 
structure, sometimes called longitudinal mixed linear 
models (Prasad and Rao 1990; Datta and Lahiri 1997): 

y¥;-X,B+Z,v,+e,, 


i=1,...,m (2.12) 


where F in (0, G(t)) and independent = of 
e,~ (0, R (a). For example, the basic area level 2. 3) is 
of the form (2.12) with y; =O Z.=1, G,(t)= a, and 
R(t) =,. Das, Rao and You (1999) studied general 
mixed ANOVA models of the form 
Yo piece, a en ea (2,13) 
where Z, consists of only 0’s and 1’s such that there is 
exactly one 1 in each row and at least one | in each 
column, v; 0,0 *T) and independent of e ~ (0, 071). 
This model relaxes ‘the assumption of a block diagonal 
covariance structure. 

Ghosh and Rao (1994) reviewed some work on model 
diagnostics for models involving random effects. Jiang, 
Lahiri and Wu (1998) developed a chi-squared test for 
checking the normality of the random effects v, and the 
errors e, in the basic unit level iets model Yi 
x/Btv,+e,j=1,. Whar is 


3. MODEL-BASED INFERENCE: 
BASIC AREA-LEVEL MODEL 


EBLUP, EB and HB methods have played a prominent 
role for model-based small area estimation. EBLUP is 
applicable for linear mixed models whereas EB and HB 
are more generally valid. EBLUP point estimators do not 
require distributional assumptions, but normality of 
random effects is often assumed for estimating the mean 


squared error (MSE) of the estimators. Also, EBLUP and EB 
estimators are identical under normality and nearly equal to 
the HB estimator, but measures of variability of the 
estimators may be different. To illustrate the methods, we 
focus on the basic area level model (2.3), which is 
extensively used in practice. Various extensions of the basic 
area-level and unit leve! models are studied in section 4. 


3.1 EBLUP Method 


Appealing to general results for linear mixed models, the 

BLUP estimator of 0, under (2.3) is given by 

6, (0) = 7,6, + (1 - 7) xB (o,) (3.1) 
where y; = a. / (0, +W,) and B (0. ) is the weighted least 
squares (WLS) estimator of § with weights (a. +.) rrit 
follows from (3.1) that the BLUP estimator is a weighted 
combination of the direct estimator 0. and the regression 
synthetic estimator x; ‘Bo. Da. eine result (3.1) does not 
require the normality of v, and e,. Since 0, is unknown, we 
replace it by a suitable estimator o to obtain a two-step or 
EBEUP. estimator ane 6. (Cr ). The estimator of total Y, is 
taken as g- (Gk j= nO, is One could use either the method 
of fitting constants (not requiring normality) or the restricted 
maximum jikelihood (REML) method under normality to 
estimate a. . Jiang (1996) showed that REML estimators of 
variance components in linear mixed models remain 
consistent under deviations from normality. Therefore, 6, 
with REML estimator of a. is also asymptotically valid 
under nonnormality. 

As noted in section 2.1, EBLUP estimation is not appli- 
cable if the sampling model (2.2) is changed to the more 
realistic model (2.4). 

A measure of variability associated with EBLUP esti- 
mator is given by its MSE, but no closed form for MSE 
exists except in some special cases. As a result, considerable 
attention has been given in recent years to obtain accurate 
approximations to the MSE of EBLUP estimators. An 
accurate approximation to MSE (6,) - E(, S aye for large 
m, under normality is given by 


MSE @,) = g,,(6,) + 85;(6,) + 83)(0,) (3.2) 

where 
81(0,) =Y,V}. (3.3) 
8,(0,) = (1 - ¥)°x/|o x x/@,+y,)| x, 64) 
g,,(0) =[vi/(o? + v,)*] EG, -x/BYP VE), (3.5) 
wince} + y,"] V6) 3.6) 


and Var ) is the asymptotic variance of a (Prasad and Rao 
1990). The leading term £,,(0, )=yY,W, is of order O(1) 
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whereas g,, (0° ), due to estimating B, and g,(o, SF due to 
estimating 0,, are both of order O(m~ '), for large m. 
Note that the leading term shows that MSE (6, ) can be 
substantially smaller than MSE (6, ) under the model (23) 
when y, is small or the model variance a is small relative 
to the sampling variance ,. The success of small area 
estimation, therefore, largely depends on getting good 
auxiliary information {x,} that leads to a small model 
variance relative of W;- Of course, one should also make 
a thorough validation of the assumed model. 

An estimator of MSE (0;), correct to the same order of 

approximation as (3.2), is given by 
~ n2 ) n2 

mse (0;) ~ g,;(6,) + 8;(6,) + 283; (0, ), (3.7) 
i.e., the bias of (3.7) is of lower order than m™! for large 
m. The approximation (3.7) is valid for both the method 
of fitting constants estimator and the REML estimator, but 
not for the ML estimator of a, (Datta and Lahiri 1997; 
Prasad and Rao 1990). Using the fitting of constants 
estimator, Lahiri and Rao (1995) showed that (3.7) is 
robust to nonnormality of the small area effects v, in the 
sense that approximate unbiasedness remains valid. Note 
that the normality of sampling errors e, is still assumed but 
it is less restrictive due to the central limit theorem’s effect 
on the direct estimators 0.. 

A criticism of the MSE estimator (3.7) is that it is not 
area-specific in the sense that it does not depend on 0, 
although x, involved through (3.4). But it is easy to find 
other choices using the form (3.5) for g,, (a° ye For 
example, we can use 


mse,(8,) = 8); (6°) + tay (62) + ex (6) 


+1Wi/G, + v,)1@, - x;BrA EG), ©) 
where B = B(G. ) and h, (o,) = V(G") = -2m Yo, +) 
for the fitting of constants estimator 3%, (Rao 1998). The 
last term of (3.8) is less stable than 83; (a ) but it is of 
lower order than the leading term g,, (0; ). 

Rivest and Belmonte (1999) obtained an unbiased 
estimator of the conditional MSE of the EBLUP estimator 
0.=0, (6°) for the basic area level model, assuming only 
the sampling model, i.e., conditionally given 0,’s. Hwang 
and Rao (1987) obtained similar results and showed 
empirically that the model-based estimator of MSE, (3.7), 
is much more stable than the unbiased estimator and that 
it tracks the conditional MSE quite well even under 
moderate violations of the assumed linking model (2.1). 
Only in extreme cases, such as large outliers 0,, the 
model-based estimator might perform poorly compared to 
the unbiased estimator. 


3.2 EB Method 


In the EB approach to the basic area level model, given 
by (2.1) and (2.2), the conditional distribution of 0; given 0, 
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and model parameters ( and oO, denoted (0; 6, B, o.). 
is first obtained. The model parameters are estimated from 
the marginal distribution of 0,’s, and inferences are then 
based on the estimated conditional (or posterior) distribution 
ony (OH| 0. »B; G “yi In particular, the mean of_ the 
estimated posterior distribution is the EB estimator 6F 
Under normality, Oe is identical to the EBLUP estimator 
be but the EB approach is applicable generally for any joint 
distribution. It should be noted that the EB approach is 
essentially frequentist because it uses only the sampling 
model and the linking model which can be validated from the 
data; no priors on the model parameters are involved unlike 
in the HB approach. 

As a measure of variability of Bie , the variance of the 
estimated posterior is used. Under normality, it is given by 
g,,(6, )= Y; ; which leads to severe underestimation of true 
variability as measured by MSE. Laird and Louis (1987) 
proposed a parametric bootstrap method to account for the 
variability in B and 6, but Butar and Lahiri (1997) showed 
that it is not second-order correct, i.e., its bias involves terms 
of order m~!, unlike the bias of (3.7) or (3.8). By correcting 
this bias, they obtained an estimator which is identical to the 
area-specific MSE estimator (3.8). Therefore, corrected EB 
and EBLUP lead to the same result under normality. 


3.3 HB Method 


The HB approach has been extensively used for small 
area estimation. It is straightforward, inferences are “exact” 
and it can handle complex problems using recently deve- 
loped Monte Carlo Markov Chain (MCMC) methods, such 
as the Gibbs sampler. A prior distribution on the model 
parameters (also called hyper parameters) is specified and 
the posterior distribution of the small area totals Y, or 
g(Y,) = 9; is then obtained. Inferences are based on the 
posterior distribution; in particular, Y, or 0; is estimated by 
its posterior mean and its precision is measured by its 
posterior variance. 

For the basic area level model, (2.1) and (2.2), with 
normality of v, and e,, the posterior mean E (0, | 6) and the 
posterior variance ve | 6) are obtained in two stages, 
where 6 = (Oy Oye In, the first stage, we obtain 
E(6; |6,0 ) and v6. |6,0 =) for fixed o{, assuming an 
improper prior, f(B) « const., on B to reflect absence of 
prior information on B. The conditional posterior mean, 
given 0,,, is identical to the BLUP estimator 0, ify ) and the 
conditional posterior variance is equal to g (5, eg, (o. ). 
At the second stage, we take account of the uncertainty about 
Oo, by first calculating its posterior distribution f(o, | 6), 
assuming a prior distribution on a, and prior independence 
of 6B and o, The posterior mean and variance are then 
obtained as 


° = E(0,10) = E,216,(02)] (3.9) 


VO, |8) = E244 [8),(0,) + 8,(0°)] + V.2,8,(0,)] (3.10) 
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where E¥2 216 and V,?) 6 woo _the expectation and 
variance with respect to f(o% | 6). No closed form 
expressions for (3.9) and (3.10) exist, but in this simple 
case they can be evaluated numerically using only 
one-dimensional integration. For complex models, 
high-dimensional integration is often involved and it is 
necessary to use MCMC-type methods to overcome the 
computational difficulties. 

It follows from (3.9) that 67" = 6;(6,) but (3.10) 
shows that ignoring uncertainty about 0, and using 
Bi (a 185; (G‘,) as a measure of variability can lead to 
significant underestimation. 

If the assumed prior f(o ) is proper and informative, 
the HB approach encounters, no difficulties. On the other 
hand, an improper prior f(o, ) could lead to an improper 
posterior (Hobert and Casella 1996). In the latter case, we 
cannot avoid the difficulty by choosing a diffuse proper 
prior on a. because we will be simply approximating an 
improper posterior by a proper posterior. 

To illustrate the use of Gibbs sampling, we again 
consider the basic area level model under normality. To 
implement Gibbs sampling assuming the prior f(t, = 0, 2) 
is a gamma (a, b),a > 0,b > 0, we need the following 
Gibbs-conditional distributions: 


Ga bo ee N,[(X’'X) 'X'@, 0, (X’X)! Cea) 


0. | B, 07,6 NG, (B, 0%) = 


6.00 
y,8,+ (1 - ¥,)x;B, y,W,),2=1 (3412) 


(ii) 
(iii) 0,7|B,0,6~G o +a,¥(@,-x/B)°+b , (3.13) 


where X is the m X p matrix with x; as the i-th row and 
O'= (Or n.ei0) o LneGibbs algorithm i is as follows: (a) 
Using starting values 6. and eee draw B“ from (3.11). 
(b) Draw 0!”,i=1,...,m from (3.12) using B and 
Os, (c) Daw 0; 21) fom (3.13) using Oy i ln 
ie BO, Steps (a)- (c) complete one cycle. Perfonea large 
number of cycles, say ¢, called “burn-in Pee until con- 
vergence and then treat (B“?, o mi oy : nd, ras 
J samples from the joint "posterior Hs ie o and 
Os i= 1, ...,m. Other methods use multiple parallel runs 
instead of a single long run as above. Parallel runs can be 
wasteful because initial “burn-in” periods are discarded 
from each run. But a single long run may leave a 
significant portion of the space generated by the joint 
posterior unexplored. 
The posterior mean and the posterior variance are 
estimated as 


re. 


i (3.14) 
F, 


rs [o cae a 5) 


and 


V(0,16) - y 21,0" #)) 2 2,,(6 ani 
I 


SONG Ore: (3.15) 
J 


ee 
J 


The estimator 0, ;(-) has smaller simulation error than the 
poke isa conditional | expectation and the well-known 

Jy.0°" because 6, kOe ) is a conditional expectation and 
the well-known Rao- Blackwell theorem holds. It is therefore 
advisable to do analytical calculations first before applying 
Gibbs sampling. 

For the basic area level model, all the conditional distribu- 
tions, (3.11)-(3.13), are in a closed form and, therefore, 
samples can be generated directly. But for more complex 
models, some of the conditionals may not have closed form 
in which case alternative algorithms, such as Metropolis- 
Hastings within Gibbs, are needed to draw samples from the 
joint posterior distribution. We refer the reader to Brooks 
(1998) for an excellent review of the MCMC methods. 
Software, called BUGS and CODA, are readily available for 
implementing MCMC and convergence diagnostics, but 
caution should be exercised in using MCMC methods. For 
example, Hobert and Casella (1996) demonstrated that the 
Gibbs sampler could lead to seemingly reasonable inferences 
about a nonexistent posterior distribution. This happens 
when the posterior is improper and yet all the Gibbs- 
conditional distributions are proper. Another difficulty with 
MCMC is that the convergence diagnostics tools can fail to 
detect the sorts of convergence failure that they were 
designed to identify (Cowles and Carlin 1996). Further 
difficulties include the choices of ft for the burn-in period, 
number of simulated samples, J, and the starting values. 


3.4 Some Recent Applications 


(1) Dick (1995) used the basic area level model (2.3) to 
estimate net under coverage rates in the 1991 Canadian 
Census. The goal is to estimate 96 adjustment factors 
0,=T,/C,, corresponding to 2(sex) xX 4(age) xX 
12(province) combinations, where TJ, is the true 
(unknown) count and C; is the census count in the /-th 
area domain the net undercoverage rate in the i-th area 
is given by U,=1- 0,'. Direct estimates 0. were 
obtained from a post enumeration survey, and sampling 
variances , were derived through smoothing of 
estimated variances, assuming , 1s proportional to 
some power of C;. Explanatory variables, x, were 
selected from a set of 42 variables by backward 
stepwise regression. EBLUP (EB) estimates of 8, were 
used and their, MSE estimated using (3.7) with, REML 
estimate of o, . The EB adjustment factors 6) were 
converted to estimates of missing persons, M, = 
Ly Cc. and these estimates were raked to ensure 
consistency with direct estimates of marginal totals. 


The raked EB estimates, 6; were used as the final 
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(2) 


(3) 


We now present 


estimates of M; 5: MSE. estimate of 6; was obtained 
as [mse (6/" GH [Ge By2, This somewhat ad hoc 
method ensures that the coefficient of variation (CV) 
of Be is retained by Oi but properties of this 
method remains to be investigated. 


The basic area level model (2.3) with 0; = log Y, has 
been recently used to produce model-based county 
estimates of poor school-age children in U.S.A. 
(Fisher and Siegel 1997; National Research Council 
1998). Using these estimates, the US Department of 
Education allocates over 7 billion of federal funds 
annually to counties. The difficulty with unknown yp, 
was handled by using a model of the form (2.3) for 
the census year 1990, for which reliable estimates 
W,. of sampling variances, ,, are available and 
assuming the census small area effects, v,, follow the 
same distribution as v,, i.e., N(O,o aye Under the 
latter assumption, an estimate of af was obtained 
from the census data assuming Y,. 7 and used in 
the current model (2. 3), assuming W, = = off n,, to get 
an estimate of ro, ~The resulting estimate, 

Y,=6, eh n,, Was treated as the true , in developing 
EBLUP estimates, 6,, of O:. The small area 
(county) totals Y, (number of school- -age children in 
poverty) can then be estimated as Y,= = exp (6, ), but 
a more refined method based on the mean of lognor- 
mal distribution was used: Y, = - 

exp{6, + + MSE (6. )}, ignoring the g,., -term in 
Qs) which was found to be small. The MSE of i 
was estimated using the approximation 
MSE(0, Ve GV (Y, ). The estimates y, were raked to 
agree with model- based state estimates obtained 
from a state model. The reader is referred to National 
Research Council (1998) for details on x-variables 
used in the county model and evaluation of the 
models. Several criteria were used for evaluating the 
models and the estimates, including regression diag- 
nostics and comparisons to the 1990 Census counts. 


Other applications of the basic area level model 
include the following: (1) Estimation of unemploy- 
ment rates at census tract level (Chand and 
Alexander 1995); (41) Estimation of counts in 
employment categories and household income cate- 
gories at the Congressional District level (Griffiths 
1996); (411) Estimation at the provincial level in the 
Italian Labour Force Survey (Falorsi, Falorsi and 
Russo 1995). 


4. EXTENSIONS 


some recent extensions and 


applications of the basic area level model in section 4.1 
and those of the basic unit level model in section 4.2. 
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4.1 Area-Level Models 


Recent extensions of the basic area level model include 
multivariate and time series models and models for disease 
mapping, as noted in section 2. 


4.1.1 Multivariate Models 


Datta, Ghosh, Nangia and Natarajan (1996) used 
multivariate area level (Fay-Herriot) models to develop HB 
estimators of median income of four-person families for U.S. 
States wHere 30 =4(0, 5.02), 0.,)' with 0,,,0,, and ale 
denoting the true median incomes of four-, ee and 
five-person families in state 7. Adjusted census median 
income and base- year census median income for the three 
groups were used as explanatory variables. Diffuse priors on 
model parameters were used along with Gibbs sampling. The 
resulting HB estimators, HB?, for four-person families in 
1979 were compared to the direct Current Population Survey 
(CPS) estimators and univariate and bivariate model-based 
HB estimators, HB! and HB?, treating the 1979 estimates, 
available from the 1980 census data, as the true values. In 
terms of relative absolute error averaged over the states, the 
three HB estimators performed similarly, but outperformed 
the direct CPS estimates. In this application, the univariate 
estimator HB! worked well and it is not necessary to use 
more complicated estimators based on multivariate models. 
Estimates of @,, are used for administering an energy 
assistance program to low-income families. 

Longford (1999) obtained multivariate shrinkage (compo- 
site) estimators of small area means and proportions, and 
illustrated their superiority over univariate shrinkage 
estimators. 


4.1.2 Time Series Models 


(1) Ghosh et al. (1996) developed HB estimators under the 
time series linking model given by (2.5) and (2.6) and 
applied them to estimate median income of four person 
families using direct estimates oO” Dee cans IRIAN 

., 10 for the 51 states over a ten year period. 


(2) Datta et al. (1994) used the time series model (2.10) 
with u, following (2.6) and developed HB estimators. 
They also used methods for validating the model, based 
on cross-validation. They applied the methods to 
estimate monthly unemployment rates for U.S. states. 
HB estimators performed significantly better than the 
CPS estimates, as measured by the CPS and HB 
standard errors. We refer the reader to Datta et al. 
(1994) for details on the x-variables used. Datta, Lahiri, 
Maiti, and Lu (1999) used the linking model (2.8) with 
a random walk model on the U.S, but added extra 
terms to (2.8) to reflect seasonal variation in 
unemployment rates. 


(3) Datta, Lahiri and Maiti (1999) and You (1999) 


obtained EBLUP (EB) estimators and associated 
second-order correct estimators of MSE for the time 
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series/cross-sectional linking model (2.8) with a 
random walk model on u,,’s. Datta et al. used ML 
and REML estimators of model parameters while 
You employed the method of moments estimators. 


Datta, Lahiri and Maiti (1999) used EB estimators to 
estimate median income of four-person families by 
US. states using time series and cross-sectional data. 
They employed the linking model (2.8) with a 
random walk model on u,,’s. Using the 1979 
estimates available from the 1980 Census data as the 
true values, they compared the EB (EBLUP) 
estimates with the HB estimates of Ghosh et al. 
(1996) and the CPS direct estimates. In terms of 
absolute relative bias averaged over states, EB 
performed better than HB and both EB and HB 
performed much better than the CPS direct estimate. 
In terms of coefficient of variation, EB again 
performed better than HB and CPS; second-order 
correct estimate of MSE of EB was used. 


4.1.3 Disease Mapping Models 
ind 


Maiti (1998) used the model y, | 8; ~ P(n;0;) and 
B; = log 0; ~<" N(w, 0”) with diffuse prior on p anda 
gamma prior on o ~. He obtained HB estimators of OF, 
and the posterior variance of 0,, and applied the results to 
the well-known lip cancer data from Scottish Counties 
(small areas); see Clayton and Kaldor (1987) for details. 
He also studied HB estimation under the spatial 
dependence model for B,’s mentioned in section 2.1. 
Estimates of 0,’s are very similar for both the models but 
standard errors for the spatial model are smaller than those 
under the first model. Lahiri and Maiti (1996) obtained EB 
estimators and second order correct estimators of MSE 
under the Clayton-Kaldor model mentioned in section 2.1, 
and illustrated the method on the Clayton-Kaldor data set. 
Nandram et al. (1998) used the age-group specific models, 
mentioned in section 2.1, to obtain HB estimators and also 
developed Bayesian methods to compare alternative 
models, using three different measures of fit. They applied 
the results to estimate age specific and age adjusted morta- 
lity rates for Health Services Area’s (sets of counties based 
on where residents seek routine hospital care) for the 
disease category “all cancers for white males”. 


4.1.4 Other Extensions 


Datta and Lahiri (1995) considered robust HB 
estimation using a class of scale mixtures of normal distri- 
butions on the random effects v, with the basic area level 
model. This class includes t, Laplace and logistic distri- 
butions; Cauchy distribution for outlier areas was adopted. 

You (1999) considered the more realistic sampling 
model (2.4) on Y, with sampling errors e; and the linking 
model (2.1). Assuming V¢e; | Y,) = VW ie and 

9. = log(Y,), he used HB methods to demonstrate that for 
small sample sizes the posterior inferences under the 


sampling model (2.4) can be significantly different from 
those under the sampling model on 6.. 


4.2 Unit Level Models 


Recent extensions at the basic unit level model include 
multivariate models, two-way and two-level models, random 
error variance models and logistic linear mixed models, as 
noted in section 2. 


4.2.1 Nested Error Regression Models 


Rao and Choudhry (1995) provided an overview of small 
area estimation in the context of business surveys. They also 
studied the performance of EBLUP estimator of a small area 
total relative to traditional estimators through simulation 
using real and synthetic populations. 

As noted in section 2, model-based estimators for unit 
level models do not depend on the survey weights. Prasad 
and Rao (1999) obtained model-assisted estimators for the 
nested error regression model that depend on survey weights W; 
and remain design-consistent as the sample size, n,, in- 
creases. The unit level sample model is first reduced to 

ais =x, B ahs Ves) (4.1) 
where y,,=) wy, with w,=w,/)jw, and similar 
expressions for x, and @,,. A pseudo-BLUP estimator of 
0, = X/B +v,, for fixed 0; and 07, say 8, (0,, 0,) is then 
obtained from the reduced model (4.1), noting that 
é, “= NO, 0, DW). where X, is the vector of known 
population means and Y, ~ Q; for large N. (This estimator is 
called pseudo-BLUP because it is different from the BLUP 
estimator under the full unit-level sampling model). The 
unknown parameters o and a. are then replaced by model- 
consistent estimators 6, and 6° under the full model to 
obtain the pseudo-EBLUP estimator 8, = 6, (on 6°). This 
estimator is model-assisted and it is approximately design 
and model unbiased even if the sample design is nonignor- 
able. Prasad and Rao (1999) also obtained a second-order 
correct estimator of MSE(@,,,). You and Rao (1999b) deve- 
loped a pseudo-HB methodology which leads to estimators 
similar to the pseudo-EBLUP estimators of Prasad and Rao 
(1999): 

Singh, Stukel and Pfeffermann (1998) made a compa- 
rison of frequentist and Bayesian measures of error, using 
analytical and empirical methods for the basic unit-level 
model. 

Stukel and Rao (1999) obtained EBLUP estimators and 
associated approximately unbiased (or second-order) correct 
MSE estimators under two-way nested error regression 
models. Simulation results of Stukel and Rao (1999) 
suggested that the behaviour of relative bias of MSE 
estimators is more complex than in the one-way case. 


4.2.2 Two-Level Models 


Moura and Holt (1999) obtained EBLUP estimators and 
associated second-order correct MSE estimators for the two- 
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level models. They obtained EBLUP estimators and used 
them on data from a sample of 951 retail stores in 
Southern Brazil classified into 73 small areas. They 
compared the average second order correct MSE of the 
estimators to the average MSE value for the nested error 
regression model to demonstrate improvement in 
efficiency. You and Rao (1999a) applied HB methods to 
the Brazilian data. They studied three different two level 
models: (1) equal error variances; (2) unequal error 
variances; (3) random error variances. Bayesian 
diagnostics revealed that model (2) fits the data better than 
models (1) and (3). 


4.2.3 Random on Error Variances Models 


Arora and Lahiri (1997) studied the unit-level model 
with random error variances o. and assumed 


‘4 
oO. Ld. G(a, b). They obtained the EB estimator of 


I 
small area mean Y, and applied the Laird-Louis bootstrap 
to estimate its MSE, taking account of the variability due 
to estimation of model parameters. 

Arora and Lahiri (1997) obtained a reduced model from 
the unit level random error variances model by incorpo- 
rating survey weights. They performed HB analysis on the 
reduced model with o,° ~  G(a,b), and applied the 
results to estimate the average weekly consumer expendi- 
tures of various items, goods and services for m =43 
publication areas (small areas) in U.S.A. 


4.2.4 General Linear Mixed Models 


Datta and Lahiri (1997) studied the general linear 
mixed model with a block diagonal covariance structure, 
(2.12). They developed EBLUP estimators and associated 
second-order correct estimators of MSE, using REML or 
ML estimators. In the case of ML estimators an extra term 
of order O(m ~!) should be subtracted. Das, Rao et You 
(1999) extended these results to the general mixed 
ANOVA model (2.13) in which case the asymptotic set-up 
is more complex. 


4.2.5 Multivariate Nested Error Regression Models 


Datta, Day and Basawa (1999) obtained EBLUP (EB) 
estimators and second order correct estimators of MSE, for 
the multivariate nested error regression models. They con- 
ducted a simulation study using the sample sizes and 
auxiliary variable values given by Battese, Harter and 
Fuller (1988). Further, they estimated the model para- 
meters for their multivariate model using Battese ef al., 
data on crop areas under corn and soybeans for m = 12 
counties in North-Central Iowa. Treating the estimated 
parameters as true values, they generated simulated 
samples and showed that the multivariate approach can 
achieve substantial improvement over the univariate 
approach inefficiency. 


4.2.6 Logistic Linear Mixed Models 


Farrell, MacGibbon and Tomberlin (1997a, 1997b) 
studied EB estimation for binary y, assuming the sampling 


183 


model y,, | 9; me Bernoulli(®@,,) and the linking logistic 
model log {8;,/(1-8,)}=x/.B + v, with v, “" NCO, 0.). 
The conditional distribution of 0..’s is approximated by a 
multivariate normal to get an EB estimator of local area 
proportion ie . They employed the bootstrap method of Laird 
and Louis (1987) to get a bootstrap-adjusted estimate of 
variability associated with the EB estimator. But results of 
Butar and Lahiri (1997) for the linear case suggest that the 
bootstrap method may not be second-order correct in the 
nonlinear case as well. Jiang and Lahiri (1998) also studied 
EB estimation for the above model and obtained the EB 
estimator exactly through one-dimensional numerical 
integration. They called the EB estimator an empirical best 
predictor (EBP) which may be more appropriate because no 
priors on model parameters are involved. Employing method 
of moment estimators of model parameters B and o,, they 
also obtained an approximation to MSE of the EB estimator 
correct to terms of order m~!. Jiang, Lahiri, and Wan (1999) 
proposed a jackknife method of estimating MSE that is 
applicable to general longitudinal linear and generalized 
linear mixed models. This method leads to second-order 
correct MSE estimators and looks promising. But one needs 
to recompute the REML estimates of model parameters by 
deleting each area in turn. The computations can be signifi- 
cantly reduced by using a single step of the Newton-Raphson 
algorithm with the estimates from the full sample as starting 
values. Properties of this simplification remain to be studied. 
Booth and Hobert (1998) argued that the conditional MSE of 
the EBP given the i-th area data is more relevant as a mea- 
sure of variability than the unconditional MSE because it is 
area-specific. Fuller (1989) earlier proposed a similar 
criterion in the context of linear mixed models. But the MSE 
estimator (3.8) shows that it is possible to obtain area- 
specific estimators of the unconditional MSE, at least in the 
linear model case. Also, it is not clear how one should 
proceed with the conditioning when two or more small area 
estimators need to be aggregated to obtain an estimator for 
a larger area. How would one define the conditional MSE of 
the larger area estimator? 

Malec et al. (1997) used logistic linear mixed models and 
the HB approach to estimate proportions for demographic 
groups within U.S. states. Data from the National Health 
Interview Survey were used for this purpose. Cross-valida- 
tion methods were used to evaluate the model fit. For one of 
the binary variables observed for respondents to the 1990 
census long form, they compared the estimates from alter- 
native methods and models with the very accurate census 
estimates of true values. For logistic linear mixed models, 
not all the conditional distributions for Gibbs sampling have 
closed form unlike those obtained for the probit linear mixed 
model derived from a latent variable approach (Das et al. 
1999); 

Malec, Davis and Cao (1996, 1999) studied logistic linear 
mixed models to estimate overweight prevalence for sub- 
groups (small areas) using National Health and Nutrition 
Examination Survey (NHANES III) data. Again, HB 
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methods were used but survey weights were incorporated 
using a pseudo-likelihood. Folsom, Shah and Vaish (1999) 
studied general logistic mixed linear models in the context 
of estimating substance abuse in U.S. states from the 1994- 
1996 National Household Surveys on Drug Abuse. They 
developed survey-weighted pseudo HB estimators and 
associated posterior variance, using MCMC methods. 

Ghosh et al. (1998) applied the HB approach to genera- 
lized linear mixed models and used the results on two real 
data sets. The first data set, based on a 1991 sample of all 
persons in 15 geographical regions of Canada consists of 
responses classified into four categories to the question 
“Have you experienced any negative impact of exposure 
to health hazards in the work place?” Objective here is to 
estimate the proportion of workers in each of the four 
response categories for every one of 60 groups cross- 
classified by 16 geographical regions and 4 demographic 
(age X sex) groups. The second data set relates to cancer 
mortality rates for the 115 counties in Missouri during 
1972-81. 


5. DISCUSSION 


We briefly discussed, in section 1, survey design issues 
that have an impact on small area statistics. Preventive 
measures at the design stage, such as those proposed by 
Singh, Gambino and Mantel (1994), may reduce the need 
for indirect estimators significantly, although for many 
applications sample sizes in some domains of interest may 
not be large enough to provide adequate precision even 
after taking such measures. As noted in section 1, some- 
times the survey is deliberately designed to oversample 
specific domains at the expense of small samples or even 
no samples in other domains (areas) of interest. 

We have provided a brief overview of the literature, 
over the past five years or so, on model-based small area 
estimation. The methodological developments and appli- 
cations are both impressive, but it is necessary to exercise 
caution in using model-based methods because of the 
underlying assumptions. Good auxiliary information 
related to the variables of interest plays a vital role in 
model-based inference. As noted by Schaible (1996), 
expanded access to auxiliary information through coordi- 
nation and cooperation among federal agencies is needed. 

Model validation also plays an important role in model- 
based estimation. Fay and Herriot (1979), Ghosh and Rao 
(1994), Dick (1995), Malec et al. (1997), Datta, Lahiri, 
Maiti, and Lu (1999), You and Rao (1999a), National 
Research Council (1998) and others used some methods 
for model validation and illustrated their application. But 
the available methods for handling models with random 
effects are not as extensive as those used for the standard 
linear and non-linear models with only fixed effects. More 
work, both classical and Bayesian, on model diagnostics 
for random effects models is needed. 


Area-level models have wider scope than the unit level 
models because area-level auxiliary information is more 
readily available than unit-level auxiliary data. But the 
assumption of known sampling variances, ,, is quite 
restrictive, although the methods used in the applications 
(section 3.4) seem to be promising. It should be noted that 
errors in estimating , do not affect the model-unbiasedness 
of the EBLUP(EB) estimators provided the mean of 0, in the 
linking model (2.1) is correctly specified. But the efficiency 
of the estimator is affected as well as the validity of the MSE 
estimators (3.7) and (3.8). More work is needed on 
obtaining good approximations to the sampling variances. 
This task becomes more difficult when using multivariate 
and time series area levels models because sampling 
covariances are also needed. 

Recent work on incorporating survey weights into model- 
based estimation under unit-level models is promising, but 
the assumption that the sample design is ignorable may not 
be true for some applications. Krieger and Pfeffermann 
(1997) proposed methods for direct estimation of large area 
parameters that take account of the sample selection effects. 
It would be useful to extend this work to indirect estimation 
of small area parameters. 

The Hierarchical Bayes (HB) approach is a powerful 
method for small area estimation because it can handle 
complex problems and the inferences are “exact”. But, as 
noted in section 3.3, caution should be exercised in the 
choice of improper prior distributions on the model 
parameters. 

We studied model-based estimates of small area totals or 
means, but they may not be suitable if the objective is to 
identify domains with extreme population values or to rank 
domains or to identify domains that fall below or above some 
prespecified level. Ghosh and Rao (1994) reviewed some 
methods for handling the latter cases. For a simple model, 
Shen and Louis (1998) proposed “‘triple-goal” estimators that 
produce good ranks, a good distribution and good area — 
specific estimators. It would be useful to extend their 
approach to handle more complex models that are suitable 
for small area estimation. 
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Population Based Establishment Sample Surveys: 
The Horvitz-Thompson Estimator 


MONROE SIRKEN and IRIS SHIMIZU’ 


ABSTRACT 


The Population Based Establishment Survey (PBES) is a linked population/establishment sample survey in which listings 
of the establishments having transactions with households in a population sample survey serve as sampling frames for 
establishment surveys. This paper presents and discusses the PBES Horvitz-Thompson estimator of X, the sum of a variate 


over the transactions of all establishments. 


KEY WORDS: Network sampling; Establishment transactions; Integrated sample design. 


1. INTRODUCTION 


Whenever free-standing sampling frames are unavailable 
or when available frames lack good coverage of establish- 
ments or lack good measures of establishment size, the 
Population Based Establishment Survey (PBES) is an 
attractive design alternative to the conventional establish- 
ment sample survey. And whenever the variate of interest 
refers to rare and elusive populations that are hard to reach 
directly, the PBES is an attractive design alternative to the 
conventional population sample survey. 

This paper presents the PBES Horvitz-Thompson esti- 
mator of X, the sum of a variate over the M transactions of 
R establishments. Let M_ be the total number of transac- 
tions of the establishment F.(7=1,...,R) during a specified 
calendar period. The task at hand is to design a multi- 
purpose establishment sample survey to estimate the Xs for 
a large number of different variates. Typically, establish- 
ment surveys that seek to estimate X are designed as two- 
stage sample surveys in which establishments are selected 
with probabilities proportionate to size, and their trans- 
actions are the second stage selection units. Designed in 
this manner, establishment surveys require free-standing 
sampling frames with good coverage of R establishments 
and good measures of establishment sizes, the Ms. 

Though listings of households and persons enumerated 
in population sample surveys often serve as sampling 
frames for other population sample surveys (Mathiowetz 
1987; Cox, Folsom and Virage 1987), listings of establish- 
ments that have transactions with households in population 
sample surveys rarely serve as frames for establishment 
sample surveys. The Consumer Price Index (CPI) which 
depends on data collected in population and establishment 
surveys (Leaver and Valliant 1995) is a notable exception. 
Households enumerated in the CPI Continuing Point of 
Purchase Survey (CPOPS), a population sample survey, 
report the establishments with whom they had transactions 
(purchased merchandise). The listing of establishments 


reported in CPOPS serves as the sampling frame for the 
CPI Pricing Survey, a sample survey of retail establish- 
ments that collects prices for a basket of consumer goods. 

Several years ago, a Panel of the Committee on National 
Statistics, National Research Council (Wunderlich 1992), 
suggested that the National Center for Health Statistics 
(NCHS) investigate the feasibility and potential gains of 
using listings of medical providers that are reported by 
households in the National Health Interview Survey (NHIS) 
as sampling frames for NCHS’ national medical provider 
sample surveys which were then and still are independently 
designed as conventional establishment sample surveys. 
[The NHIS is an on-going household survey of about 
42,000 households annually that is conducted by the NCHS 
to obtain national health statistics for the U.S. civilian non- 
institutional population (Massey, Moore, Parsons and 
Tadros 1989)]. The Committee’s suggestion initiated a 
PBES research program at NCHS. 

Judkins, Berk, Edwards, Mohr, Stewart and Waksberg 
(1995) compared the operational and design features of the 
health care surveys if linked to NHIS with design features 
of independently designed health care surveys. Judkins, 
Marker, Waksberg, Botman and Massey (1999) made rough 
cost/error comparisons of an independently designed dental 
survey and a PBES dental survey linked to NHIS. They 
tentatively concluded that if a reasonable list with a reason- 
able measure of size can be found, an independently design- 
ed dental survey is probably preferable, and otherwise the 
dental survey linked to NHIS should be considered. 

More recently, the PBES research has been theoretically 
oriented, focusing on the problem of constructing alterna- 
tive unbiased PBES estimators with different data require- 
ments, and getting closed formulas for their variances. 
Conceptual difficulties initially encountered in this effort 
were Overcome once it was recognized that the PBES is a 
population network sample survey (Sirken 1970). Applying 
network sampling theory, Sirken, Shimizu, and Judkins 
(1995), and Shimizu and Sirken (1998) obtained two 
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versions of the unbiased PBES multiplicity estimator and 
derived their variances. In this paper, we present the 
unbiased PBES Horvitz-Thompson estimator and _ its 
variance. The PBES estimators are essentially extensions to 
multiple stage sampling under special conditions of single- 
stage network sampling estimators that were originally 
proposed by Birnbaum and Sirken (1965), and described by 
Thompson (1992). 


2. NOTATION 


Let Mj represent the number of transactions of the 
establishment E(J= ieee Pell 
R 
M= Ss M, = the total number of transactions 
jel 
of the R establishments. (1) 


Let N; =the number of households having transactions with 
establishment F.(j=1,..., R), Nii = number of households 
having transactions with both establishments E. and 
E,(j#!), and N, = number of households not having any 
transactions with any establishments. Then 


R 
Nig Nien Ds » Ny= 
the total number of households having 
transactions with R establishments, (2) 
and 
N=N~* +N, =the total number of households. (3) 


Let the value of the variate for the kth (k = 1,..., M.) 
transaction of the establishment Ej =i |e) abewdenoted 


sum of the variate over M, transactions 
of the establishment E., (4) 


and 


R 
> ere 
j=l 


sum of the variate over M transactions 
of R establishments. (5) 


3. THE NETWORK SAMPLING ERROR MODEL 


A PBES is conducted to estimate X. First, a population 
sample survey based on a random sample of n households 
H,(i=1,...,2) 1s conducted in which sample households 
identify each of the establishments with whom they had 


transactions during a specified calendar period. After elimi- 
nating duplicate reports of the same establishments, a 
follow-on establishment survey is conducted with the r 
distinct establishments reported by n households in the 
population sample survey, and each sample establishment 
EG =1,....,7) independently selects and reports the 
variates for a random sample m. of its M, transactions. 

Judkins et al. (1999) view the PBES as a 2-stage esta- 
blishment sample survey in which the r establishments that 
had transactions with n sample households in the population 
survey are first stage selection units, and the m. transactions 
(j = 1,...., 7) selected by each of the r establishments, are 
second stage sampling units. However, the PBES design 
features become more transparent, and the PBES estimators 
and their variances more tractable when the PBES is 
modeled as a 2-stage network sample population survey. 
From the network sampling perspective, households are 
first stage units, and transactions that are countable at 
sample households in compliance with the PBES counting 
rule are second stage units. 

The PBES counting rule specifies that every household 
in the network of NV. households that had transactions with 
EG =1,....,R) is linked to the same fixed size random 
sample m, of the M. transactions of the establishment E}- 
The PBES counting rule implies that the same m. trans- 
actions of E,(j = 1, ...., R) are countable in the population 
survey at every sample household belonging to the network 
of N, households that had transactions with E.. From the 
network sampling perspective, establishments that have 
transactions with households are proxy respondents for 
transactions that are countable at households. PBES house- 
holds do not report about their own transactions nor about 
the transactions countable at their addresses vis-a-vis the 
PBES counting rule. Households identify establishments 
with whom they had transactions and those establishments 
select the subsamples of their transactions that are count- 
able at sample households and they report the variates for 
the selected transactions. 

The PBES counting rule produces a configuration of 
transactions between establishments and households that 
partitions the NV households into R establishment networks, 
A; (j = 1,....,.R), where the network A, contains the set of NV. 
households and is linked to the M, transactions of E.. 
Though the same household may belong to multiple net- 
works, each of the M transactions is uniquely linked to one 
and only network. 

Networks are counted differently by PBES multiplicity 
estimators and by the Horvitz-Thompson estimator. Multi- 
plicity estimators count the M, transactions linked to the 
network A,(j = 1,...., R) every time households belonging 
to the network A. are selected in the population survey 
sample. The Horvitz-Thompson estimator does not depend 
on the number of times that households belonging to the 
same networks are selected in the population survey. The 
PBES Horvitz-Thompson estimator counts each distinct 
network only once. 


Survey Methodology, December 1999 


4. THE PBES HORVITZ-THOMPSON 
ESTIMATOR 


For a sample of n households selected by simple random 
sampling, and a total sample of 


m= » m, = transactions, (6) 
= 


where the transaction subsamples m, Crone ary are 
selected independently and by simple random sampling, the 
PBES Horvitz-Thompson estimator of X is 


R a. 
X’= 2D — x’. (7) 


Here a. is a random variable that is equal to | if any of the 
n sample households belongs to the network A; and at; iS 
equal to 0 otherwise, and 


m. 
y} 


ay 
soman® 
is the unbiased estimator of X,(j = 1,..., R) (8) 
and 
p, = E(a,) = 


the probability of any of the n sample 
households belonging to network AY = bree) AO) 


X’ is an unbiased estimate of X if everyone of the R 
establishments has transactions with at least one household. 


Let 
q; = 1 Pj iz 


the probability that none of the n sample 
households belongs to the network A, (10) 


If n households are selected by simple random sampling 
without replacement, 


NIN: 
j 


(11) 


If n households are selected by simple random sampling 
with replacement, 


scale iin 
Nee 


q; (12) 
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There are two potential measurement problems involving 
the GS(J=1, r). First, they are dependent on the 
Nis (J = 1,...,7), Quantities that are often difficult to 
ascertain in establishment surveys. Second, it would be 
difficult to compute the qjs for most population surveys 
which, like the NHIS, are based on complex sample 
designs. 


5. THE VARIANCE OF THE PBES 
HORVITZ-THOMPSON PBES ESTIMATOR 


The variance of the Horvitz-Thompson estimator of X 
may be written as 


Var (X') = VarE(X'|Q) + E(Var X'|Q) (13) 
where (X’|Q) denotes the value of X’ conditional on a 


fixed sample Q of n households. 
Consider the first term on the right side of (9), 


Var E(X'|Q) = Var 


2 at 


joie we, 
R a 
=) | Var(a,) 
j=l D; 


hae Cov (a,a,). (14) 
I 


Since a, is a binomial random variable 


Var(a,) = pj ~P; (15) 
and 
Cov (a,a,,) nies Wyse (16) 
where 
Poa Gad 1!) (17) 


is the joint probability that any of the n sample households 
belongs to the networks A. and A,, and qu G#l) is the 
probability that the n sample households are linked to 
neither the network A_ nor A). 

For simple random sampling of n households with 
replacement, 


, (WENN ND 
qi, =—_1—_—_+ , (18) 
Nie 


and for simple random sampling of n households without 
replacement, 
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NSN Nee 
J J 
gq, =~ (19) 
N 
Consider the second term on the right side of (13), 
1 a a; 2 V/ 
E(Var X'|Q) =E yS, — M; Var (X,’) 
j=l P; 
R V y! 
SS (20) 
}} 
Hal P; 
Van (1) = Semeirae (im (21) 
iy 
where the population variance 
M; 
ose) 
: oe An)? (22) 
Or iOGh= 
J M,-1 


Suppose the PBES is designed as a self-weighting 
sample. Then, "D (m,/M)) =f, where f is the overall 
sampling ratio of selecting a transaction. For a prescribed 
value of f, the size of the sample of transactions selected in 
the establishment E, is 


j ae = Ss So ti cory . (23) 


Combining (14) and (20), the variance of the PBES 
Horvitz-Thompson estimator of X is 


yu P; j=l 14 PP; 
RM? M.-m. 
my ere J J o°( A 


The first two terms on the right side of (24) represent the 
between establishment component of variance due to 
sampling households. The second term on the right 
vanishes if none of the N households has transactions with 
more than one establishment. The third term on the right 
side of (24) is the within establishment component of the 
variance due to subsampling transactions, and vanishes in 
single stage sampling when the sample establishments 


report the variates for all their transactions. Single stage 
sampling is more likely to be the design option in a single 
purpose PBES than in a multi-purpose PBES, especially 
when the variate of interest represents a relatively rare 
event. 


6. CONCLUDING REMARKS 


All unbiased PBES estimators, whether the Horvitz- 
Thompson estimator proposed in this paper or the PBES 
multiplicity estimators proposed by Sirken, Shimizu and 
Judkins (1995) and Shimizu and Sirken (1998) depend on 
multiplicity parameters to adjust for variations in the selec- 
tion probabilities of the establishments reported in the 
population sample survey. However, multiplicity and 
Horvitz-Thompson estimators differ in the ways multipli- 
cities are defined and in likelihood of successfully 
collecting this information in the follow-on survey with the 
establishments that were reported in the population survey. 

The feasibility and ease with which establishments can 
provide the multiplicity information is a key factor in 
deciding on which kind of PBES estimator, if any, is most 
appropriate in particular applications. The N.s and 
M's (Vj =1,..., 7) respectively are the multiplicities needed 
by the PBES Horvitz-Thompson estimator and the PBES 
multiplicity estimators, where N. is the number of house- 
holds having transactions with the establishment E., and 
M. is the total number of transactions of the establishment 
ie bie N;s are unlikely to be readily available except at 
establishments, such as health maintenance organizations, 
utility companies, and home owner insurance companies, 
for which households are the transactional units. On the 
other hand, the Ms are likely to be available at many 
establishments that tend to keep track of the total number of 
services provided though unlikely to know the number of 
households to whom services were provided. 

The PBES is a sample survey design option with many 
potential applications. It is a mechanism for linking popu- 
lation sample surveys to data files of establishments. 
Because the mechanism does not require disclosure of 
personal identifiers, PBES would not be restricted by the 
kinds of confidentiality concerns that ordinarily limit access 
to establishment data files. PBES offers the prospects of 
being able to estimate the volume of establishment trans- 
actions under circumstances beyond the capabilities of 
conventional establishment sample surveys when free- 
standing establishment frames are unavailable or inade- 
quate, and beyond the capabilities of conventional popula- 
tion sample surveys when the variates of interest relate to 
rare and elusive populations that are hard to reach directly. 
Determining which, if any, of these and possibly other 
potential PBES contributions are realizable will require 
research studies comparing the cost and error effects of 
PBES estimators and estimators of conventional establish- 
ment and population sample surveys. 
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Variance Estimation for Complex Statistics and 
Estimators: Linearization and Residual Techniques 


JEAN-CLAUDE DEVILLE’ 


ABSTRACT 


In a sample survey, in the absence of external information, the total of a variable is estimated using the Horvitz-Thompson 
estimator. Its variance is in turn estimated by calculating a fairly complex quadratic form, generally recursively. In this 
paper, this problem is assumed to be solved on the basis of a software capable of carrying out the calculation automatically. 
In the case of complex estimators (i.e., of the calibration type), and in that of non-linear statistics (substitution estimators), 
it is shown that the same tool may always be used provided an appropriate artificial variable is chosen. In all cases, this 
artificial variable provides an estimation of the variance that is approximately unbiased and constructed using the influence 
function technique as well as some asymptotic postulates. Many examples are provided for the use of this technique: 
complex but explicit functions of totals (correlation coefficient), implicit functions of totals, calibrated estimators, fractiles 


and rank statistics, statistics derived from factorial methods. 


KEY WORDS: Variance estimation; Complex statistics; Linearization; Substitution estimators; Residual technique; 
Influence function; Implicit parameters; Fractiles; Rank statistics; Factorial analysis. 


1. INTRODUCTION 


The formulation of results in the form of confidence 
intervals is the goal (rarely reached) of all sample surveys. 
The most common procedure consists in estimating the 
variance of the statistics involved for the probability distri- 
bution induced by the sampling scheme (and sometimes, for 
the sake of simplicity, following fairly drastic assumptions 
called models). Then, following the assumption, rarely con- 
tradicted by the facts when the samples are large enough, 
that the statistic follows a normal distribution, a confidence 
interval symmetric about the point estimation is derived 
according to simple, standard procedures. 

There is abundant literature dealing with this problem, 
before and after the benchmark work found in the book by 
Wolter (1985). 

The goal of this paper is to show how simple tools can be 
used to effectively carry out a variance estimation in com- 
plex cases by means of a unique technique, i.e., lineariza- 
tion. We will first describe the state of the art concerning 
the estimation of the variance of the Horvitz-Thompson 
estimator for a total. After providing a definition of “lin- 
earizable statistic” and a description of the concept of 
influence function analogous to that used in non-parametric 
statistics, we will introduce the class of functional substitu- 
tion estimators shown to be linearizable under fairly general 
assumptions. We will show how the usual rules of differen- 
tial calculus can be extended to linearized variables, and 
how, using step-by-step procedures, they can be used to 
calculate fairly easily the linearized variables of fairly com- 
plex statistics. Special attention will be given to statistics 
using quantiles as well as those linked to the most current 
multivariate analysis. 


This procedure is the chief component of the POULPE 
software used at INSEE: 


— Having a tool to estimate the variance of a total using 
a simple expansion estimator. 

— Reverting to this case, using specially constructed 
variables, when using a complex estimator and/or when 
estimating a complex statistic. 


2. GENERAL FRAMEWORK: SIMPLE 
EXPANSION ESTIMATOR 


Let us consider a population U of unitsk, J, ..., for which 
a sample design is defined, i.e., a probability distribution p 
that associates with any part s of U — the sample — a proba- 
bility p(s) of being selected. Using the latter, probabilities 
of inclusion 7, (1, = De eps) are defined, as are proba- 
bilities of inclusion of order 2,7, , for elements of s. It is 
then possible to use the Horvitz-Thompson estimator, 
Y=),.,¥,/m, of the total Y of a variable of interest y. It 
offers the advantage of being (almost) always available and 
unbiased, and its variance 1s easily calculated: 


A ale yy 
Var(Y)=)> 1,1 -2,) = +29) @,,- 5) =eD 
U : U 


k TM, 1 


where the second sum extends to all pairs (k,/) of 
population U. ; 
A useful estimator of the variance of Y is given by: 


en ae RT Ny). (O09 
Kore deme as ie I 
S My s pay Barn 
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In practice, for large samples, this variance estimator is cal- 
culated recursively since the double sum which appears has 
a prohibitive number of terms. Moreover, the probabilities 
of inclusion 2,, can be calculated easily only in some rare 
simple cases. 

In fact, all known sample designs boil down to a few 
simple schemes: Bernoulli or Poisson sampling, simple ran- 
dom sampling, systematic sampling and sampling with un- 
equal probabilities of fixed size. For the first of these, there 
are some closed formulas providing a variance estimate 
based on the sum of squares. The same applies to system- 
atic sampling given a few assumptions that are easily veri- 
fied for selection order. Finally, the variance of sampling 
with unequal probabilities of fixed size, for many selection 
methods, can be approximated in an extremely fine and 
general manner using the following formula, applied in 
POULPE (Deville 1993): 


kl 


(2.3) 


These simple schemes can be combined to provide 
arbitrarily complex designs by means of two operations, 
i.e., Stratification and multi-stage sampling (or sub- 
sampling). 

In terms of stratification, a variance estimate of the grand 
total can be obtained by adding the variances of the esti- 
mators of stratum totals. 

Multi-stage sampling can be obtained when the popu- 
lation is divided into sub-populations U, called “primary 
units”. A sample s, of the latter is selected on the basis of 
a sample design p, applied to the population of primary 
units. Then, for each U,(i€s,), a sample is selected using 
a design p,/s,. Conditionally on s,, these designs are inde- 
pendent. From them are derived the probabilities of inclu- 
sion and the following variance formula: 


Var(Y,) 
| 5 
2 
%y 1; 


where Y, is the total of y for U,,7, its probability of 
inclusion, VA the estimator of Y, for design Piss, Finally, 
if V(Y;;7€5, ) is the variance estimator of ee Y. ft and V, 
a variance ScHimator of A conditionally on St, ‘then 


A Ye 
Var(Y) = Var pe 


Sa i 


(2.4) 


, : Vv, 
Var (7) = V(P,;i€5,) +O (2.5) 


1ES) Tl; 


is a variance estimator of Y (Durbin 1953). 


Naturally, for each stratum / or each primary unit /, the 
sample survey p, or p,/s, can itself be stratified or become 


a multi-stage sampling. However, in all cases, the repetitive 
and recursive use of the abovementioned rules makes it pos- 
sible to calculate a variance estimator using simple elements 
based on the sum of squares. For surveys carried out among 
people, it is customary for a sample design to comprise 
three to five selection stages. 

This means that the quadratic form (2.2) can be calcu- 
lated mechanically, without however any explicit computa- 
tion of the terms involved in the double sum found in the 
formula. 

To complete this overview, it should be noted that a 
sample is frequently selected in several stages, normally 
two or three. This means that a sample s is selected and 
used as a reference population for the selection of a second 
sample r, using a sample design q(r/s). If it is controlled by 
the statistician, this design is generally a stratified design 
with simple random sampling for each stratum. Otherwise, 
the design is described using a response model that makes 
it possible to formalize a reweighting procedure for non- 
response. In all cases, there are second-stage probabilities 
of inclusion P, and P,, describing the inclusion in r of the 
pe k or of the sia (k,/). The expansion estimator is 

een ape y,/m,P 

Its variance cf be calculated fairly easily, and is 

estimated using the expression: 


1,1 
CECA a PD WF fuer het 
r TM, ) Py, ™% Ty 
Pe y y 
f 3 ys 1 eS k I (2.6) 
r P,, } P,m, P 
with T= 1, and Pay = Pi 


In spite of a few difficulties, this variance estimator can 
be calculated mechanically while avoiding the prohibitive 
double sums. The same applies to three-stage designs which 
occur when a non-response stage is added to a second stage 
controlled by the statisticians. Such procedures are used in 
POULPE; 

Thus, the Horvitz-Thompson estimator (or its extension, 
the expansion estimator) has a variance that takes on the 
quadratic form Q(y,;keU). The latter can be estimated 
without bias (or eventually with negligible bias) using the 
recursive calculation of a quadratic form Oy, kes) 
(where s now represents the final sample, no matter how 
many stages were needed to obtain it). In the following, we 
will assume the availability of an “automatic” method of 
calculating this quadratic form. 


3. COMPLEX STATISTICS AND 
ASYMPTOTIC POSTULATES 


We will show that it can also be applied when we use a 
more refined estimator than HT (involving external 
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auxiliary information), e.g., for complex statistics (means, 
quantile ratios, complex indexes such as GINI, the coeffi- 
cient of an econometric model, a principal component 
analysis factor). 

The results we will provide are “asymptotic” approxima- 
tions. As in Isaki and Fuller (1982) or in Deville and 
Sarndal (1992), we postulate the following scheme: in a 
series of sampling problems indexed by an integer v (which 
we will suppress so as not to overload the notation), the size 
N of the population tends towards infinity as does the size 
n (or the size expectation) of the sample. For each v , we 
thus also have a sample design, the associated HT esti- 
mator, a vector of invariable fixed size for variables x, of 
X estimated using X. 

The three following propositions are postulated: 


k 


=' '\N*X has a limit. (onl) 
- WN Bax - X) converges in terms of probability towards 
zero. G2) 


— n-?N-\(X-X) has as a limit a multidimensional 
normal distribution. G3) 


The first postulate formalizes the concept of a series of 
populations of increasing size extracted from a parent 
continuous distribution. This can also be interpreted as if 
the population were an i.i.d. sample of a certain infinite 
superpopulation. The other two postulates relate to the 
convergence of the HT estimator and to the fact that it leads 
to a central limit theorem. In practical terms, these postu- 
lates are satisfied in many cases, given certain technical 
assumptions: simple random sampling (Hajek 1964), 
Poisson sampling and randomized systematic sampling - 
(Rosen 1972), stratified design with the number of strata 
tending towards infinity (immediate application of 
Lindeberg conditions). 

In reality, however, we can never tell whether, for 
example, the design used involves a number of strata 
tending towards infinity! What the asymptotic postulates 
mean is simply that certain magnitudes (technically those 
which are O(n '”)) are considered “small” and that the 
product of the two “small” quantities is a “negligible” (and 
therefore neglected!) quantity. 

On the basis of these postulates, we will show how 
certain estimators and certain non-linear statistics can be 
approximated using HT statistics having the form )” z,/1, 
for well-chosen variables z,. 


4. SUBSTITUTION ESTIMATORS 
AND FUNCTIONALS 


Let us now consider a fairly general class of non-linear 
Statistics of the finite population based on the concept of a 
measurement functional, as well as their substitution 
estimators. 
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With each unit k of the population U there is associated 
a point x, of R? for the p problem variables of interest to 
us. The population U is thus represented by the measure M 
having a unit mass in each of the points x, . 

This measure 1s positive, discrete and finite, and its total 
mass has a value of N. We assume that all the x, are 
separate, without loss of generality (we can always add a 
dimension which is the “rank” of k in arbitrary numbering). 
For any variable y, = y(x,), we thus have fydM = wale 

From an asymptotic point of view, the series of 
populations is a series of measures on R?. According to the 
first asymptotic postulate, this series behaves as if we were 
dealing with 1.1.d. selections for a fixed probability 
distribution on R?. 

A functional T(M) associates with any measure of a class 
containing at least the point measurements, a real number 
or a vector. We also assume that all the functionals of 
interest are homogeneous, i.e., there is a positive real 
number a dependent on T such that T(tM) = t°T(M) for 
any positive real number ¢. A total is a homogeneous 
functional of level 1, a mean of level 0, a sum having a 
double index of level 2. Being limited to homogeneous 
functionals is not too cumbersome in practical terms. 

Now let M (estimator of M) denote the measure 
allocating a weight w, to any point x, for k in s and zero to 
any other point, regardless of the origin of the weights 
(Horvitz-Thompson or calibration). 


Definition: The substitution estimator of a functional T(M) 
is T(M). 

In the case of a total, this definition should not be 
surprising since T(M) = | xdM(x) =) x, w,. For “ordinary” 
complex statistics (ratios, means or indexes, for example), 
this represents the common practices of survey operations. 
The same applies to statistics of rank, with finer points 
having more to do with the estimation of the distribution 
function than the estimation of the fractiles (see for example 
Chambers, Dorfmann and Hall 1992). 

A fairly general class of parameters linked to the finite 
population can be obtained using implicit equations which 
define them. Such is the case, for example, for the adjust- 
ment of a parametric model at the population level leading 
to an “estimating equation” derived from a broad adjust- 
ment principle (maximizing likelihood, minimizing chi-2 or 
“moment” methods or “generalized moment” methods). 

This form of writing introduces the (eventually multidi- 
mensional) model parameter as a functional of M. Its 
estimator (in the sense of sampling) is the same functional 
for M. Thus, the estimation of the least squares in the linear 
model is written as follows: 


B=arg Min) q,(y, - x, BY’. 
U 


The estimation (sampling) of B is B = arg Min), 4, 
(yas Ss The use of B (rather than an estimator for a 
model conditional upon the sample) is much more robust, 
and correctly accounts for the fluctuations of sampling on 
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the result (on this point, see Binder 1983, Binder and Patak 
1994, or Binder and Kovaéevié 1997). 

Generally speaking, an “estimating equation” at the 
population level will be written as T(M, 2) = 0 where T is 
a functional of dimension p parametered by vector A also of 
dimension p. This equation will be assumed to have a 
unique solution for fixed M. The substitution estimator of 
i is the solution of the (estimating) equation T(M, i) = 0. 


5. LINEARIZABLE STATISTIC 


Let us consider some statistics S dependent on the 
observations (x,; kes) (in fact a series of statistics defined 
in each of the sampling problems within the asymptotic 
framework). S is said to have a probability of order f (n) 
(where f is some positive function of n), and we write 
Se O,(f()) if for any ¢ >O there is a constant C such 


that 
P| Jel > c| <8) 
f(n) 


In other words, the survivorship functions of variables 
IS\l/f(n) are uniformly overestimated by the survivorship 
function represented as (C(€),€). 

The third asymptotic axiom (central limit axiom!) can 
therefore be written as N“!(X - X) = O(n '"), and the 
second as N“'X = O (1). In the rest of this paper, we will 
use more or less implicitly the following well-known result 
(see for example Billingsley 1969): 


Result: If a statistic S converges towards a certain 
distribution, and if (S - T) = O,(f(n)) with f(r) > 0, then 
T converges towards the same distribution. Specifically, S$ 
and T have the same limit variance. 

The statistic S is said to be of degree a if N “S tends 
towards a limit. Clearly, for example, a HT estimator is of 
degree |, a ratio of HT estimators is of degree O (or homo- 
geneous). The third asymptotic postulate states that 
nE(X - X)? is of degree 2. The substitution estimator of a 
homogeneous functional of degree a is a statistic of degree 
a. 

The following definition can now be formulated: 


Definition: A statistic S of degree a is linearizable if there 
is a synthetic variable z, (known as the linearized variable 
of S) such that the variance of Z is equivalent to that of S in 
the sense that. 2'2(N °S = N 22) O,(f(n)) with 
f(n)-0. In general, we will almost always have 
f(n)=n aes 

In practice, this means that the variance, and therefore a 
confidence interval, will be estimated for S on the basis of 
the variance of Z (whether or not it is a HT estimator). 

Note, on the other hand, that the definition does not 
imply the uniqueness of the variable linearizing a statistic. 


Specifically, the approximation contained in the definition 
can be more or less fine at two levels: that of the conver- 
gence speed f(n), and, for an equal speed, that of the 
increment C(e). 

Generally speaking, however, the linearized variable z, 
cannot be computed explicitly by means of data from the 
sample. We are then led to replace z, by an approximation Z, 
using certain statistics estimated on the basis of the sample. 
This occurs in the most elementary cases. The matter of the 
legitimacy of this approximation must be dealt with, and 
this can only be done within an asymptotic framework. 


Result: If quantities z, depend regularly on a fixed, finite 
number of estimated parameters, then the variance esti- 
mators O(z,; kes) and O(z,; kes) are equivalent, i.e., 
their difference as normalized by factor n/N? is an 
asymptotically negligible quantity. 


Proof: By “regularly” is meant that Z, = z, + anit whee 
OIE -T'IP?), where I’ is the p vector of the parameters, I” 
is its vector of estimators and €, is a p-variable. The 
asymptotic postulates tell us that n/N? Q(z,) converge 
towards a finite quantity just as n/N*Q(z,,&,) = 
ues A,, 2, 6, if the quadratic form is made explicit, and that 
n/N? Q(E,). We then have: 


O@,) = O,) + 20(,,&)'(F -1) + 0,(r - TIP). 


As lf -Til= O,(n-"?), we obtain the result. 

When the number of estimated parameters tends towards 
infinity, the situation is not perfectly clear. In practical 
terms, obviously, what is meant by the number of estimated 
parameters tending towards infinity? Theoretically, more- 
over, there are some difficulties as can be seen from the 
following two contradictory examples: 


Example: Poststratification. We assume the poststrata 
defined on the basis of a numerical variable, and we 
construct m adjacent poststrata, each of which comprises 
about n/m surveyed units. Here vector I’ is that of the m 
means of poststrata ie p= 1 at m. If m increases with n, 
each estimated parameter Y, is such that Y, -Y = 
O,((n/m) 2). Then IIT - Pll is of the order of m22n-¥2, 
Taking m =n“ with a< 1/3, the previous result and its 
proof remain valid. 


Counter-example: For the estimation of inequality indexes, 
we are led to use statistics such as S = )) y, F(y,) where F 
is an estimation of the distribution function of variable y. If R, 
denotes the rank of y, in the population, we could imagine 
that z, = 1/Ny, R, is a linearized statistic for S. This is 
completely false (Deville 1997). 

The difference with respect to the previous example rests 
in the fact that.S uses an estimated parameter per sampled 
unit, in which case anything can happen! The general 
procedure for dealing with such statistics will be described 
below in section 12. 
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6. INFLUENCE FUNCTION OF A 
FUNCTIONAL AND ASYMPTOTIC 
VARIANCE OF THE SUBSTITUTION 

ESTIMATOR 


Definition: The influence function (if it exists) of a 
functional T is: 


IT(M; x) = lim— (T(M +18, )-T(M)) 
t-0 


where 6, denotes the unit mass assumed at point x. 


Comment: This definition is slightly different from that 
used in the field of robust statistics (Hampel, Ronchetti, 
Rousseeuw, and Stahel 1985). It is made necessary by the 
fact that the total mass of M is variable, and often unknown 
in a Statistical problem. It is nothing more than the differ- 
ential as viewed by Gateaux for a Dirac mass assumed at a 
point x. 

The essential point of this paper can now be formulated: 


Result: Under broad assumptions, the substitution 
estimation of a functional T(M) is linearizable. A linearized 
variable is z, = IT(M; x,) where Tis the influence function 
of Tin M. 


Comment: The influence function can thus be used to 
estimate the variance of T(M). This being said, very often 
the influence function includes in its definition certain 
functionals of M (e.g., a ratio or a mean). We are thus led to 
choose an estimation of the influence function itself in order 
to compute the variance estimation. This choice is not 
necessarily unique. 


Proof of the result: Let us provide the space of 
measurements on R? with a metric d accounting for the 
eae ey GMM 0) iis and a Only) 5 it 
N-'(fydM, - fydM,)- =0 for any variable of interest y. 
The asymptotic postulates mean that d(M/N, M/N) tends 
towards zero. We can visibly ensure that d(MIN, MIN) is 
O,(1/yn) according to the third postulate. Now, let us 
assume that T can be derived in accordance with Fréchet, 
e., for any direction of the increase, in the space of 
“useful” measures provided with the abovementioned 
metric. Thus we have: 


MM 
N~“(T(M HOG My eS —])+ Z Z 
(T(M) -T(M)) = ye 2" yo of 4 2}) 


The result is that: 
ynN “(T(M - T(M))) I ei (w= Io, (1): 
U 


Thus, according to the third postulate, the variance of the 
second member tends towards a limit, that of n/N Var(Z), 
and the result is obtained. 


VW. 


7. EXAMPLES AND COMPUTING RULES 
FOR INFLUENCE FUNCTIONS 


Example 1: If 7 is the total T = { xdM(x) of a variable, the 
influence function of 7 is this variable itself: 7(M, x) = x. 
Specifically, if x = 1, T = N the population size. The 
influence function is then constant, and its value is 1. 

The rules of composition for influence functions are 
copied from those of differential calculus: 


Rule 1: If fis a derivable function defined on the space of 
values for J a vector function, we have: 


FC) SDT) iT. 


(where Df represents the matrixes of the partial derivatives 


of f). 


The proof is immediate. 
Example 2: f(T) = 1/T and T = { xdM, scalar total. The 
influence function is -x/T?. 


Rule 2: If S and 7 are two functionals, we have: 
HGS 82 ID) SUISs =e IOP enna” TAC SIE = S00 > JIBS. 


If J and S have vector values, and if H is a matrix, we 
have, when the products are defined: 


MALyH=hitawand SAD SUS) AT eS AIT: 


Example 3: R = fydM/JxdM = Y/X aratio of two totals. 
The influence function is: 
herd 


2 5 as a Rx). 


For a mean Y = { ydM/ { dM, the influence function is 
therefore: 1/N(y - Y), which is the usual definition, or just 
about, given in the robustness theory (Lecoatre and Tassi 
1987): 


Rule 3. ets'G — 1)... 
S =T1/_,S,. We have: 


te {i 2] 


t=] i 


,q) denote scalar functionals and 


Proof: /(LogS) = — 


Now let T(A) = T(M, 4) denote a family of functionals 
depending regularly on a parameter A that varies in a 
domain of R‘’, with A a measure on this domain. This 
leads to: 


Rule 4: /({ 7(A)dA (A)) = [ IT (4) dA (A). This is elementary. 
Note: The persistency conditions include the possibility of 


reaching the limit under the integration sign. 


If, moreover, @ is a function of R¢ in the domain of T 
measurable for all measures M of interest, we proceed as 
follows: 
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Rule 5: /({ 7(@(x))dM (x);€) = T(@(E)) + ITM, 9 @)3€) 
dM(x). 

Proof: (provided as an example): Let S(M)= 


{ T(M, p(x)) dM (x). We have: 


“[s(M+15,) -S(M)|=— |[T(M +8, (0) -TM, g9)| 
dM(x) + 8T)(T(M + 15,), 909). 


The second term tends towards T(M, p(&)) whenever t 
tends towards zero. The former can be written as follows: 


[JIT (M.9(2); 8) * Ruy gene O] 4M) 


where R is a quantity that tends towards zero (it may be 
assumed that the convergence is consistent at x). The result 
is derived immediately. 

Let us now assume that 7(1) is a functional with values 
in R‘, regular at 4. Specifically, then, matrix 0T/ 0A is 
reversible for any M, and, for fixed M, application 4 7(A) 
is one-one and allows for a partial reciprocal function. 
Equation 7()) = 7, therefore has a unique solution for any 
M, defining a functional A(M). 


Rule 6: The influence function of 4(M) is: 


IX(M; €) = <M, Fa cas a Guba wae) 


Proof: T(M + 18., A(M + 16.) - T(M, i)) = 0, hence: 
IT(M, 98) + 12(M;8) = 0 


This rule may also be needed: 


Rule 7: Let S denote a functional in R‘, and let T, denote 
a family of functionals regularly indexed by ACR’. We 


have: 
oT 
CTs — IS. 
Tale : | a N= "5 

Proof: Writing everything, we have /(T,) = IT(S(M), M). 
The rest is obvious. 

Note, finally, the interesting link between the influence 
function and the functional from which it is derived: 


Result: If 7 is homogeneous of degree a we have: 


[IT(M; x) dM (x) = 7 IT(M; x,) = aT(M). 
U 


The specific case a =0 shows that any homogeneous 
functional has a zero-sum influence. 


Proof: We have: 
T(1 +h)M) - T(M) 
h 


from the definition of homogeneity. The result follows from 
the linearity of the derivation as interpreted by Gateaux and 
the definition of influence function. 


= a aa “2 r(M) 
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8. APPLICATIONS: FUNCTIONS OF TOTALS 


We have already seen that, for linear functionals, 
T(M) =¥,y, = JydM, the influence function is y, itself. 
The application of the notion of influence function becomes 
redundant. It will be noted, however, that it is in no way 
asymptotic. 


Function of totals: If X is a vector of totals, the influence 
function of X is, naturally, the vector x, of the variables 
making up X. As aresult, if T(M) = f(X) =f({xdM), the 
influence function of T is: 


IT(M, x.) =f (XP adit) =f (x, 


where f’(X) is the row vector of the partial derivatives of 
f with respect to the coordinates of X taken at point X. We 
are led naturally to the classical result of Woodruff (1971). 

In line with the above, the substitution estimator of f(X) 
is FO: Its approximate variance is that of f’(X).x,, and 
it is numerically approximated by /f’ (Xx ).x, in compliance 
with common practices. 


Example: The ratio R = f(X, Y) = Y/X of two scalar totals 
is estimated using R = Y/X. This statistic (of degree 0) 
allows as a linearized variable z, = 1/X(y, - Rx,). To 
numerically compute the variance estimation of R, we use 
the approximation Z, = 1/X(y, - Rx,), an expression 
which depends on Y and X and therefore on s; Z, is 
therefore not a linearized variable as understood in the 
definition. 


Example: Ratio estimator. 


It is a = (X/X) Y. If we refer to the previous example, 
the linearized variable of ‘es is y, ~ Rx,, approximated by 
Dig Re And yet it could also be said that the estimated 
variance of ee ,, must be equal to X* times the estimated 
variance of R, which leads to the approximation 
AIX Rx ,) which has many times been deemed more 
interesting han the previous one. This example shows that 
the choice of linearized variable is not necessarily unique 
once external information is used. 

Nevertheless, one of the advantages of the influence 
function approach is to provide computations fairly easily 
in apparently complex cases. 


Example: The correlation coefficient between x and y is 
written as follows: 


Dees pay Yk 
U Nv U 


Pantlen IDD seni E. 3 
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Using the logarithmic derivatives (rule 3), we obtain: 
Up), a I(V. IV yy NAb (Vv IV ye — 1 Vy), 


p (ele ne oh an ae 


The influence of Ay, = 


x “LY is obtained in the 
same way using: U 


wah 
N 


as es 
a 1). ¥x, + Xy, - XY 


(A 
Dany 


xye = Ayy 


hence: I(V,,), =x 
Thend(V,.), = (x, 
with 


ree Pree Oe LY): 
ac and I(V,,., =(y, - Y)? and so, 


(x, =X)0,-Y) aus 


Sy Sy 2 Sy 


N(Ip), = 
And the work is done. 


9. APPLICATION: IMPLICIT 
PARAMETER 


Let us assume that B, a parameter with g components, is 
a solution to an equation of the type: 


H(By i 1B) 0 (9.1) 
U 

where the /, are regular functions of R? in R‘. This 
situation frequently occurs when B is the parameter of a 
model assumed to be valid in the population U. Under the 
usual assumptions of independence, equation (9.1) can 
result from the application of the maximum likelihood 
estimation principle. It is then the equation of the score. In 
the case of a linear model with Gauss residuals, this leads 
to the normal equations that can also be derived from the 
least squares principle: 


l ,~(B) = - SOs x, B) 


O; 
with obvious notations. 
If the functional family H(B) regularly depends on B, we 
have: 


ell 
I(B,), = { x) IT(B,), 
B=B, 


0 


a 1" 
I(B,), = - LAMONT Ot 
(Bo), pas (Bo) 
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In the case of regression, we have: 


1\ -1 
XX 1 ] 
M(B), = {8 5 | ges hes aa poe Ke 


v9; O, Ox 


with the regression residual e,. Thus we simply have the 
linearized variable of the vector of regression coefficients. 
To numerically compute the variance estimator, we use the 
approximation 


aed 

Pers al 
Zs en where T, = 2 fitk 
2 
o; 5 6,1 


Ne 


and 2 =a Biv This expression therefore depends on s 
through T, and 
fsa 
5 5 Op Ts 


Example: Regression estimator. 

When the constant (or the variable 5) is part of the 
regressors, i.e., when there is a vector A such that x; A = 1 
(or o,) for any x, the regression estimator takes on the 
simple form ie iat = X'B where X is the known vector of the 
total of the x,. 

Regression estimation theory (Cochran 1977, Sarndal, 
Swensson, Wretman 1992) tells us that the residuals é, are 
the linearized variable of this estimator, and that they can be 
approximated using the estimated empirical residuals é, 
(note that these only depend on a finite number of 
parameters). 

However, the above leads us to think that we should 
have: 

Var (Ypeg) = X'Var(B)X 

and that a natural “linearized” variable for i should be 
X' Ts plGexye If Me is replaced by its Bepecuition T, we 
notice that X’T' = 2’ and that 1'x, =6,, and we fall back 
on the previous approximation. Note, finally, that the 
quantities X'T, are exactly the weight corrections (or g — 
weights) used in the regression estimator, the use of which 
is often recommended within the framework of variance 
estimation. 

It is quite clear that the two linearized variables lead 
asymptotically to the same result. The choice should 
therefore be based on other criteria. In a few specific cases, 
the concept of conditional estimation justifies the use of 
these g — weights, notably for the poststratified estimator in 
the case of simple random sampling. The general case 
remains fairly mysterious. 

In the case of a logistic regression adjustment, the 
dependent variable y, has a value of O or 1, and the 
equations of the score are written as follows: 


H(B)=)> x,(y,-f{B)) with f(w) =expu/(1 +expu). 
U 
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We therefore have: 


1(B),=( Yo xpxj F/B -F Ox) B)) ly (yp —f G/B). 
U 


Using this variable makes it possible to compute correctly 
the precision of a logistic regression, i.e., taking into 
consideration the sampling scheme. 


10. THE RESIDUAL TECHNIQUE FOR 
COMPLEX ESTIMATORS 


Many complex estimators commonly used nowadays can 
be incorporated into the general framework of external data 
calibration (Deville, Sarndal 1992; Deville, Sarndal, 
Sautory 1993). A vector X of totals of auxiliary variables x, 
is known, and we look for new weights w, confirming the 
calibration equations )’ w,x, = X for any sample s. If we 
look for such weights as close as possible to the HT 
weights, they are found to be necessarily of the type w, = 
1/n, F(x; A) where A is a vector of the same dimension as 
X solving the calibration equations. The functions F, 
depend on the chosen distance and allow limited develop- 
ment in the form F,(u)=1+ g,u+ O(u?). The most 
frequent form is F,(u) = F(q,u), F a unique function. 
Often, also, the q, are all equal to 1. Thus we find in this 
family the ratio estimator (arbitrary F and q, = 1/x,), the 
poststratified estimator (with x, a stratum indicating 
vector), the raking ratio estimator (with x, a margin 
indicating vector and F an exponential function), and the 
regression estimator (F'(u) = 1 + u). 

The asymptotic variance of these estimators can be obtained 
naturally by applying the rules of linearization. The 
calibration equations define A using: 


9 / i ] / 
T(M, A) = fx, F (xj aM) = Yo —X,F, (aj) = X 
AY k 
Since we have 7(M, 0) = X, the application of rule 6 yields: 
IX(M, x) = sad babes 38 
with 


T= |x ad ONE) =e, daa, 
U 


Moreover, the calibrated estimator appears to be the 
substitution estimator of the functional S(M, i) = 
Jy, ie OG d) dM (k), which, according to rule 7, allows for 
the linearized variable y, -x/T~'{ q,y,x,dM (i) =y, -x/ B by 
introducing the vector B of the least squares regression 
parameters into the population for the weights q . 

Thus the variance of the calibrated estimator is obtained 
by replacing, in formula (2.1), the y, by the residuals 
e, = y, — Xi B of the regression of y on x with the weights q. 
For the variance estimation, we use in formula (2.2) either 
é, = y, ~ x, B, or, as in the case of the regression estimator, 


F(x Ne. 


If we now turn to a parameter 7(M) estimated by 
substitution using the weights w, obtained by calibration, 
we have the following important result: 


Result: If 7(M) allows for a linearized variable z,, and if 
T(M,,) is the estimator of 7(M) using the weights w, 
derived from calibration on a vector X = Pryde then e,, a 
residual of the regression z, on x, is a linearized variable 
for T(M, ). 


Proof: The variance of T(M,) is equivalent to that of 
Z,,=)w,2, according to the previous demonstration. 
However, the variance of Z, is equivalent to that of 
Delian 

Comment: Very often, e.g., in the case of an explicit 

‘ . . Pp l 

function of totals, z, is a linear form );_,A,y,. We then 
have: 


Pet Whee 
Vai) WizaaV an aA 
S t=1 


This suggests the following procedure: 


— compute the residuals ¢, of the regressions of y, on 
the x,. 

— form the synthetic variable )), A,€, 

compute the variance of this variable. 


It is quite clear that this corresponds to the direct 
computation of the residuals of z,, which is definitely more 
simple. 

Comment: While it may be trivial, this result is perhaps the 
most useful one in this paper, and this comment simply 
ensures that it will not go unnoticed. 


11. APPLICATION: FRACTILES 


The distribution function F(x) = 1/NCard (k; x, < x) is 
a functional family 1/N{1(€ <x)dM(&). The value of 
influence /F(x), is therefore 


1 
A cea i) aiively) 


For ae€]0, 1[, the fractile t, is defined by F(t,) = a if we 
are ruthless, and by ¢,: F(t, -0)<a< F(t,) if we take into 
consideration the staircase-shape of F. If we are ruthless, 
the ad hoc linearized variable is therefore: 


ok 
Ox 


ey 
F'(t,) N 


=i 
Ley x= a LEE oe 


LGR 1) =a) (11.2) 


The problem arises from the fact that F’(x) idealizes a 
density of the variable at point x which does not exist 
because of the stairs. 
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The difficulty can be overcome by using the following 
construction: 

By definition, a regulating core is a positive function 
K(x, t), confirming, for any x, { K(x, 1)dt=1, which is 
regular (e.g., sufficiently derivable). For any x, K(x, .) isa 
“bell” function about x, e.g., a normalized indicatrix of an 
interval surrounding x. More generally, the support of 
K(x, .) will be an interval containing x. We note G(x, t) = 
{'K(x, u)du and G(x, t)=1-G(x, ft). G(x;.) is a distribu- 
tion function. From an asymptotic point of view, the core K 
depends on the size N of the population; the “band width”, 
i.e., the “mean” width of the support of K(x,.), decreases 
with N. 

We now replace the distribution function by its 
smoothing F(x) = | F(t)K (a, t)dt. For a reasonable choice 
of K, F, is strictly increasing wherever its value is not 0 or 
1, and very close to F'so that all the fractiles ¢,, are defined 
univocally and close to t, no matter how they are defined. 
Following integration by parts, note that we also have: 


F(x) = J G(x, NdF) = > Cex, 
U 


We therefore have: 


] se 
(F(x), §) evoke. §) - Fx@)) (11.3) 
which is entirely analogous to (11.1). 
Since F,, is derivable (G being so), we have: 
1 sWeherea 
Ite (x) = - —(G(t*) ~— a) (11.4) 


Loe 


This formula is entirely analogous to (11. 2) save that 
Fy (ty,,) is perfectly defined. The linearization of t,,, does 
not therefore cause any particular problem, and may be used 
approximately for the linearization of tf, itself. A combined 
strategy consists in using the linearized variable 

1 


=- LG nent. ia 
zy Fi): (xpi, ie) 


with 


K(m) = ——1(ast<b) 


(where [a,b] is an interval containing x, more or less 
arbitrary). A practically correct linearized variable would 
be: 
b-a 
Z, = -————(1(@,, < t,) - a). 
SS 


The interval [a, b] will have to be large enough so that in 


x b-a fe 
a eee eee aoe 1 Ss + 
4 FTA Mest) 


the first factor will be sufficiently insensitive to sampling 
fluctuations. 
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12. INDEXES OF CONCENTRATION AND 
OTHER FUNCTIONALS LINKED 
TO RANKS 


Let us consider a few examples. 
(a) GINI index. 
With 2 = J1(G<x)dM(&), the Gini index can be 
defined as: 
fx T,,dM(x) 


NX 


GINI = 


Applying rule 5, we find for the influence of the numerator 
xT, +JfEl@s<&)dM(E). And yet f&E1(x<&)dM(€)= 
X - fE1(E < x)dM(&) = X - T, x, where x_ is the mean of 
the x, lower than x. Since X is a constant, the numerator 
linearized variable is therefore T, (x - x_). A linearized 
variable for GINI is therefore: 


4% _ Grr 
X X 


IGINI, = F (x,) 


(b) Population below the poverty threshold. 

It is defined as the proportion (of revenues) lower than 
half the distribution median. For the proper weight, let a 
and B denote two numbers between 0 and 1, and let us 
consider the indicator J,, = F(Bt,). The usual indicator 
corresponds to a = B = 1/3. 

The linearization is obvious using the rules under 
section 6 and the convention for writing the distribution 
function derivative: 


U gg(2) = [Fy (2) + F’ Bt, BI, (2) 


1 1 F’(B4,) 

a < = -— 1 < a 
pid s Bt) FBI) 5 Gy US) -9) 
1 F'(B1,) 

= Rae < - ] < te = 
[BGs Bs.) es Mest) +(a- FBH) 


For B = | we are able to find l/,, = 0. 
The variance of the indicator is therefore computed 
simply by using the artificial variable having a value of | if 


oe Bias 


ip) —yeaveand Olt 
(c) Kendall’s coefficient of rank correlation. 

Two numerical variables x, and y, are linked to 
individual k. The ranks of x, and y, respectively can be 
written as Ry" = J... M(x, y) and R,’ = f,., dM(x,y). 
The coefficient of rank correlation is the correlation 
coefficient between Re and jes i.e., following some 
elementary simplifications: 


r= 12} LyprXr amen) - =|. 
Ne 2 
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This expression can be linearized by applying the rules 
related to influence functions. For: T = JR: R, dM (€,n), 
we have: 


IT(x,y) = RR, + [1@< )R, dM n) 
+REAUy sn)dM En) 
=R;R, +A, +B, 


where we have assumed 


A, - Re 


kEUX<x, 


and 


B, a s R. 


kesU:y <x, 


so that finally: 


A B. 
Tro.) Sse ee ee a ped 
Nigh et woe S ut NI Saal 
The variance is computed as follows: 

- The linearized variable is z, = Ir(x,, y,)- 
- Fe and ey are the estimators of the distribution 

functions of x and y respectively. 
— A, is estimated using 


ao y ve 
KEsx,2>X 


and B, likewise. 
— Inthe calculation, we use the approximation of 


A B 
bs Des yes x y nee 
(oer Gn. & a asa —+— (-4)| 


and we calculate the variance of the total of this variable 
estimated using the HT estimator (formula 2.2). 


13. FACTORIAL METHODS 


The principal components of the vectorial variable x, 
are the eigenvectors u of the matrix of covariances 
C=), x, x; ~ XX'. They therefore confirm: 

CY i My with A the eigenvalue. 
u'u = 1 

The variance of A and that of the components of the u 
can be obtained fairly simply. The influence of C is 
IC@)=@ —X) @ — XX) heanfluence. of:Gie— ke 15 


[Cw + Che= hin My =0 Cloak) 


However (Ju)'u =0, and also u’Clu =0 because C is a 
symmetric matrix. By multiplying (13.1) on the left by wu’ 
we have: 


uICu =1h.=(u' @-X)): 


And yet u'(x - X) is equal to X€? where € is the principal 
component associated with (A, u). From this is derived the 
calculation of the variance of 4, the solution to 
Ci - hi =0. 

The variance of the components of u is obtained 
analogously. Let (A,,v) denote another eigenvalue, 
eigenvector pair of C. We multiply equation (13.1) on the 
left by v. We have: eit 


v'ICu +k (v'lu) - A(v'Iu) = 0 


hence: 
Cece, 


At = 
(v'lu) Ae %, 


and therefore: 
OU ee 
lu — pies ee 
» Soa 


Correspondence analysis or multiple correspondence 
analysis is subject to analogous treatment. 

In the case of multiple correspondence analysis (the 
more general case), each individual is characterized by the 
vector x, which “stacks” the indicatrixes of membership in 
the modalities of p qualitative variables (2 in the case of 
correspondence analysis). If] denotes the vector all of 
whose components have a value of 1, we have + =p for 
any k. We then look for vectors u normed by 
1/pN u'Du = 1, with D=diag )) x, =), diag x, such that 
the variance of € = 1/px,u is stationary. This yields a sol- 
ution to the problem of eigenvalues: Cu - pA Du =0 where 
Cae 

The search for a linearized variable for 4 and u follows 
the same procedure as before. We have the relationship 
between influences: 


(IC - pIXD - pXID)u - (C - pXD) lu = 0. 


As IC =xx', ID =diagx, and u’Dlu =0, we obtain 
through premultiplication by w’: 


ae ' 

ney = 1 (2a) 22 voy 
N\\ P P 
where uOv denotes the Hadamard product (i.e., component 
by component) of u and v. We know that u=1 is a 
eigenvector associated with the eigenvalue 1, also the 
largest. We check that for u = 1 we have /A = 0! 

In the same manner, we obtain the components of Ju on 
the other proper vectors v: 


Ve 


[= [=] 2240s] 
N\\ p P Pp 
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The analysis may be continued by calculating the 
variability of a projection onto a factorial design. If A is a 
subpopulation of size N,, the coordinates of its 
representative point on the factorial designs are 


ae 
eA 
u ml 


A 
We linearize a by using the 
u 


10 (IX ,)'u + x Iu and the rest is simple. 


a 


= , 
ED. Geass 


relationship 


14. CONCLUSION 


The linearization of complex statistics has long been 
considered the most flexible and comprehensive method of 
obtaining an estimation of the variance. Specifically, this 
method is applicable to any sample design and to any type 
of estimator. The popularity of methods based on sample 
replications is due largely to the fact that certain statistics 
are considered too complex to be linearized. However, for 
the large class of substitution estimators, the use of 
influence functions and of algebraic rules governing their 
construction makes it possible to obtain fairly simply 
linearized variables by means of which variance estimation 
boils down to the estimation of a total estimated using the 
Horvitz-Thompson estimator. 
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Cosmetic Calibration with Unequal Probability Sampling 


K.R.W. BREWER’ 


ABSTRACT 


Cosmetic estimators are by definition interpretable both as design-based and as prediction-based estimators. Formulae for 
them can be obtained directly by equating these two estimators or indirectly by a simple form of calibration. Since they 
constitute a subset of Generalized Regression Estimators, their design-variances cannot be estimated without knowing the 
relevant second order inclusion probabilities, but under the prediction model to which they are calibrated those probabilities 
do not affect their anticipated variances, so it is more appropriate to estimate these and/or their prediction-variances instead. 
An unanticipated spin-off of cosmetic calibration is a simple and effective method for eliminating negative and unacceptably 
small positive sample weights. The empirical performance of cosmetically calibrated estimators is put to the test using 


Australian farm data. 


KEY WORDS: Anticipated variance; Design-based estimation; Non-negative weights; Prediction-based estimation; 


Regression estimation. 


1. INTRODUCTION 


Cosmetic estimation was introduced by Sdrndal and 
Wright (1984). A cosmetic estimator is one that is readily 
interpretable both as a design-based and as a prediction- 
based estimator. A procedure for constructing a cosmetic 
estimator was suggested in Brewer (1995). An improved 
version of it is presented and discussed in this paper. 

Deville and Sarndal (1992) described a number of 
variants on the theme of calibration. The common thread 
running though them was that for large samples the sample 
weights had to approximate the Horvitz-Thompson (HT) 
weights (Horvitz and Thompson 1952); that is to say, the 
reciprocals, Fe of the first order inclusion probabilities, 
Tl; Weighted sums of the differences between the cali- 
bration weights and the HT weights were minimized to 
achieve this end. The simplest of Deville and Sarndal’s 
calibration estimators was a particular case of the Genera- 
lized Regression Estimator or GREG (Cassel, Sarndal and 
Wretman 1976). It requires only a slight modification to 
become a cosmetic estimator as well. Such estimators will 
be described here as cosmetically calibrated. 

The special case of cosmetic calibration under a strati- 
fied simple random sampling design was treated in Brewer 
(1999). In this paper we consider the generalization to 
unequal probability sampling. In section 2 the cosmetic and 
the calibrated approaches to estimation are outlined and 
shown to be compatible. The design-variance of the cosme- 
tically calibrated estimator is considered in section 3 and its 
prediction-variance in section 4. It is shown in section 5 
that when using cosmetic calibration it is serendipitously 
easy to overcome the problem of negative and unacceptably 
small positive weights. Section 6 contains the results of an 
empirical study based on a somewhat challenging set of 
Australian farm data. In section 7 the concept is evaluated. 


| 


2. THE TWO APPROACHES TO 
COSMETIC CALIBRATION 


Throughout this paper it will be assumed that the popula- 
tion being sampled can be described to a reasonable ap- 
proximation by the following regression or prediction 
model: 


ia. He tae EAU 


E,£;=04;, E,(¢e,)=0 Vkej, (1) 
where x; is a p-vector of explanatory variables Hae unit j 
and €. is ‘a random error with the properties shown, o? is an 
J 2 
unknown scalar and the a; are assumed known. We will 
also write diag(a.) as A. Expressions such as “prediction- 
unbiased” and “prediction-variance” when used in this 
paper refer to unbiasedness, variance efc. in terms of the 
model (1). It is not uncommonly assumed that the a; are 
proportional to some power of a measure of size, say y zy : 
where y lies between 0.5 and 1. When y = | the coefficient 
of variation of E, is constant. The value y =0.5 corres- 
ponds to the situation where the large units behave like 
random aggregations of small units. Solving the model for 
the three cases y = 0.5, 0.75 and 1 usually gives a realistic 
range of variance estimates. 

The cosmetic approach requires that there be an esti- 
mator of B, po such that the standard and the predictor 
forms (Royall 1970) of the GREG estimator are numerically 
equal, i.e., 


Lee V aly ey, oly X SUIT XB oa (2) 


ALE yA XO IXY) PAZ (3) 
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where y and y, are population and sample vectors of the y 
values, X and X. are the full-rank N x p population and 
nX p sample matrices respectively of supplementary vari- 
ables [so that 1,, y = T(y) and 1,,X = T(X)], Tocs(¥) is 
the Cosmetic ene: of T(y) and II, is the nxn 
diagonal matrix of the sample z.. It is assumed here that 
these inclusion probabilities are determined entirely by 
quantities known to the survey designer from non-sample 
sources, so that the question of possible informativeness 
arises only for secondary analysis. fps (y) also possesses 
the internally bias-calibrated property defined by Firth and 
Bennett (1998). 

Expressions (2) and (3) are equal when 1’ (II, '-1L) 
(y =X Spee oi =0. Assuming Biss is of the projection 
form (Q’ >a 'Q’ y,, this condition is satisfied when 
1’ CII, I ) spans the row space of Q’, for then there 
must be some row p-vector @’ such that Ov 
190 SL) co. ta ey Bee 
a 'Q’ ly, aX (Q’X.)° iQ’ yJ)=0 as required. 

Brewer (1995) suggested a way of achieving this result 
using instrumental variables, but subsequent empirical tests 
(along the lines of those described in section 6) indicated 
that this approach was not efficient. It is more efficient, and 
simpler, to take the Best Linear Unbiased Estimator of B, 
Wee =(X‘A, eX a7 1X? ‘A, nye where A. contains only 
Hie sample ‘values in iN and replace the aN factor by 
i hey (II, -I,,) where Z, is n x n diagonal and za Pe A 0 
iS any linear ‘combination of the columns of > For then 


Boos =EX(Z, I = BX XZ ay a) 


w ich) is of the required projection form with Q’ 
Xe Za (a =I, ). Also, since a’ =1,2Z Xx (XK 
a’Q’ 1 GZEX CS iXeyp ex Zeus ~I,). But 
X (X Cane ‘ZA =X (X'X )IX'X a= X a=Z1,, 
12 X (X'X)'X" =1'Z' and a/Q’ = Var! 13) as 
required. 

The choice of Z, is still somewhat arbitrary but, if we 
aim for the (nm = lz, ' to be as closely proportional to the 

mcs possible, p cos Can approximate Baie One case is 
of particular interest here. If (i) the 2, are chosen to be 
proportional to the djs (aiming to minimize the design- 
variance of the GREG), (ii) they are all small compared 
with unity, so that Th -le ao and (iii) the a, themselves 
are proportional to the elements Zz. of z, a linear 
combination of the columns of X, then the choice Bie z 
will achieve the desired close proportionality. 

An alternative way to derive the estimator Baas is to use 
the calibration approach described by Deville and Sarndal 
(1992), in which sample weights are made as “close” as 
possible to the 1; - subject to the condition that, for every 
variable in the columns of X, the sample estimate defined 
by these weights should be without error. The “closeness” 
is defined by an arbitrary distance function, but for our 
present purposes the appropriate function is 


D=(w,-@,)'((,’ -I,)Z;']"' (w, -@,) 


+20! (X'1, -X'w,), 


where Ws is the n-vector of the sample weights Wi, 
Gal a is the n-vector of the inverse inclusion proba- 
bilities 1 "and 2’ isa 1 xp row vector of undetermined 
multipliers. [This is the same as the first variant of 
Calibration Estimation used in Deville and Sarndal (1992), 
except that II;'Z.’ is replaced by (II,’ -I )Z5"] 
Differentiating with respect to w,, 


OD 
ow. 


5 


= 2(1;' =1,)Z;")@w, = 15 1,)- 2X2. 


Solving <2 = 0 yields 
Ow 


AY 


w, 10,11, +(MN;! -1,)Z;'X, &X,;)-1,)Z,)K 1" 


x (XL, =X), 20) 
and the corresponding Calibration Estimator, defined as 
w'y,, reduces to the formula given for Tae (y) in its 
GREG form, shown in (2) above. Since (2) and (3) are 
equivalent, there is also an alternative formula for Ww. 
namely 


w.-1+ (Cl, -1)Z. X 1X (0 1 Zax 


rok. Gi 28. © Nin) (6) 

T cos (y) being the intersection of Sarndal and Wright’s 
(1984) Cosmetic Estimators with Deville and Sarndal’s 
(1992) Calibration Estimators, we will refer to it from now 
on as the Cosmetic Calibration Estimator and will write it 


as Da. = BY): Similarly we will write fs as pate 


3. DESIGN-VARIANCE AND ANTICIPATED 
VARIANCE 


We consider first the design-variance of Dey) and 
also that of any GREG estimator that is prediction-unbiased 
under the model (1). Such an estimator can be written 
T oreo) =Tyr) + {TCX - Typ COB Greg Where Boreg 
is any prediction-unbiased and prediction-consistent esti- 
mator of B. If the sample size is fixed at n, the design- 
variance of Tey) is 


Vale mm (1,7, - Ty YT, z ym (7) 


Wel 
j 
1 


j=2 k= 


where Th is the joint probability of the inclusion of units j 
and k in sample. If (1) holds, j Deh SNE = T(X)B + gaa EY 
where € is the vector of the €;, SO writing €, in the place of 
y, in (7): 
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; Wayei é : 
Vata) = » (1,7, - m,)|€,m; "em! (8) 


The design-variances of the HT and the GREG esti- 
mators are therefore both functions of the m,- Important 
problems that this fact raises have been discussed in some 
detail by Sarndal (1996). Basically they are that the Th 
tend to be difficult to evaluate and that their use involves a 
cumbersome double summation. [To this we may add that 
the Sen- Yates-Grundy (SYG) variance estimator (Sen 1953, 
Yates and Grundy 1953), which is usually the most efficient 
one to use when the sample size is fixed, is easily destabi- 
lised by the presence of small values among the Thins and is 
biased if any of the x, are zero. Zero values can occur 
easily, particularly when sampling systematically. Other 
relevant references on the 2, include Rao and Bayless 
(1969), Bayless and Rao (1970) and Brewer and Hanif 
(1983, 62-68).] 

Sarndal’s proposals were to circumvent the problems, 
either by relaxing the requirement that the first order 
inclusion probabilities be exactly proportional to size or the 
demand that the sample size be fixed. Here we suggest 
another way to circumvent these problems. It depends on 
the fact that if the working model (1) holds exactly, then the 
variations in the 2, from one selection method to another 
(holding the first-order inclusion probabilities constant) 
contribute nothing to the prediction-variance of TRE): 
and hence only trivially to its design-variance. Further, the 
anticipated variance (AV) of (Tey) - T(y)}, as de- 
fined by Isaki and Fuller (1982), which is its variance under 
both the design and model (1), is asymptotically indepen- 
dent of the Tip This may be seen as follows. Since 
T orrc(¥) is both prediction-unbiased and asymptotically 
design-unbiased (Brewer 1979, Sarndal and Wright 1984), 


A 


=o°)) (n;" - 1)a?. (9) 
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This is the same expression as was shown by Godambe 
(1955) to be the minimum possible anticipated variance 
(given the values of 2.) for any design-unbiased estimator 
of T(y). (It also provides the justification for the choice of 
1% a. when seeking to minimize the design-variance.) It 
would therefore seem preferable, if (1) is indeed a useful 
working model, to estimate the AV of (Teg) exity)} 
rather than the design-variance of T,..,(y). It follows 
immediately from (9) that a large-sample estimator of this 
AV is oy -1)a,, where 6? can be the estimator of 
o* obtained from a regular regression package based on the 
use of Bai yg, but preferably from one in which p Bie 
takes the place of B,, yp (cf Fuller 1975). Since the only 
approximation involved in deriving (9) is the omission of 
terms arising from the design-bias, the proposed estimator 
may perform reasonably well in smaller samples where the 
design-bias is known to be small; as, for example, where a 
regression of the y. ona single supplementary variable goes 
almost through the origin. 

If, for each assumed value of y, the sample a are 
normalized to sum to (say) n, the values of 6? will be 
comparable, but the best choice of y is not necessarily the 
one that minimizes G?. A robust estimator of y can be 
obtained by finding the value of 7 for which the correlation 
between (y; je x By? /z;" and the rank of z, is zero. How- 
ever, estimates of y, except where they come from large 
samples, are typically subject to high variance, and should 
be treated with caution, especially if they lie outside the 
range 0.5 <y< 1. 

When the analysis is secondary (i.e., not carried out by 
the person or organization responsible for the design or 
conduct of the survey) the unavailability of certain relevant 
information can cause the sample selection to be informa- 
tive. Special precautions are then usually needed when 
estimating the model (Pfeffermann, Skinner, Holmes, 
Goldstein and Rabash 1998). However if the sample values 
of all the x. are known, o” can be estimated using standard 
regression analysis and the only problem lies in the estima- 
tion of the expression W(t = lay. The HT estimator 
Di me) (a = Dai i is always available as a last resort, but 
if a population total such as that of the z. or of the z. is 
known, or better still both are known, that estimator can be 
improved upon. 


4. PREDICTION-VARIANCE 


It is appropriate to estimate the anticipated variance for 
sample design purposes, but for the analysis of any parti- 
cular sample the prediction-variance is a more logical 
choice. That prediction-variance is, by definition, 
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Eee acaan “ T(y)]? - E. 
ap (w,- Dy, - oy, 


JES JEés 


= p> (w, - ae +> a; 


jes Jes 


vy |2 
Ay Wy = | 


jes j=l 


2 


-o¢ 


N 
yw, (w, - a; 7 yay ae ml (10) 


jes 


= ice 54) | (11) 


Assuming the a; are known or can be satisfactorily 
imputed, (10)-like (9)-can be estimated prediction- 
consistently by replacing o” by 6°. [However the w. are 
not defined for the nonsample units, so it is not possible to 
use either (10) or (11) to obtain a formula or estimator for 
the AV of {Tgnugly)- Fly) }-] 

The first expression in round brackets in (11) is the 
difference between the population sum of the a i and its HT 
estimator, and has design expectation zero. Further, since 
Ww, tends asymptotically to Tia the second such expression 
in (11) is asymptotically zero and negligible for large 
samples. Hence a simpler but still prediction-cum-design- 
consistent estimator of the prediction variance of { Tek) 
- T(y)}is 6? esi; - 1)a;. Since this does not require 
knowledge of the non-sample a; it is an attractive choice 
for secondary analysis. 

Both the suggested estimators conveniently take the 
value zero when every unit in the population is also in 
sample with w.=1 for all 7. However if the disparity 
between the population mean and the sample mean is 
substantial, it may, as in section 3, be necessary to construct 
special estimators of the unknown Seta and related 
population sums by calibrating on whatever relevant 
population data may be available. 


5. THE PROBLEM OF NEGATIVE AND 
OTHER UNACCEPTABLY 
SMALL SAMPLE WEIGHTS 


It was pointed out in Brewer (1999) that strong 
conditions had to be fulfilled before the Representative 
Principle underlying design-based inference could be 
regarded as useful. (This Principle required that for every 
sample unit included with probability 1 there should be 
approximately ie -1 units with reasonably similar 
properties in the non-sample portion of the population.) 
Such strong conditions can nevertheless hold when both the 


population and the sample are large and the inclusion 
probabilities are an explicit function of a known measure of 
size, which is usually a linear function of the columns of X. 

The manner in which the Cosmetic Calibration weights, 
w., are constructed, however, implies that they are better 
indexes of the relevant properties than the a; are them- 
selves. So there is a sense in which the inverse weights, 
wey can be thought of as analogous to inclusion proba- 
bilities. Sample units with large weights (and hence small w, ” ) 
can be considered as typical in their characteristics in that 
they “represent” large numbers of population units. Sample 
units with smaller weights can still be regarded as typical, 
but they “represent” fewer population units. A sample unit 
with weight unity is only on the borderline of being typical. 
It does not represent any other unit. A sample unit with a 
weight less than one is definitely atypical. It does not even 
represent itself. A sample unit with a negative weight is 
perversely atypical and counter-representative. For a small 
enough domain, it can actually produce negative estimates 
of total. Its presence in the sample is a “rare event”. Yet it 
must be part of the population, or it could not be in the 
sample. 

The obvious procedure to adopt for a unit with wi< iS 
to delete it both from the sample and the sample frame, to 
recalculate the w. so that the remaining sample units are 
calibrated on the totals of the remaining population units, 
and then add the deleted unit on as an atypical extra. This, 
of course, is precisely what many design-oriented survey 
statisticians have been doing with “outlying observations” 
for decades. It is also the natural thing to do with sample 
units that are allocated weights in an unacceptable range. 

If, however, we start with a GREG that has not been 
cosmetically calibrated and attempt to remove the unaccept- 
able weights by setting them at unity and recalculating the 
remainder, we usually find that many of the newly recal- 
culated weights are themselves unacceptable. If the proce- 
dure is taken through further iterations, the number of units 
whose weights have been set to unity increases steadily, and 
the larger positive weights that are needed for those that 
remain leads to a substantial increase in prediction- 
variance. 

This problem can be substantially reduced by using 
cosmetic calibration. Wherever a sample contains one or 
more units with such unacceptable weights, each of the 
corresponding 7. values can (by a convenient fiction) be set 
equal to one, and the calculation then repeated. The factor 
(I, = I Z= in (5) and (6) ensures that wherever 1; is 
set equal to unity, the corresponding w. is also unity. The 
comparable factor for the standard GREG, IT,'Z,', does 
not possess this property. 

Removing negative and unacceptably small positive 
weights in this fashion provides no absolute guarantee that 
the remaining weights do not include some large ones. 
There is then the danger of introducing a substantial design- 
bias, but the results of the empirical study presented in the 
next section suggest that this danger is less than might be 
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feared. Where the inclusion probabilities increase only 
modestly with size, the cosmetically calibrated GREG can 
be seen to reduce the incidence of unacceptable weights 
substantially, and for one sample design entirely eliminate 
it, without materially increasing the design-variance or 
introducing any appreciable squared bias term into the 
design-MSE (mean squared error). 


6. AN EMPIRICAL STUDY USING 
AUSTRALIAN FARM DATA 


The actual performance of cosmetic calibration as 
compared with certain alternative estimation procedures has 
been studied using data obtained from two farm surveys 
conducted by the Australian Bureau of Agricultural and 
Resource Economics using economic and production data 
collected from a sample of 904 farms in the annual 
Australian Agricultural and Grazing Industries Survey 
(AAGIS) and Australian Dairy Industry Survey (ADIS) in 
the late 1980s (Chambers 1996). The data set includes two 
variables (incomes from wheat and dairy sales), that follow 
model (1) reasonably well, and two others (incomes from 
sheep and beef sales) that do not. These properties make it 
a useful and exacting data set for testing purposes. 

Chambers carried out a comparison of various estimation 
strategies using three sets of stratified random subsamples 
from his 904 sample farms. Each set consisted of 500 strati- 
fied simple random samples of 100 farms. The size variable 
used for stratification purposes was Dry Sheep Equivalents 
(DSEs). For the present study, three additional sets were 
selected, each again consisting of 500 samples of 100 
farms. The inclusion probabilities used in each set were 
proportional to a fractional power of the DSE. For Set 4 
that power was 0.60, for Set 5 it was 0.75, and for Set 6 it 
was ().90. In each case there was also a completely enume- 
rated sector. It was smallest for Set 4 and largest for Set 6. 

The larger of the two versions of model (1) used by 
Chambers to construct his estimators had eleven supple- 
mentary variables: hectares of wheat, numbers of sheep, 
beef and dairy cattle, and seven zero-one Industry indi- 
cators. This model provided the stronger challenge, and the 
comparisons presented here relate to that model only. 

Chambers calculated sample weights and RMSEs (root 
mean squared errors) for each of Sets 1-3 using six different 
estimators. The first of these, “RATIO”, was the HT ratio 
estimator based on each survey variable’s natural supple- 
mentary variable (such as hectares of wheat for wheat 
income). He calculated this only as a basis of comparison 
for other estimators, holding it to be essentially unsatis- 
factory in that the sample weights differed from one survey 
variable to another. 

The five estimators (other than “RATIO”) that were used 
by Chambers were the standard “GREG” [identical with the 
first variant of Calibration Estimation used in Deville and 
Sarndal (1992), the variable z in this instance being DSE], 
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“BLUP,” (the Best Linear Unbiased Predictor), ‘““RIDGE,” 
(a ridge regression estimator that enabled all weights to fall 
within the acceptable range) and two estimators, “NWD3” 
and “NWDAR3,” that applied Nadaraya-Watson nonpara- 
metric adjustments to the weights for the estimator 
“RIDGE”. 

As a supplement to Chambers’ study, the cosmetic 
calibration estimator, “COSCAL,” was calculated for Sets 
2-6. “COSCAL” and “GREG,” having nearly identical 
formulae, usually had very similar MSEs. Since Chambers’ 
only reason for introducing “RIDGE,” “NWD3” and 
“NWDAR3” was to get rid of unacceptable sample weights, 
the relevant comparisons in MSE terms are those between 
these three estimators and “COSCAL.” 

Except in Set 6, all or nearly all the “COSCAL” weights 
for any given sample were eventually made greater than or 
equal to one, but occasionally one or more of the 100 
weights could not be found a value in the acceptable range. 
The most intractable instances occurred where only three 
farms had been selected for the Dairy Industry and all three 
of them were of larger than average size. It was therefore 
logically impossible to calculate any set consisting of all 
positive weights to specify an estimator calibrated both on 
the number of dairy farms and on the Dairy Industry’s total 
size measure. (Dairy farms in Australia are typically on the 
small side, so for a sample of given size there are fewer 
dairy farms selected when the probability of inclusion 
increases rapidly with size of farm than when it increases 
slowly.) 

The actual extent of the unacceptable weight problem is 
indicated in Table 1. The elimination procedure broke down 
completely only for Set 6. It seems probable that there was 
less of a problem for Set 3 than for Set 6 because Set 3 had 
no inclusion probabilities that were close to but not equal to 
one. 

Table 2 shows the initial incidences of unacceptable 
weights for the estimators “GREG”, “BLUP/RIDGE” and 
“COSCAL”. The corresponding final incidence for “BLUP/ 
RIDGE” is uniformly zero, but the estimator is then no 
longer “BLUP” but “RIDGE”. For Set 2 the initial inci- 
dence of such small weights is substantially less for 
“BLUP” than it is for “GREG” or “COSCAL”. For Set 3, 
however, the initial incidence for “COSCAL” is substan- 
tially smaller than that for “GREG” or “BLUP”. For Set 6 
(1; « DSE the number of unacceptable weights found 
and the number of intractable samples discovered were 
already unacceptably large after only two iterations. 

RMSEs were obtained for “COSCAL?”, both before and 
after the unacceptable sample weights had been eliminated 
as far as possible. Table 3 contains a comparison between 
these RMSEs and those reported in Chambers (1996) for 
the other estimators. 

Most of the RMSEs obtained for the final versions of 
‘“COSCAL” are very similar to those obtained from the 
initial versions, and also from the standard “GREG”. The 
deterioration seen for “COSCAL” in the Dairy Income 
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estimates is due to the small number of Dairy Industry 
farms selected (particularly in Set 3) and the consequently 
rapid rise in RMSE that occurred as more and more farms 
with unacceptable weights were given unit weight and the 
effective sample size was consequently decreased. The 
same is true to a lesser extent for wheat farms. 


Table 1 
Progressive Elimination of Unacceptable 
COSCAL Sample Weights 
Number of Number of 
. Intractable 
Sample Set Iteration samples samples sample 
number with sample are tar weights < ] 
weights < 1 x across samples 

Set 2 0 2g). 0 496 

1 85 0 127 
“Compromise” Z 18 0 29 
allocation 3 7 0 16 

4 2 2 3) 
Set 3 0 226 0 701 

1 100 1 303 
“Optimal” 2 48 1 134 
allocation 3 P| 4 75 

4 3 7 48 

B) 8 il 3° 

6 8 8 39 
Set 4 0 188 0 322 

1 35) 0 80 
Allocation yz 1] 0 14 
« DSE°® 3 0 0 0 
Set 5 0 204 0 341 

i 51 0) WT 
Allocation 2 1] 0 16 
eDSEOF 8 3 1 4 

4 ] ] 7 
Set 6 0 187 0 592) 

1 96 ] 229 
Allocation 2 46 6 154 
eDSEO2 Further analysis abandoned 


After the elimination of unacceptable weights, the 
cosmetically calibrated estimator is design-biased. This is 
on account of atypical farms that were not selected with 
certainty being given unit weight. Table 4 shows that for all 
variables other than Dairy Income the change in the bias 
between Initial and Final/Intermediate was less than one 
third of a percentage point. For Dairy Income it is 3.21% 
for the intractable Set 6, 1.25% for the next most intractable 
Set 3 and 0.53% or less for the remainder. In every case the 
squared bias is less than 11% of the MSE, being largest for 
Wheat Income Set 6 (both Initial and Final). 

Table 4 also supplements Table 3 in giving data both on 
the accuracies of the sample estimates obtained using Sets 
4, 5 and 6 and on the percentage Mean Average Deviation 
Errors (% MADE) for all sets. Sets 4 and 5 seem close to 
having optimal inclusion probabilities, both in terms of 
MSE and in the ease with which unacceptable weights can 
be removed (seemingly just a coincidence, but certainly a 


happy one). By contrast, Set 6 performs rather poorly. The 
ratios of the MADEs to the MSEs almost all fall in the 
range from 0.52 to 0.68. The three exceptionally small 
ratios, all for Dairy Income, appear to be indicative of 
occasional large deviations from the mean when the number 
of dairy farms selected was particularly small. 


Table 2 
Percentages of Samples Containing Unacceptable 
Sample Weights 
Sample Set GREG BLUP/ COSCAL 
RIDDGE fnitial ~—_—Interm/Final* 


Set 1 (srswor) il 
Sere 


(4.27) 77 (4.27) 77 (4.27) ne. (n.c.) 


f SEGRE Py US Sem) @es «(nS 
Compromise 

Set 3 “Optimal” 94 (9.73) 93 (5.87) 45 (3.10) 1.6 (4.88) 
Set 4 

(«DSE°) n.c. n.c. Sis SIA), OW - 
Set 5 

(«DSE°75) n.c. n.c. 41 (1.67) 0.2 (2.00) 
Set 6 

(« DSE°) nic; n.c. Sie (Oal7) eet: (n.c.) 


n.c. not calculated. 

Numbers in parentheses are the average numbers of sample weights less than 
unity in samples containing at least one such unacceptable sample weight. 
*Intermediate for Set 6, Final for all other Sets. 


Table 3 
RMSEs of the Estimated Population Means of Survey Variables as 
Percentages of the Corresponding Population Values 
(Chambers’ Original Sets Only) 


Income From: 


Estimator 
Wheat Beef Sheep Dairy Total 
Set 1 (srswor) 
RATIO 14.7 28.9 19.1 14.4 16.7 
GREG 13.6 26.1 17.0 15.0 i7h3! 
BLUP 13.6 26.1 17.0 15.0 17/33 
RIDGE 15.7 23.6 16.0 s/s 15.7 
NWD3 15.0 22 15.9 17,5 14.6 
NWD3AR 14.5 22.4 15.6 17.0 14.7 
Set 2 “Compromise” 
RATIO 10.0 11.6 15.5 19.2 8.3 
GREG 9.9 119 14.8 20.3 8.4 
BLUP 10.8 12.8 14.3 20.5 8.9 
RIDGE 132 13.0 15.6 23 9.8 
NWD3 10.5 LARS 14.1 19.8 8.1 
NWD3AR 10.5 11.6 14.1 19.7 8.1 
COSCAL: 
Initial 9.9 WI 14.8 20.3 8.4 
Final 9.9 12.0 14.8 PA 8.4 
Set 3 “Optimal” 
RATIO 10.1 10.1 15.9 7} 79 
GREG 11.6 11.6 17.4 32.3 8.4 
BLUP 11.9 11.1 16.4 32.1 8.0 
RIDGE D}) 9.6 DGS 47.8 11.9 
NWD3 12=5 9.1 15.6 30.7 ls 
NWD3AR 12.9 8.9 Bs) Bl) Te33 
COSCAL: 
Initial 11.6 11.4 17.6 32.5 8.3 
Final 14.6 11.6 18.1 41.4 8.7 
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Performances of Initial and Final (or Intermediate*) COSCAL Estimates 
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Table 4 
Survey Variable Sample Set Inital Intermediate/Final* 
% % % % % % 
Bias RMSE MADE Bias RMSE MADE 
Wheat Income 
Set 2 “Compromise” 0.22 DS 6.4 0.13 Se) 6.4 
Set 3 “Optimal” 0.99 11.6 TT 0.67 14.6 Usil 
Set 4 (« DSE°) 1.83 8.9 6.0 Lg) 8.8 6.0 
Set 5 (« DSE°”>) 2.93 OF oi) NS Shi) S)a// 
Set 6 (« DSE°”) 3.45 11.0 7.0 32) 10.8 6.9 
Beef Income 
Set 2 “Compromise” - 0.01 1251 8.1 - 0.08 12.0 8.1 
Set 3 “Optimal” 0.50 11.4 7.0 0.25 11.6 7.0 
Set 4 (x DSE°) Bes 13.0 74 2.49 11.4 Us 
Set 5 (« DSE°”>) 2.00 10.4 6.6 LOH 10.4 6.6 
Set 6 (x DSE°”) RSS) 11.4 6.2 1.71 10.9 6.4 
Sheep Income 
Set 2 “Compromise” 1.05 14.8 og 1.09 14.8 9 
Set 3 “Optimal” 0.94 17.6 10.8 0.72 18.1 10.9 
Set 4 (« DSE°™) - 0.09 13:5 9.0 - 0.04 13.6 9.0 
Set 5 (« DSE°”>) 0.27 14.5 9.8 0.35 14.4 9.8 
Set 6 (« DSE°”) 1.04 16.9 9.9 1.11 2 10.3 
Dairy Income 
Set 2 “Compromise” - 0.24 20.3 11.4 0.25 le 11.4 
Set 3 “Optimal” 1.32 52 15.2 Deoyi) 41.4 15.1 
Set 4 (« DSE°™) - 0.52 20.2 Dey - 0.30 20.1 A, 
Set 5 (« DSE®”’) - 2.47 20.4 13.4 - 1.94 21.4 135 
Set 6 (« DSE°”) 0.01 29.8 16.3 - 3.20 57.8 16.6 
Total Income 
Set 2 “Compromise” 0.18 8.4 5.4 0.14 8.4 5.4 
Set 3 “Optimal” 0.69 8.3 5.4 0.46 8.7 5.6 
Set 4 (« DSE°) eT 8.9 4.6 D2 ILS: 4.6 
Set 5 (x DSE°”*) 1.83 eS 5.0 1.84 les 4.9 
Set 6 (« DSE°”) 1.83 8.5 4.6 1.87 8.3 4.6 


* Intermediate for Set 6, Final for all other Sets. 


No single estimator out of “RATIO”, “GREG”, “BLUP” 
and “COSCAL” has a consistent edge over any of the 
others on the sole ground of low RMSE. “RIDGE” is 
generally inferior, as might be expected on account of its 
prediction-bias, and the two Nadaraya-Watson estimators 
are generally superior, as might also be expected on account 
of their nonparametric calibration. However, their superi- 
ority is neither compellingly large nor consistent over all 
variables. 

If the choice is restricted to the three simplest estimators 
capable of producing the same weights for all variables, 
namely “BLUP”, “GREG” and “COSCAL”, then all three 
are comparable in accuracy but “BLUP” and “GREG” are 
inferior to “COSCAL” in the elimination of unacceptable 
sample weights. It is true that “COSCAL” was not uni- 
formly successful in eliminating such weights, but the test 
it faced was exceptionally severe. Eleven explanatory 
variables were used for samples of size n = 100, the totals 
of these explanatory variables included several linked pairs 
(each consisting of a production measure and a count of the 
number of contributing farms) and for two of the six sample 
sets the inclusion probabilities increased rapidly with size. 
Such a stringent combination of requirements should 


seldom be encountered in normal survey practice. How- 
ever, especially in circumstances where the explanatory 
variables include such linked pairs, it would seem prudent 
to avoid using inclusion probabilities that increase rapidly 
with size, even at the expense of a moderate departure from 
the otherwise optimal rule that the T; should be propor- 
tional to the d;. 


7. EVALUATION 


It takes little effort to change a standard GREG estimator 
into a cosmetically calibrated estimator. The matrix I,’ in 
one formula must be replaced by .! -I,,, and it may also 
be desirable to replace the existing Z, matrix by another 
choice. The efficiency of the estimator seems to be little 
changed as a result, but there are several unequivocal 
advantages. 


(i) The estimator is then clearly interpretable as 
prediction-based as well as design-based. 
(ii) Its anticipated variance and its prediction-variance 


can both be estimated more easily and more 


212 Brewer: Cosmetic Calibration With Unequal Probability Sampling 


efficiently than the design-variance of the standard 
GREG. [Although these options are also available 
for any GREG estimator, the most appropriate 
estimator of B for the purpose of estimating o* is one 
that is equally relevant to design-based and pre- 
diction-based inference. The f cos obtained by 
equating (2) and (3) is such an estimator. ] 


(iii) Design-based estimation has a tendency to be more 
reliable for large samples, and prediction-based 
estimation for small samples and small domains 
(Brewer 1999). It is not surprising, therefore, that 
the estimators used for large domains are typically 
design-based while those for small domains are often 
purely prediction-based or “synthetic.” If the large- 
domain estimators are cosmetically calibrated, the 
estimates for their component small domains 
automatically sum to them without forcing. 


(iv) As an unexpected spin-off, the elimination of 
negative and other unacceptably small weights is 
streamlined by the use of cosmetic calibration. 
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The Use of Auxiliary Information in Design-Based 
Estimation for Domains 


VICTOR M. ESTEVAO and CARL-ERIK SARNDAL! 


ABSTRACT 


This paper examines some important issues in the use of auxiliary information to produce design-based estimates for 
domains. We identify three types of design-based estimators and discuss two of these in detail. Both are defined as linear 
weighted sums of the observed values y, of the variable of interest. The first is the linear prediction estimator, which is built 
on a principle of model fitting and good predictions of the unobserved y,. The second is the uni-weight estimator, which 
applies the same weight to y, in the calculation of all estimates for those domains containing unit k. The latter approach has 
practical advantages for large-scale productions of statistics because it does not require the calculation of different weight 
systems for the many variables of interest. It is used in Statistics Canada’s Generalized Estimation System (GES), which 
produces point estimates and corresponding design-based variance estimates for any domains. The auxiliary information 
used to create the weight system determines the precision of the domain estimates. For the uni-weight estimator in particular, 
a crucial factor for its variance is the level (domain level, population level, or some intermediate level) for which the 
auxiliary information is known. We define information groups as the subpopulations with known auxiliary totals. These 
should be as close as possible to the domains of interest in order to produce efficient estimates. We prove that under certain 
conditions, the variance of the domain total increases monotonically as the information group moves from the domain to 
the entire population. 


KEY WORDS: Design-based domain estimation; Auxiliary information; Level of auxiliary information; Information 


groups; Prediction estimator; Uni-weight estimator. 


1. INTRODUCTION 


The estimation for domains of various sizes is an 
important requirement in the production of statistics for 
most government surveys. In most statistical agencies, the 
estimation and the associated measurement of precision rest 
on design-based principles as far as possible. As Singh, 
Gambino and Mantel (1994) point out: “Most producers of 
survey data are accustomed to design estimators and the 
corresponding design-based inferences. They interpret the 
data in the context of repeated samples selected using a 
given probability sampling design, and use estimated 
design-based cv’s (coefficients of variation). Where 
possible, samples should be designed to produce small area 
estimates of adequate precision, and sample designs should 
be fashioned with this in mind. Auxiliary data should be 
used, where possible, to improve the precision of direct 
small area estimates.” 

Let U = {1,...,k, ..., N} denote the survey population. A 
probability sample s is drawn from U. The inclusion proba- 
bility and the sampling weight of unit k are denoted by 2, 
and a, = I/n, respectively. Let U, be a domain of interest. 
It can be an arbitrary subpopulation Uc U. The variable 
of interest is denoted by y, and y, is its value for unit k. We 
want to estimate the population total Y = }’,, y,. In dealing 
with a domain, U,,, it is convenient to use the domain 
specific variable y,, defined as y, =y, if ke U,, and 
Vy = 0 if k € U,. Similarly, if x is an auxiliary variable, we 
have x, =x, ifke U,, and x,, = 0 if k ¢ U,. Then we can 


write Y, sep Dia Ve= avy and Ke eee where 
Sapeiode. U, denotes the part of the sample s that falls in 
domain ue 


2. AN EXAMPLE TO INTRODUCE 
THE ISSUE 


The following example illustrates how different levels of 
auxiliary information can cause large differences in the 
variance of an estimator of a domain total. Suppose we have 
a one-dimensional auxiliary variable x which is strictly 
positive and positively correlated with the variable of 
interest y. Simple random sampling without replacement 
(SRSWOR) is used to draw a sample s of size n from U, so 
a,=N/n for all k € U. Consider a domain of interest U_, for 
which we need to estimate Y , De y,. The following “hs 
design-based estimators come to mind. 


LAOS IIP.G PY GR. 
eee) da) 
ane ee 


where Y= (N/n)Y. Yyps Xan = (NIN)DY,, Xs Xq_ = (NINE, 
aye uX aq X = ee eee mle x, and 
poate All three estimators are design 
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consistent. Estimator Yay uses the auxiliary total X , at the 
domain level, whereas Y ,,. uses the auxiliary total X at the 
population level. In practice, this distinction comes into 
play when the auxiliary information is derived from a 
source other than the current survey, such as an admi- 
nistrative data source. The total at the domain level is not 
always available to construct a but we often know the 
total at the population level required for ee . Since Y ‘al 
uses more detailed information, we faenieivel'y expect that 
its variance should be smaller than that of Y ie Finally, Y ,, 
is the Horvitz-Thompson (HT) estimator. Although design- 
unbiased, it is usually less efficient since auxiliary 
information is not used. 
The variance of Ye for j = 1, 2,3, is approximately 
V(P,)=N2(ln = IIN)P, Say Hy (2.1) 
where P, =N_,/N is the relative size of the domain, 
Svu, = Lu, (= Vy, )°/(N,-1) is the variance of y in the 
domiain and Hy, is the only factor differentiating the three 
variances. Let slg = CV, Nyy where cv 508 any u,/Yu, 
and cv, =5, ae, as “the openers of undetien of y 
and x within the domain, and let areas te ee uSyu denote 
the corresponding correlation coefficient. heh: ne have 


2 
Hele eo7 Ke 


Hy =1-2P,M,r,K,+{1+P,|I -2M,+(ev,u)"|}/e%yu,) 


Hy =1+(1-P))/€V,y,) 


where M , /xX,, and cv, , = S,y/Xy. These expressions 
can be ites iit for Exar, Sarndal, Swensson and 
Wretman (1992), Chapters 6 and 9. The terms H_,, and H_,, 
follow from the Taylor variance, that is, the variance of the 
linearized statistic. The expression for H_,, follows from the 
exact HT variance. The approximations (N,- 1)/(N- 1)= 
N,/N=P,and (N, -1)/N,=1 were used in all three cases. 

Sines the variances V( z, i)» J =1,2,3, depend on several 
parameters, it is not so easy i compare them. In Table 1 we 
compare the three variances for different values of r, and P , 
es the assumption M , u, Xu = 1 and cv,,, =cv, uU, 

= 1. Roughly ee ene we assume that’ y ond ve have 

ty Sais variability in the domain and that x has a similar 
distribution in the domain as in the population. For domains 
of size P< 0.5, Table 1 shows the following. 


A 


Il ye has considerably smaller variance than Y 5 
particularly as the domain size decreases and the 
correlation increases. It is not surprising that fe is less 
efficient than Y,,. What is surprising is the rapid rate 


at which this occurs. 


om is has only marginally smaller variance than the HT 
estimator Y,,. This is particularly striking for smaller 
domains (P,, = 0.1 and 0.3), but even if the domain is 


as large as half the population (P, = 0.5), 
moderately more efficient than Y),, 
correlation is 0.9 or larger. 


Y jy is only 
when the 


Table 1 
Variance Ratios Comparing Yon on and ye Under 
SRSWOR; Vij = = VY, ) eufies een ais ut - the Gomelation 
Between x and y in the Dancin, P,=N,/N is the Relative 


Domain Size 


Variance Ratio 


Vao!Vay Va3!Var 
Ya Ya 
Vite 0.70 0.80 0.90 0.95 0.70 0.80 0.90 0.95 
0.1 3.10 460 9.10 18.10 1202 ral: O3amelO4 1.05 
0.3 2.63 3.80 7.30 14.30 Oe TIP. Tales 1.19 
0.5 273,00) 5.505 10:50 1s Sime Se ele) 1.43 
1.0 1.00 1.00 1.00 1.00 L672 SO S00 1 OL00 


In fact, under conditions other than those of Table 1, it is 
easy to see from (2.1) that Y a) can have a larger variance 
oe Yj; This can happen for example, when M, = 

aes > - and cv ae /CV,y <1. Therefore, even though ae 

Tees a highly correlated auxiliary variable, an Soins 
which does not, namely Ves, may be a better choice. The 
poor performance of Y,, may seem disappointing but what 
counts is not so much the use of a highly correlated 
auxiliary variable as the level at which we have information 
about this variable. Estimator Y ay USeS auxiliary informa- 
tion at the population level, and this is not very efficient for 
estimation at the domain level. 

In a survey where the frame provides a positive measure 
of size x, for every ke U, it is possible to calculate an auxi- 
liary total at any level — for the domain, the whole popu- 
lation, or any other subpopulation in between. We can use 
any of these totals to form a ratio estimator for the domain. 
The example suggests that the estimator with the auxiliary 
total at the domain level is better than one with an auxiliary 
total at a level above the domain. The gain from using the 
highly correlated auxiliary variable diminishes rapidly as 
the level of the known auxiliary total moves from the 
domain to the entire population. 

Note that Y 7) 18 not the only design consistent estimator 
that can be constructed with the auxiliary information at we 
domain level, X,. Another possibility is va =n 
(X, -X, DR, Chere the slope estimate R = Y. Je ays 
ieee on ‘the entire sample s, not only on the domain sae of 
the sample as in "ee The difference is in the underlying 
regression model: a common slope for the whole population 
in the case of Ne) and a separate slope for the domain in the 
case of hes The variances V(Y ,,) and 404 14) are equal (to 
the same Toe of approximation as in (2.1)) if R= 
De elbe le, yy! Ly Xt = R,. They will not be very 
different even when Ry #R! That i . the choice of model is 
relatively Hae By contrast, the level of auxiliary 
information leads to considerable differences in the 
variance. 
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3. ISSUES RAISED BY THE EXAMPLE 


The results in Table | raise several issues. In this paper, 
we examine three of these, in the general case of a 
multidimensional auxiliary vector x: 


1. The ratio estimators Ves and re in the example use 
the same auxiliary variable x. Thus both should benefit 
from a positive correlation between x and y. But they 
are different by construction, and they behave very 
differently, as the example shows. What are the two 
construction principles, in the general setting with 
multidimensional auxiliary vectors? Do these two 
principles yield identical estimators in some situations? 
These issues are discussed in sections 4, 5 and 6. 


2. Fora given domain, we define the information group to 

be the subpopulation for which the x-total is known. In Y,,,, 
the domain is the information group and for Y,,, it is 
the entire population. The example shows that the level 
of the information group is an important factor for the 
variance. Are there conditions for which a lower level 
group will yield a strictly smaller variance than a higher 
level group? This issue is discussed in section 7. 


3. The domain size (number of units in the domain), is 
another component of auxiliary information. How are 
the domain sizes incorporated into Ve and es in 
addition to the auxiliary information on x ? This issue 
is discussed in section 8. 


4. CONSTRUCTION BY PREDICTED 
VALUES OBTAINED BY MODEL FITTING 


4.1 The Prediction Argument in Estimation for 
the Entire Population 


Suppose the target of estimation is the entire population 
total; ey%= MarVas A sample s is drawn, giving unit k the 
sampling weight a,=I/n,. The data {y,:kes} are 
observed. For non-sampled units, ve is unknown but 
suppose we can find a value 1, that approximates y, for all 
units in the population, even if only rather crudely. Then 
there is strong incentive to build the estimator by “shifting 
the origin” of unit k from 0 to p,, because the residuals 
y, ~ H, are smaller on average than the y, values and have 
smaller design-based variance. Now Y =)',u,+ 
yy 0, -H,). where the known sum )’,,u, is the dominant 
term, and the smaller residual sum )),,(y, - U,) requires 
estimation. Conceptually, two choices must now be made: 


(i) Treating the M, as non-random, we must choose an 
estimator for the residual sum )’,(y, - H,)- 


(ii) We need to find values p, close to the y,. There are 
two parts to this choice: (a) the model relating y, to 
u,, and (b) the technique used to fit this model: 


2AD 


(generalized) least squares, GLIM, maximum 


likelihood or some other alternative. 


The usual choice in step (i) is the HT estimator, leading 
to Y=)',u,+),4,(9,-M,). This choice is made by 
convention and is not optimal. No minimum variance 
unbiased choice exists. Alternatives are the estimators 
considered by Raj (1956) and Murthy (1957). Auxiliary 
information is important in step (11). Let x be auxiliary 
vector of dimension J> 1, and let x , be its value for unit k. 
Suppose x, is on the sampling frame for every kes. 
Predicted values y, are obtained from the auxiliary infor- 
mation by fitting a model so that E, (y,|x,,B) =f(@,|B), 
where E,, is the expectation operator under the model 
m,f(¢|B) is a specified function, and B is an unknown 
vector of model parameters. The model is linear if 
f(x, |B) =x/ B, otherwise non-linear. x 

Using the sample data {(y,,x,): kes}, we obtain B as 
an estimate of B. Then we calculate a predicted value 
¥, =f ,|B), for every k € U. This is feasible because x, 
is known for all k € U. Using ¥, and the HT estimator for 
the residual sum, we have 

YorED Boh Ip Ea I): (4.1) 

This is the Generalized Regression (GREG) estimator. 
We use the subscript PRED rather than GREG to empha- 
size that the construction is based on predicted values. It is 
an asymptotically design unbiased (ADU) estimator, 
regardless of whether or not the model m is “true”. Hence, 
it is called model assisted as opposed to model based. It is 
not known how to obtain an optimal (minimum variance 
unbiased) estimator of Y under the twofold choice (i) and 
(ii). The model is linear if f(x, | B) = x, B, otherwise non- 
linear. 


4.2 Linear Model 


The generalized least squares method is usually used to 
estimate the parameters of the linear model. Find B to 
minimize Mealy, ~ XY B)’/c,, where the c, are suitable 
positive constants. This leads to 


B = DE. EE BOTAN 


k 


(4.2) 


where T,=)).a,x,x,/c,. The predicted values are 
y, =x, B, and the construction principle (4.1) gives the 
linear GREG estimator, 


ee oe a,(y,-x,B )=¥_+(X-X,)'B (4.3) 


where X = Luxe Vide ae a,y, and X, = Yay Xp: The 
choice of c, influences the variance but only in a mild way. 
For some designs, we can find optimal c, that minimize the 
Taylor variance of Ys INPRED: The specification a) aE 

should include information from the sample design. For 


example, consider a stratified SRS design with H strata and 
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sampling fractions f, =n,/N,, HOt [=e co, 6 Milner, 1 
obtain the minimum Taylor variance, we take 1/c, = 
1/f,-1 for all k in stratum h and we let x, = 
(Gs poicsse Gppainewa Series U apne mM NCKO. Gp ame Wall sha 1S IDES HAUT IE, 
otherwise €,, = 0 and x, includes all of the other auxiliary 
variables with known total )’,,X9,. Then, except for the 
factor (n, -1)/n,= 1, (4.3) coincides with an asymptotically 
optimal solution derived in a different manner by Montanari 
(1987). 


4.3 Non-linear Model 


In the nonlinear case, the model m can be fitted by GLIM 
or some other technique. Generalized least squares remains 
an expedient approach: minimize the weighted sum of 
squares )) a,(y, - f(x ,|B))*/c, as discussed by Fuller 
(1996). This produces an estimator B of B. We then 
calculate the predicted values y, = f(x, |B) for all k € U, 
and the estimator is built, as in the linear case, according to 
(4.1). In some recent research, the nonlinear case 1s 
compared to the linear case. For a categorical variable of 
interest taking m possible values, Lehtonen and Veijanen 
(1998) fit a multinomial logistic model f(x,|B) = 
POY) = expel PH/y,; exp OLB.) forgv=7,:., m. 
They use weighted log-likelihood to estimate 
B = (B,.....B,/)’ and from the resulting predicted values y, 
they build the estimator as in (4.1). Their empirical 
investigations indicate that this estimator realizes modest 
efficiency gains compared to the linear GREG estimator. 
Unlike the linear fit, the Y, for the multinomial logistic 
model are guaranteed to fall in the unit interval. This model 
is more realistic and provides better fit for many survey 
data. However, it requires more detailed auxiliary 
information since the auxiliary values x, must be known 
individually for all k. Unlike the linear model, it is not 
sufficient to simply know the population total of x, at some 
level of aggregation. Firth and Bennett (1997) examine the 
fitting of GLIM models, producing predicted values 
y,=G Ges, +. + sie where G(*) is the link 
function. In an empirical study involving tax auditing data, 
a binary y-variable, and maximum likelihood fit of the 
simple logistic function, they find that the improvement 
over the linear GREG estimator is at most, a few percent. 
These differences are insignificant compared to the very 
large effects in Table 1 caused by the level of the auxiliary 
information. 

From a variance perspective, it is important that the 
model m fits well, because the variance depends on the size 
of the squared residuals (y, yas Lehtonen and Veijanen 
(1998), and Firth and Bennett (1997) show that when we 
estimate the entire population total Y, there is only a modest 
decrease in variance in fitting a non-linear model over a 
linear model. However, in the estimation of a domain total, 
described below, this decrease in variance is more pro- 
nounced. This seems to be especially true as the domain 
gets smaller, as suggested by the study of Lehtonen and 
Veijanen (1998). 


4.4 The Prediction Argument in Estimating for a 
Domain 


Most surveys require estimates for a large number of 
domains. There are two simple techniques for constructing 
a design-based domain estimator. Both take the GREG 
estimator vere given by (4.1) as the starting point, but the 
resulting domain estimators are not in general identical. In 
this section, we present the predictive argument, leading 
up to the predictive estimator of a domain total. In section 
5.3, we present the unique weighting argument leading to 
the uni-weight estimator of a domain total. 

The predictive domain estimator is constructed as 
follows: predicted values y, have been determined for the 
entire finite population U, under some appropriate model. 
When the target is a specified domain, it is natural to use 
the y, and the residuals (y, -y,) from within that domain 
only. Replacing U by U,, ands by s,, in (4.1) we get 

Yuprep = Doe yet Da a, (Vy ~ Y,)- (4.4) 

By construction, estimator (4.4) meets the objective of 
additivity over a set of domains that partition the popu- 
lation. That is, the sum of the estimators (4.4) over a set of 
these domains is equal to a Se the entire population 
estimator given by (4.1). In the special case of linear 
prediction, j,=x,/B, where B is given by (4.2). Then 
(4.4) becomes (see Sarndal et al., 1992, Ch. 9) 


Yauinpred ~X a B Die a,(¥,~*,B). 


The construction of (4.5) requires that the total A 
vu, Xk be known, either from an exterior source, or from 
the microdata as when both x , and domain membership are 
specified in the sampling frame. If the model produces 
accurate predictions, eae, can be very precise. 

Estimators for domains are frequently classified as either 
direct or indirect. In the terminology of Schaible (1992) 
and Federal Committee on Statistical Methodology (1993), 
an estimator for a domain is called direct only if it uses 
values of the variable of interest over the domain and for 
the time period in question. Otherwise, it is indirect. It 
follows that grt is indirect when B is based in part 
on y-data from outside the domain. For some structures of 
the auxiliary vector SE eune expression (4.5) for Vip ads 
is of the direct variety, requiring only {y,:kes,}. An 
example is shown in section 6. 


(4.5) 


5. CONSTRUCTION VIA A SUPPLY 
OF WEIGHTS 


5.1 The Linear GREG Estimator as a Weighting 
Procedure 


The linear fORmypE Yan ener given by (4.3), invites an 
alternative view. We can regard YL INPRED as a linear 
weighted sum of the observed y, values. This gives 


Survey Methodology, December 1999 


YUINPRED =>. Wie (sy) 
where w, =a,g,, with 
& =1+A'x, /c, (5:2) 


and ' = (X - X, uses ' where T,=),a,x,x,/c,. Note that 
the g, depend on both kands (hence oe are Padonn) and 
their calculation requires the auxiliary total X = gt po be 
domain prediction estimator i VINELED 2iY emoy (420) can 
also be expressed by linear weighting as 


YoupreD = Die W ae Vic O23) 
where the weight is now w, =a,g¢, with g,=5, + 
A, x,/c, where on if kesy, Of, = 0 ike sess hand 


Ee = ce -X, ,) I, . Wenote two features of the weights w ,, 
in We 3): “G) ok domain requires a separate weight SSE 
because g, depends not only on k and s but also on the 
domain U_,; (ii) all units in the sample s (not just those in 
the domain of interest) may receive non-zero weights g_j,. 
Hence, the estimation may be indirect. Exceptions to this 
occur when x, has a structure such that g, =0 for 
kes -—s_,. In this case, (5.3) becomes a direct estimator. An 
example is given in theorem 6.1 of section 6. 


5.2 The Case for a Unique Set of Weights 


The use of separate weight systems for different 
domains, as in gua ee given by (5.3), is usually efficient 
but may be considered a drawback in large-scale production 
of statistics. Most government surveys require estimates for 
many y-variables and for each domain of interest we need 
to create a domain specific variable y , as defined in section 
1. Timeliness in the dissemination of survey results is 
important. Estimates must be produced routinely and 
rapidly for all the y ,-variables, including the corresponding 
estimates of variance. It may not be practical to produce and 
manage separate weight systems for every y,-variable. 
These factors speak in favour of a multi-purpose weight 
system that can be applied, with good results, to all 
y variables. 


5.3. The Uni-weight System Estimator for Domains 


The weights in (5.1) are w, = a, g,, where the g,, given 
by (5.2), depend on the x, for the sampled units and on the 
known total X = )’,,x, but not on the y, values. They can 
be computed once and then applied to any domain specific 
y,-variable. The information carried by this weighting 
system is based on the known total X which we assume 
includes all the information that is available or that we wish 
to use. Let us apply the weight system w, = a, g, to the data 
for domain U_,. We obtain the uni-weight estimator of the 
domain total Y,, defined by 


y 


dWEIT ape Wie (5.4) 


aby 


This is a direct estimator, because it uses y-data only 
from within the domain. By construction, it is additive over 
mutually exclusive and exhaustive domains since SA ; 


¥ tpneses yy, Alternatively, we can write Y hee as 
Weve Sb W, Yj This permits us to determine the basic 
statistical properties (asymptotic unbiasedness and 


variance) of Y yy, from the entire sample s. The subscript 
dWEIT in (5.4) emphasizes the construction in terms of 
weighted y-values. If the domain is the entire population U, 
then the linear prediction estimator (4.5) and the uni-weight 
estimator (5.4) are identical. Both are equal to the linear 
GREG estimator (4.3). In general however, they differ for 
a domain that is a proper subset of U. 

The idea of a uni-weight system is the basis for the 
methodology in GES as given by Hidiroglou (1991) and 
Estevao, Hidiroglou and Sarndal (1995). A single weight 
system creates economies of scale in many surveys. The 
uni-weight system is not the most efficient for each of the 
y ,-variables, but this simple approach can often be used to 
provide good estimates on a timely basis. Sometimes, there 
is little to be gained by searching for an “optimal” 
weighting scheme for each of the  y,-variables. 
Furthermore, when the x, values are not available for all 
units on the frame, there is no choice but to compute the 
weight system using whatever totals are known from 
administrative sources. Table 2 provides a summary of the 


features of ae Y TGNPRED ane Y Buse 
Table 2 
Comparison of Non-Linear Vgeo 
Linear eae ( tages) and Yayerr 
Estimator 
Non-linear Yoiwprep — Yawert 
Y iprED 

Auxiliary information x, for all Lu, *k Wee 
requirement keU 
Linear weights (for y, ) No ies Yes 
Uni-weights (for all No No eS 
Ye variables) 
Additivity over domains that Yes Wes Yes 


partition U 


5.4 Calibration as a Procedure for Creating 
Weights 


Calibration is a computational procedure designed to 
produce a system of weights based on the known total 
X =)',X,- The calibration procedure starts with the basic 
weights a, = 1/n, and modifies them through the use of 
auxiliary information X. We define and minimize a measure 
of distance between the original weights a, and the new 
weights w,, subject to the calibration constraint 
yw, x, =X which states that the new weight system must 
produce an exact estimate of the known vector total X. 
When the distance function is defined as the generalized 
least squares measure )) c,(w, - a,) la, we get the 
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weights w,=a,g, of PI ests XB +) 4,0, -x/B). 
GES uses a procedure that permits individual bounding of 
weights, see Estevao (1994). The function is minimized 
subject to the calibration constraint and the bounding 
constraint u,<w, <1, for kes, where the u, and the /, 
are the user eeeeied bounds. This avoids neoaie weights 
and large positive weights whenever a solution exists. 
Several alternative distance measures have been considered 
and recently evaluated by Stukel, Hidiroglou and Sarndal 
(1996), and Singh and Mohl (1996). Each distance measure 
produces a slightly different weight system, but these do not 


generally lead to significantly different point estimates. 


5.5 Information Groups 


The efficiency of the uni-weight system depends on the 
availability of auxiliary information for suitable population 
groups. In general, totals known for smaller groups produce 
more efficient sian estimates than totals known for 
larger groups. This is illustrated by theorem 7.1. We are led 
to examine the structure of the auxiliary vector total 
X= Ly x, used to compute the uni-weight system 
{w, a, &,: ke s} for Y »pyr- The vector total X includes 
ont totals of one or more x-variables either for the whole 
population U or for a set of population subgroups. The 
x-variables form a vector that we denote by x, and call the 
core vector. We define an information group as a subpo- 
pulation with a known core vector total. The groups 
establish the level of the auxiliary information. The 
efficiency of the uni-weight system is a function of the core 
vector variables and the level of the information groups. 

Classical post-strata are information groups with x), = 1 
for all k. As another example, consider a business survey 
where Xp, = (%,,X5,) 18 the value for enterprise k of a 
two-dimensional core vector, where x,, = Number of 
Employees and x,,=Gross Business Income. If the 
estimation is based on X =()),,X,,,).y%,), then the 
information for the core vector is at the entire population 
level. If X = (Vy Xe Lu, Xe? Lu, Awe ie x,,), then the 
information about the core vector is at the more 
disaggregated level defined by U, and U,, for example, a 
geographical subdivision of the population. 

Information groups and domains of interest are different 
concepts. An information group may be a domain, but in 
general, domains will cut across information groups. In the 
above example, the domains of interest may be industry 
classes. In business surveys, some units change classifi- 
cation. As a result, information groups based on the frame 
information may not be the same as the domains of interest. 

If the core vector has dimension J>1, and there are 
P >1 groups, then the auxiliary vector x , has dimension J x P 
andlisigiven’ by WES iQ ame ei vere + Ye Xo,)' where 
Yok is the group dentiticn such sak Yok =1 if unitkisa 
member of group p and y,, = 0 otherwise. The vector total 
that must be known is hee vy hy = Xp Xops eX ops 
Where Xo, = Yu, *o is the known core vector total for 
migecan She - In the special case where the 


information groups form a partition of U, Estevao, 
Hidiroglou and Sarndal (1995) point out that the factors g, 
given by (5.2), can be computed group by group. The 
factors for units in group p will depend on the known total 
for that group, Xo, but not on the other P - 1 known 


totals. Letting T Ly 4 Xo X qu! Cy and ae SF Ge Xi 
we have from (5. 2), for units k in group p, ; 
x me (Xo, ~ Katey ibs Xo yg (55) 


6. EQUIVALENCE OF THE PREDICTION 
ESTIMATOR AND THE UNI-WEIGHT 
ESTIMATOR FOR PARTICULAR CASES 


In sections 4 and 5, we examined two arguments for 
constructing a linear weighted estimator of a domain total. 
They lead to two possibly different estimators of a domain 
total, the linear prediction estimator 4 JLINPRED. BEVEDs BY 
(4.5) and the uni-weight estimator Y ,,,., given by (5.4). 
The motivating factor in the prediction approach is to obtain 
close predictions y,=f(x,|B) of the y,. In the uni-weight 
approach, we apply one set of weights to all the y,- 


variables in the survey. The motivation here is to construct 


a unique weight system that uses auxiliary information to 
the fullest extent possible. Model fitting and getting the 
closest possible predictions are not the primary concerns. 

It is important to emphasize the distinction between the 
auxiliary vector and the amount of auxiliary information 
used in the estimation. Both Y faut oes and Y nyerr use the 
same auxiliary vector x,. However, the amount of auxiliary 
information is not meee ail the same: Y dLINPRED Tequires 
Yu,* ,, a total at the domain level, whereas Y arr 
requires | eka total at the population level. The esti- 
mators Y Gutorian ls y aweit ate not in general identical, 
but they are equal for certain structures of the auxiliary 


vector x, aS we nOW show. 


We consider D domains, ae a U,, forming a 
partition‘of U? Lev 07— (075-207, #o, 0, be the domain 
identifier vector for unit k and es (8, eee Oe ie, 


Spx Xox) Where Xp, is the known core vector for unit i 
Then the requirement for Y weir? Ly Must be known”, 
is equivalent to“), x u, ox Must be known for each domain”. 
Next, the requirement for Y Ae pa ¥, must be 
known” is equivalent to * Yu, Xo, Must be known”, since the 
domains are non- overlapping. Thus, when we estimate for 
all D domains, the use of ¥ auanprep requires that “Di 
must be known for each domain.” Both ates recur 
the D core vector totals Yu,* oy 2 = I ,..., D. Each domain 
is an information group for the core vector 2 AAV 
ee and yaa identical 1 in this situation? Although 
they use the same information, this can not be taken for 
granted because they are constructed differently. However, 


the following statement shows that they are in fact identical. 
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Theorem 6.1 Let U,, ..., U j,.., U, be domains that form 
a partition of U. Let the auxiliary vector be x, = 
(0 pipe Meno, X 4) “suchithat.X = Du, “oe isa 
known core vector total for d = 1, ..., D. Then the predic- 
tion estimator 1% ALINPRED 2iven by (5.3) and the uni-weight 
estimator Ye given by (5.4) are identical, and 


A a 


Y /LINPRED ~Vowert Ls, Bak y,where 84. =1+(Xoq~Xouq) 
(Xa Xoun)’ T, Xq/c, with Xoaq = bse a,x, and T, = 
Ys UX on Xone x: : 

The proof follows by showing g, =g,= 8, forkes, 
and g, =O for all kes-s,. The details are omitted. 
Theorem 6.1 suggests that when possible, we should 
determine the uni-weight system by using an important set 
of domains as information groups. The theorem does not in 
general hold when the domains overlap. For example, 
consider two domains U, and U, with a non-empty 
intersection, U,, = U,1 U,. Let x, = (6,,%,,5,*,)'. Then 
to estimate the first domain total i u, Yk 1 aac 
requires the auxiliary information eee Ly, Xp Yu, 
while Y,i~wprep Tequires the more detailed information 
Lu, x, =(QLu, Sh ee The two estimators are not 
identical. 


Ok 


7. A MONOTONIC PROPERTY OF THE 
TAYLOR VARIANCE 


The level of the information groups will greatly 
influence the variance of the uni-weight estimator. The 
example in section 2 illustrated this. Loosely speaking, the 
closer a domain is to an information group, the smaller the 
variance. For specific cases, it can be shown that the 
variance is a monotonic function of the information group. 
Theorem 7.1 illustrates this. 

Consider a domain of interest, U,, of the sampled 
population U, such that U_, is wholly contained in a given 
information group, U,, with known auxiliary total X9, = 
Lu, X,- Consider also an alternative, larger information 
group, U,, with known auxiliary total X), = )},%,, and 
such that U, cU,cU,cU. Thus U, provides information 
at a more detailed level than U,, and U, is “closer” than 
U, to the domain of interest U,. The uni-weight estimator 
of Y, based on the group U,,j=1 or 2, is given by 


a 


RED Ne By Saji Yak (7.1) 
where g,, is given by the right hand side of (5.5) if we 
replace the index p by j. Theorem 7.1 deals with two 
designs, Poisson sampling (with inclusion probability 
7, < Z,, where z, is a measure of size) and stratified simple 
random sampling (STSRS). Note that the choice of the c, 
is important to obtain the result. In the theorem, V (Y dWEIT j) 


denotes the Taylor variance of Y dWEIT " 


Theorem 7.1. Let U, < U, be any information groups such 
that U,;c U, c U,<cU, where U,, is the domain of interest 
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and Xo, =)y Xo, iS a known core auxiliary total for 
U,,J= iL 2 Then the following holds: (a) under Poisson 
sampling; VW yer) < VO awe >) Provided ¢, = 1/(a,-1); 
(b) under STSRS V(¥ ;werr)) < VYawerry) if Xo, is defined 
to include, in addition to other auxiliary variables, the 
stratum identifier (6,,, .--) Oj.) -+»0;,) where 5), = 1 if unit 
k belongs to stratum h and 6,, = 0 otherwise, and c, = | for 
all k. 

The proof of (a) is given in Appendix A. The proof of 
(b) is similar. In practice, we usually settle (or have to 
settle) for a single set of information groups and calculate 
the uni-weight system as a consequence of this choice. 
Theorem 7.1 requires rather special conditions but it 
suggests that in general, we can obtain efficient estimates 
for important domains by using them as information groups. 
However, other domains if interest may cut across these 
information groups and for these domains, the conditions 
for precise estimates may not be as favourable. 


8. INCORPORATING INFORMATION ABOUT 
DOMAIN SIZES 


In this section, we return to the example of section 2 with 
more auxiliary information. In addition to the unidimen- 
sional, always positive core auxiliary variable x with a total 
known either at the population level or at the domain level, 
we assume now that there is also information about the 
sizes, N ,,d = 1,...,D, for D domains of interest forming a 
partition of U. 

By formulating the auxiliary vector x, as in Case A or 
Case B below, we can incorporate the known domain sizes 
into the estimator through either of the two construction 
arguments in sections 4.4 and 5.3. We use the following 
notation: Sy = OO he) Ven Veda Sia — duty 
EA ae x), Ce oe a Oz = eH where Loa 
Lisp eX Nae V5 Ys te /N,, and N ,= dase a,. We also 
use the domain identifier 6, = (0), 1 Oj) 2 Opy)’ « 

Case A Specify the auxiliary vector as x, = (6;,x,)’ and 
let c, = 1 for all k. Then, the predictive estimator (Case A1) 
and the uni-weight estimator (Case A2) are not identical. 


Case Al Jointly, the set of D predictive domain estimators 
(4.5) requires the information (NV, X,),d = 1,...,D, where 
X,=N)Xy.= Lyx, is a known total at the domain level. 
The prediction estimator for domain U _, becomes 


Yaupred = Nas, * Booms Xa ~ Nas.) (8.1) 

A D D : 
where = Booyp= La-1 Seya/ Ded=1 Sexa- The underlying 
regression has a common regression slope for all D 
domains, whereas the intercepts are allowed to vary 
between domains. This estimator is indirect since the 
sampled units in all domains (and not only those in U,) 
receive non-zero weights. Each domain has its own weight 
system. 
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Case A2 Jointly, the set of uni-weight estimators (5.4) 
requires the information (N,,...,N..,Np,X), where 
X =)',,x, is a known total at the population level. The 
uni-weight estimator for domain U_, becomes 

Yowert= Nays, + Bi & - vai aaa) 
where Bay S a eS 1: S..q: This direct estimator is the one 
that we would have to use 6 the x-total is not available at 
any level lower than the entire population. The predictive 
estimator (8.1) will ordinarily have much lower variance 
than the uni-weight estimator (8.2). Although they are both 
based on the same auxiliary vector, the information content 
is higher for (8.1). 


Case B the auxiliary vector as x, = 
(OR eis Dy Xoxr 07 8 peX ox) and let c, = 1 for all k. Here 
the core vector is’ x>, = (1, x,)’, and enh domain is an 
information group. Because x, has this structure, theorem 
6.1 tells us that the prediction estimator and the uni-weight 
estimator are identical. By either approach, the required 
information for the D estimates is CNG X,), ae wie 
have 


(8.2) 


Specify 


Yauinpred~ Yawerr=Na¥s,* Basep Xa ~ NaX,,) (8-3) 


where Bes = Set She This is a direct estimator, 
allowing a separate slope and a separate intercept to be 
fitted in each domain. We can now compare 14 OrIaPRED ane 
Ywerr from two perspectives: (i) the prediction 
perspective: (ii) the uni-weight perspective. 

The prediction perspective: Both (8.1) and (8.3) are 
linear prediction estimators. They use the same amount of 
auxiliary information, but differ in the underlying 
regression model. The model for (8.1) 1s a regression with 
a common slope but with separate intercepts for each 
domain. The model for (8.3) 1s one in which each domain 
has a separate slope as well as a separate intercept. It 
follows that (8.3) has a better fitting model since more 
parameters are fitted. Consequently, it has a smaller average 
squared regression residual and usually a smaller variance, 
compared to (8.1). However, the variance advantage of 
(8.3) will be highly limited, often one or two percentage 
points, depending on the population data. For a small 
domain, (8.1) may in fact be preferred since the separate 
slope estimate is unstable when based on few data points. 
Thus, when both (8.1) and (8.3) are available choices (their 
common auxiliary information is available), the choice 
between them (which is a choice between two regression 
models) is not one of crucial importance. 

The uni-weight perspective: Both (8.2) and (8.3) are 
uni-weight estimators. They require different amounts of 
auxiliary information. An x-total at the population level 
suffices for (8.2), but the x-total must be known at the 
domain level for (8.3). Because the information is much 
stronger for (8.3), it will usually have considerably smaller 


variance than (8.2). It would in fact be a mistake to choose 
(8.2) when the information is available to use (8.3). The 
amount of auxiliary information is more essential than the 
choice of model. 


9. DISCUSSION AND RECOMMENDATIONS 


We have argued that the prediction approach is not 
always practical in a survey with many domains and 
variables of interest, because the search for the best fitting 
model will often require a lot of effort. In the much simpler 
uni-weight approach, we attempt to construct a unique set 
of weights that give good efficiency for all domains and 
variables of interest. We have given some formal evidence 
(theorem 7.1) that it is in our interest to have the 
information groups as close as possible to the principal 
domains of interest. The selection of the x-variables and, 
above all, the specification of the information groups are 
crucial factors in obtaining high overall efficiency in the 
uni-weight approach. In this paper we have not addressed 
a question of considerable importance, namely, how to 
make sure that high overall efficiency is realized, given the 
multi-purpose use of the uni-weight system. 


ACKNOWLEDGEMENTS 


For the formulation of the ideas in this paper, we have 
benefited from discussions with M. A. Hidiroglou and 
A. Singh of Statistics Canada, R. Lehtonen of Statistics 
Finland and S. Lundstrém of Statistics Sweden. We also 
acknowledge the helpful comments and suggestions from 
the Associate Editor and two referees. 


APPENDIX A 


Proof of Theorem 7.1. For j = 1, 2, denote by Vi the 
Taylor variance of Y awerr > yaa, 8; Yay, Where g,, = oe 
(Xo; - Mii / eal is based on the information group 


U,, with Xj oe GX). andi D er) IX 4X ou !C where 


Ss; =n, chen we have Ve uD ts Gla, = 1) 
akj al) oe Ey; 8 a regression deel oxplanes 
below, and a,, = 1/1, where 1,, denotes the probability 
that units k and / are both rend in the sample, and 
a,,=a,=1/n,. In general, Vi is a quadratic form in the 
E ay but the: expression simplifies for Poisson sampling, 
a, a, for all k #1. Then with only squared 


where a,, = 
terms remaining, we have V,= aif EO, where 


Oar -1)!. Now. since C, = =Q), we get Fax = 
Ypres eBbe for k € U), where ae (Ly, ened een 
eee Vay! Qy Let Dy = Eayr — Fag = on (By. By): 


Then 
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2 2 
Va-Vy 2a Ey! Q, - pay Ena! Q, 
2 2 
23s {En + Dye a Oe ue oy, Ena! Q,: 


It follows from the normal equations that }),,D, En) / 


re Boo Boa) Yu, *ok E ya /Q, = 9, so that V, ip 
Yu, Pa! Qi. + Lv,-v, Eda /Q;- Because both terms on the 


right hand side are non-negative, we conclude that V, > V,. 
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Acknowledgements should appear at the end of the text. 

Any appendix should be placed after the acknowledgements but before the list of references. 


Abstract 


The manuscript should begin with an abstract consisting of one paragraph followed by three to six key words. Avoid 
mathematical expressions in the abstract. 


Style 


Avoid footnotes, abbreviations, and acronyms. 

Mathematical symbols will be italicized unless specified otherwise except for functional symbols such as “exp(-)” and 
“log(-)”, etc. 

Short formulae should be left in the text but everything in the text should fit in single spacing. Long and important equations 
should be separated from the text and numbered consecutively with arabic numerals on the right if they are to be referred 
to later. 

Write fractions in the text using a solidus. 

Distinguish between ambiguous characters, (e.g., w, @; 0, O, 0; 1, 1). 

Italics are used for emphasis. Indicate italics by underlining on the manuscript. 


Figures and Tables 


All figures and tables should be numbered consecutively with arabic numerals, with titles which are as nearly self 
explanatory as possible, at the bottom for figures and at the top for tables. 

They should be put on separate pages with an indication of their appropriate placement in the text. (Normally they should 
appear near where they are first referred to). 


References 


References in the text should be cited with authors’ names and the date of publication. If part of a reference is cited, indicate 
after the reference, e.g., Cochran (1977, p. 164). 

The list of references at the end of the manuscript should be arranged alphabetically and for the same author chronologically. 
Distinguish publications of the same author in the same year by attaching a, b, c to the year of publication. Journal titles 
should not be abbreviated. Follow the same format used in recent issues. 


‘$]U999I SOIDUINU SO] SULP DST[NN JJIPOU I] DIAING “BUC NV S}1I99 91}Q JUDATOP SANADI OP SANN sa] ‘uoNeoqnd op sguur | 
B ‘aa ‘9 “q ‘e SaINZ] Soy] JURINOfe UD dQUUL SUIQU OUN Pp }9 INa}Ne dUIQUI UN,p sUONedT|Gnd so] JonsuNsiq ‘onbrsojouolyS 
dIPJO Ud INQ JUDAIOP INIyNe dUIQUI UN Pp San so] 19 oNbNaqeydye s1ipsio ud ag WOP 9}x9) UN.p Uy Le] B aIYdessoI[qiq eT 
“(p91 d *LL61) uesyoo) :ajdwoxg 

‘Q0udI9JO1 LP] Soide ajjanbe] Jonbrput ‘a9}19 sa JUDWINDOp UN .p onJed 

aun Ig ‘uoneorqnd ap ajep Pv] 39 Sinayne sap WOU JJ JOsIOdId JUIAIOP 9}X9} 9] SUBP SO}TeJ XNVALI] SaIINV .P & SIDUDIOJOI SIT 


arydessorqrg 


‘(stoJ algtuaid vy Inod aouasgjal yey A nb asessed np said sosgsul 9.199 JUDATOP SII ‘JUDUIOTPULION) 

‘9]X9] OB] SULP JOINS] JUDATIOP S|I NO WoOIpus,| op UONedIpUl oun JajJod ja sagredas sased sap Ins oNIesIed JUdAIOP SI] 
“(xneva[qe) sop ney Ud Jd SaINBIJ Sap seq ne) a[qIssod anb Jneoydxo 

ISSNY I1]1] UN Ja}IOd 19 SaqvIe SIIJJIYO SAP DIAL JIINDISUOD IIPJO UD S9JOIDUINU 39 SNO} JUDATOP XNvIIqGP} So] 39 SAINSIJ SIT 


xNeva[qe} 32 SINS 


"9]X9] 9] SUBP JULUST[NOS 

3] ud onbiyey us sutidunt ang wop inb 90 Janbipuy ‘s}ouwl sap IMJOssal are Inod sgstjyN JUOS sonbryey sogoesed so] 
“(1 ‘140 ‘O ‘0 {© SM SUIUIOD) SNZIQUIL SaIQ}OvIVS Sd] JUSUIITL[O JonsuNsiq 

‘onbijqo a1eq oun .p opr | B 9)X9} 9] SUBP SUOT}OVIJ Sd] DITION 

“UIO] SNyd sdUdIIJOI We A ININe | Is JIOIP e] & aquie SIJJIYS uN Jed ynnogsuos 

QIpJO Ud Sdg}O19UINU 39 [edrould 9}x9} Np sagsedgs ag JUDSATOp sajueyOduI 39 sonsUO] suONeNbs saq ‘a[duts soedso un 
B DIPUOdSaIIOD JUDAIOP 9}X9} 9] SUP SdIQ}9eILO Sa] Sno} sie ‘fedroutid 3)x9} a] SUBP JOINSIJ JUDATOP SdJINOD S3[NULIOJ sa] 
“019 (-)3O] 39 (-)dxa suTWOD spauUONoUOJ 

SofoquiAs sa] Inod jnes ‘alreNUOD UOT}LOIpUI oUN,p sUTOUI eB onbITe} US saUTIduIT JUOIJOS sonbryeUgYJeUL sa;oquIAS sa] 
‘SQ[BIS $9] 19 SUONLIAQIGE Say ‘sased sap seq Ne so}0U So] JOA 


uoNsepay 


‘QUINS9I J] Suep sonbNeUTaYeUI 


SUOISSIIAX9 Sd] IOWA ‘S9[D SOUL XIS B SION ap TAINS dydeiseied un.p gsodwiod guINs91 UN Jed JIDUDUTUIOD POP 9}X2} JT | 


guinsay 


‘atydessoryqiq ve] Japgoeid seul s}UDUIDIOIJOWIOI $3] IAINS Op oxouUP 9]NO J, 

‘9)X9] NP UL B] & aIVTeIed JUDATOP SJUDUIIIOIJOWIII SIT 

‘9)Xx9] np osed aramid ev] ap seq ne a}OU oUN SUP JOINSIJ JUDAIOp INayne onbeyo ap assaipe | }9 WIOU JT 

‘sotidoidde san sap jueyiod sag}019UINU SUOT}IOS UD SYSIAIP 91}9 JUDATOP $9] Xd} Sd] 

‘Inoyne Jno} donod Zz] SUIOU Ne Pp SdaSIeU Sop ddAv 39 INOYWed oUsT]Ja}UI 9[qnop eB 

‘JUDUZ[NIs VdeJ oUN Ins ‘(saonod [| Jed 7g) prepur}s JULIO} ap ouvyq JoIded un Ins sorydessopAOVp INQ JSAIOP $9}X9} SI] 


uone}UIsI1g 


cs 


GS 
ce 


“SOINSIJ SOP 19 SI[NULIOJ SOP JUDIE.) 9] 
Inod 9931x9 sioje vias Jorded ns UOISIOA 9UN SIVUL ‘Sa[qe}dad0R JUOS S]AIOISO] SoINe SIT “199JJIGPIO AA JUWIa[GQeJayoid ‘9)x} ap 
JUSUWD}TVI] IP SIOTYOIJ IP IULIOJ SNOS STLUNOS 31]Q JUSATOP Sa}dadoR sapoNIe Sa] “sNOSsap-19 syutod sa] Ja}0U Op 19 (TU ‘6] ‘JOA Np 
Inied e) ajanbua,p sanbiuyoa ly ap JU9091 OIDUINU UN JoUTUIeXa ,p aiatid ‘anjauinos a] Inod 3)x9} aNOA Jatydesso[AVOep ap JULAY 


SALXa4L SAd NOILVINGASHad VT INVNYHONOD SHAILOAAIG 


Site 


ys hie: BR 7 
ky od a “ - bok aaal ft 
i aria od saphe\to.ctehres ange Re oe ee ca 


ae a rar iy a 
ae = a Dae - oat Reayawast. oe — d, hina, 


ni tgayo0g LINED ot FS pe) jyrumncseh = 
EMA F 2.88 A VAC / 


ip ais ck consent youre fama genre Na Acero yrs . | 
AP aPNTT SE AE 
berate (oS bnaigs Reb ; 
PITRE eT 


wd Pas Apa etila piciancgric ogee 
7 sal _ 


| ahs ena ; A onorevncrtte iat iti eter mein 
7 ot . & : Aa BE Ge deseo AIS OF haves ueimaalctlel yp oyveae uonerce * 

a eri Kn ues mn 
OU Gn cel circ mapAou ind 3 pirecokausescY of Yrmbeneis ats (a noe | Pray sae 
ent oe, / " oe 
pings . ‘ ; 


- - ine Aine. oe "Ag ae i 


~ aaa “ere 4 


a Fas a iam * oh 7 
oe teas wei fide tay as - | 7 _ f : Ay Ce Bad = 
7 eoe> ww ~~ iZ moe Jo: | hs ; y% 
aati Lanaeestheamnciercic etn atte te borat) pou, 

‘F BME HH LEM AL pe ; 
Bi Banya ricutony tx pine DA cada teem 
ae 


Baas menrinion Lanes J : hel deere 


wee Pay vi i= . 


a vows “goayaees sya F aehtowpecyeiiepss 2.39" 


(a 


Beet fe aepieey Cy p>» for Pests Cteqeues 4 


Wha) 


399 ovinjrelea) (Wi ete) 62 ei eiaspu sire; ie Lelie |e) vats) oo) 48m) cscelia! (6° ele co.ralial ve) let foice) Le) “ols! lane) ree iovier (Ke, atiia 1.6) Si els wee) (wc (a) 6 ewines Tei eine Loitenisjialievieiar eve) Tet fwatouie ameied R soon /siodeg SUTWUODYWO] 


L99 °°°° zyovoidde sourjsip-uinuIUTU & :sIajouvIed a]eOS Pu UOTNLIO] JO UONLUINSA JSNGOI snooUR}[NUIIS, 0} UINPUOppe ;sIOUINY 
UHOAAdSNVWLLLAH ‘d SPUlouL, 29 MANLZO 19wWiO 

Ara! Means aera oad aa Ren OD POE ol SSOUISNGOI puv UONLIISNI]II :sIsATeUue UOISIOApP JO} POOY![ay!] PANeUWIOJUT AT[EUITUTW VY 
‘AMAVTD 'S puedo 2 NVNA OV 

GSO a Be FUE Se a Sa Se aes cel Se a ae sooeds Jajauresed pauresjsuod Ul WYILWOSTe J 94} JO sonsodoid souas1IDAUOD 
*NOLHTLLLAN ¥ed 

(a Ge nee tae ana cee ga ar ca ONG, OBOE OPED aa RE eyep [eotoyds aposro-[[euls SurzAyeue 10} sonbruyoa} Japour Jeaury] ous 
~-LSHATA [oe g-stno'T 

L09 wLel gene ie, we lellele) os eva wip eels ae) wi eiie: wisstieim ‘wilel(w kul es Ae)(shu elie <qnin) wiles. sa) lela Awitny te) cane SUOTDINSOI adeys Jopun uoneUutysa Ayisuop ul uononpol IO 
“ATTHOAYA ZsewoL 

66S S16, \al eo} ve! fal Yel avi) (die Ne- ‘elicwl es vial 6! \@)ce)ip) fel alle relne: odin evietieiie ie, an eit (el iehedelieuslieivele isle Uu Jojouresed yeruoulq ou) jo UOT}EWIT}SO pooyl[eyly UWINUITXeU ou} uO 
‘ONVM SUIULX 29 NHANON ‘LL ‘VLdnD 4 'V 

SRS ei vite: @|cvice, lel -e: fee! 4} ,eicejle: (es aris}iel errs )\s|ca',@1 0) 16) »} 16) 9, ¥)lu1 (a) 0) we )nen elge) (ertelcol Wire vallejiel.e)isileie) sobs oie Velie iwi ieliatieliele 1e siivl ‘el is?io) eine suonouny suneuiysa Jo $1001 aidnynyy 
“ONVA 8uetloZ 2 TIVWS ‘D JoydoisuyD 

6LS eRe Nelo fesiale\ ior tele. Were! wlign iva ueliwiel ete) Miele! elie fete iol wile thle tele vemete wiielivilp cere) 6. ¢ (rite vy \e\ ele \e. 1s 16] 1p vols suotsuedxa yWomespy 0} uoneuxoidde oped a]U0W 
“NAS UeYs 7 NILAVW ‘V [849 “TIVH 4919d 

L9S Dale OO GMeO (Quon Oscmorticn ciceck cro cicrc) O Or O- cna POD beg GOO Oy so NCep.GeO Od O-OO > GOs s[opoul eoryoresary ul oueLIeA ou} Io} Joud V 
‘STHINV ‘f [98 4oTA 

LSS AM atabies: atayiotic) (ape e aa seanele non wa cme a tee teste acm cue tet asi cu circatee cual eta SUOIZOI ey Ayisuop ye JOJLUIN|SO Jopueudig oy) Jo JOIARYOq onoiduiksy 
‘VALSAAC Preyory 3 NV TOUVO SHY) 

YAS et RIES OO NORE EOC ORO AOD 0392010. sassa00id uossiog snoauasowoyuou Jo uoNtsodiadns ay) JoJ uoNeInduroo uLIsakeg 
‘ONY UUKT  ONVA SunoX vel 

STS °° °° SaLeANTNUI snssad0id ap sonbriuidwia suoneyai090jne 19 ssouRTIeAODOINE sap onbyo}duiAse yUdUIDJIOdWIOD Np UOTeUINS| 
‘OONVUA URNsUYD 7 LANITYA Uely 

60S CINCO ister) Ceci sc) OMB NO TOU Ciect IC JOsCOD COO OD CO Cho O OR OOO Otro D Oto .O > GO ooo mos Oo fen sossao0id qutod aeUeAIG IOj QOUdIOJUT jsnqoy 
MOOD ‘f PleYSTY 2 ON VW OL punuipy 

GRR aA pn ee Be a aera AjloNsepsososaj}oy Jopun siajouresied UOIssaIBaI JO SIOJCUIT}SO- [J JO} sono duIASY 
LHOIN’A Wea 

C&P oF eeiXee.. vi «ete Le ei6, 160.4) 6} b.\e ate ley 8! elso, 01's bin? py ele, eli) 0) elle. eid \ie, 0.16/70) .6; .8).¢) 19.6! 'slaun'e!\e. Aylonsepaososajoy Jopun S[Opoul UOISSOIBOI jo WwW jo yor] SUNSIL, 
TT Sueys-uryo 

JE eo Bak ORION IS CROIO ROIGIG IS 3 Cio OCG CCI Hoo N.Cldt GAMO + $189] 1J-JO-Yor] aqeorjdai-reou uo Aytyeuouuou JO O9IJO OU, 
*-NHSNALSTAHD Pleuod’ 2 MONCH ‘f Plempy 

Us 1 mailer ole hohe a LIL PERCU CSG cy 0-0-0 Oe cak SURI PIIOPIO JO AI9UISOWLOY IO} $}Sa} JSeIJUOD JRUOBOYLIO pozife1ousayH 
LLOWUYACOW ‘d [9849s 

Ltr 416) {Syle: J0s'@) (ey 0) iet efor lwaiwsyeys) (vue) oh wile: ieuseiTaliel eile (onal eels) eismelviie felis ia ieiefiniisy e)’e le) eifsits, 1s cs rellie) aielienl ede nhileriea vel bienatone s[epoul eonsneys pue sooeds juayondg? 
HOV TINOOIW 1939d 


6661 24QuI9}da8/1aquIaydas ‘¢ “ON ‘ZZ BUINTOA 


SHYAILVW SAC ATAVL SLINALNOO 


anbysyejg ap suusipeued snasy eT SoySHRS JO [LUINOL URIPeUeD 24], 


‘UIPIMS ‘WIOYUYI0IS [S POI - S ‘ONE HZ XOg ‘uapams sonsneisg uowuedsg Gay ‘sIOQGAT sey] 
‘JOUPY JOlYD BY} 0} po}daIIp 9q pynoys suondiosqns pue suolsstuigns jnoge sosinbut [Ty 


RMN ee MeN Son Mot eT af opal syst cae dey eetoxer pers coer aie oh ayehen ab vices Aral 258 on eine Pores sual ahene iat os iateshs: e averal a e.icishinue Sheree eles s Se boa s[euanof 124} UT 


Fy 010-018 Aan ODD Oral ChOsd L'GUAtDENC OU A) 009-0) OLOHORND RDHEME GIO CeO eo eeB Naas GEA Toke ccinic Oo Chcin Raine ao) Oar cece oeiciees SMAIAIY BVAIJOS pue yoog 


nie iZelivhiwilelisiin 'siivielfs)'e] (0) 8) 01" es) (e) wiinuels els) (6 ‘eUidi e's) to) 8)\ 6)/e'c«) 6 06,16] 6140) '$: (016) 'e AA ca, (0! 0) @\16, 6; a 18118 C0 DAUD pup ‘anajoy) EOI E | ‘ajiaauuanG@ jlouag 


YOIMSUNIG MON UL JO}OIS apeLL [leJay oy uo Butuadg Aepuns Jo yoedury ou, {Aepuns uo uado 9g sasois prnoys 


Dolpa) st -e' eis) leis (e) 0's) elie) »)(olia) walle: etelia, e:-a) (a) lia.(s) (a) (es halle, "« be S| 8) 618 t9) (a ane fing DYJADIN puv ‘qjamjuny i YOAID “ary W uaydaj¢ quay aolups 


Adaing uonendog juaND dy} WO sayeUINs| SWOg UO s}YSIaAA dUISOduIOD Jo salyq 


5 iJon. paseo Malo d Oo OaS 45 ORD 45.0 4 6.0 61 dome 5 pc erene OSI mo ten Mnaaq ap ‘( YlIpy puv unuDY ua ‘D‘f uo 


sonsisoyT pue Aj1yend ejeq :sjooyos Arewg ul sidng jo Adaing [ley Aq YsIq V 


pee sto feline} lelteih oie’ cere) e\e /o) 0) ellie elie lateieusrie lee ie Xe) fehferieielien’e! 9 cous uosqoqd MaYyDW pup ‘yaANYIC yi ydjoy ‘JOYSADIN we] pavyriy ‘9J00L.O T upg 


SSUIPULY [eoLIdurg pure sanss] [eoISo[opoyjay aUIOS :sonsHeIS UONe[Ndog [eIONJO YIM yIeax] Jo skaaing a[dues SuueduioD 


Diath (8\-e alain ie)e ie, ¢/(elie/al(e la: ele. ae, \e lenis) siisc'siiel si16lie\so) 6 e/a) \6ulelie, (@ [o.je\ 0: |e) ‘vie. ‘w: 66, (6).,0, (@).6)\0) 0 ie 18. 08, 811016, 6)" © 'm \s\"e 18) 18150) #16, 9: \e 0) 6 UuosfjoM Javy rip pup 183]]3 1 uDAT 


epeued sonsyeisg ul uoneoyddy Iau pue saydioutig dWOg - so1jseIS§ [BIDN0S JO sud}sAg SpIeEMOL, 


PERCE MCR Md pete ea ve arN ace ea Nee eect or italia coie te ete eevee escn orton Ca Stes ahs faits ‘ehoriAisas) o) ciehwiree e 1) alse re. ee tw hoc ches Se [DYlUaMoT UUYLLa J 


uOoIssnosiq 


5 BASEN D WNC iS CII CPOE EN OR ROTORS GO ARON Ol a, © AE RRR RIE Bach. Re ea WANDA ‘ UDULLON 


IY UONLULIOJU] IY} UI SONsSHeIS [eopay Jo sININ IU 


See Pe cee TPE yee ces tae nce ener ee aS ie atin eircmspems sna ecou tgs « (ia teeel/S- aul Sy artenguise train ein St Site, Migeils: & argeila Go ses jn UBUD “y auuayIDy 


syiewsdy Surusdg 
dIN}OIT] UISURH SLOP] YJUDAIS UL 


6661 “€ JequINN “ST auINJOA 


$}u9ju07) 


CEE eive <0) 6 <w We, Jee ee (ecw (8) W000. 105 6 O69, Ch ake 0) @) er /aike; (6) salle! Gel eis oe) Cee 6 We) .6) 8 e mm Sel Ug).8) 0) oe 6 e//e fend Jolussiel 6, .emieué! 6) in e/a. w/e) ce ree] ia) ania 8) i ee) ere iv naire te ADAOYIAA dIsoA 
asuodsaluoN }uUp) puke UONINSQnNS plaly4 


GEE RL REL Ee MCG So Und 9 IR i 2 FE TET SPER SSO E oe aT Os ac a ene ae Suvyz suny)-17 
asuodsaiuon 0} yo0fqng Beg Adaing Areulg sulzAjeuy Udy UONRIYNeNS-ISOg UO 910N V 

Se [DPULLE IUA-[ADD pu WOAISpUNT UaIXIS 
asuodsauON JO JUDUNVII], JOJ POYJIJA] PlepuLis ev se UONeIqIeD 

COZ TENTED T tte ete ee tees tree ee eer eee n ey Erte ease eee e eee E Sete eter ee eee teenie tenes payouuay ‘g anyy 
SIOULUTY JOUINSUOD JO ADAING GGG OU} UI S}O9JJq asuOodsoIUON Jo sIskTeuy 

697 fet ter a Pet De er Tee ec ee Se ee et I ed Ma het Tr SE TC a tet CC tee Te dca NC Rat bS SAP RR Ch 11095 auUucT pup ‘YyIUs J2YIDY ‘QIUNDT AaylwaH] 
AdAING Joueg [euIpnsuo7T & ul asuodsaIUON SuIONpay JOJ saisaje1S 

ISG Whalley vet ce. eke., eli. Nel eels Ya) 6 tego’ Ko evade: ‘ale: ie uenenedieda deka. ve! (ete) hieceve.ehiele\ sie ie)\se SdaMog Kajysy puv ‘SUIULOD ‘gd cuy “asus 4ouva|q ‘SAAOLD) W 142qOM 


UOISIOAUOD J[esnjoy pue 
‘SOATUDOUT [eNUIOJIC ‘SOAMUDOU] ‘YISUIT MATAIO\UT JO UONedronIeg ADAING UO sjOaIJq OY} BuLINseayy 0} yovoiddy ArojyeJogey] VW 


LEZ © 06 hea ee ee el cee 0 6 Sle, 0 © 6 a ete o. (€ 0) ele v6 8.0 1.0 © 19 'w. wees ehielre to eae) so.diLeliee)s tegsm eee, alle (aiiel wae) ie ate) [s-.e) eae 8 Kauoop aulp]D4sayHy pup apiays udjoioy 
SADAING JUDWIUIOAOD “Sf Ul SOAT]UDOU] ATe}OUO|] 

WG © [ercey wi iawe: Ge-leniel eo: \sl.eie We) 6) wi,0.(pile. 6) 1¢- <6) eile en's) e/ apien ohienity a) Ge Yemen erre se) e7 re iy ca\(siie) 0:9) a 91 6! (evan) (Si elVel rele Newel lellsicel io) (w folie) ellelie! olis ke)’ ieiieriwl ie en alexe, 6 erate a] SDU0HIW aUullayJoy 
SADAING PIIWVIPI|I-JOMIIAIOJU] Ul sayey suodsay UO S2ATUDOU] JO J9IJq OY, 

661 a aye, wy) 08 ale hia) ww, Wh hj, 16 Te. WLGk weg 18. oO. W Tekan ab) ete OLS! rece ee eel et eel VSL W ke wale ey ee Ieee Os. alee S18.n1¢ YOUIDg pup aqjaupdup) pjauvd ‘Uuopand upsns 
SADAING MIIAIOIUT 9OV4]-0}-908,] UO SOIBdILINS SUL[ED , SIOMIIAIO]U] 

C81 W.. Wee wa le elie ete ease) mela ta: te alle] a)0: ope, wt 0} «li y..e\J9: allokm ie 0.9) 0.0: us, 9 cej 0) P WLe) ariealt 614 Slo. 4 serie ere SLeMeKe unaay ap ‘d ylpy pup xOoH door ‘saaylius 4ay) 
asuodsaiuoN AdAING SUNYSIY JOJ SONI], SIOMIIAIOIUT 

FQ RDS See Lass hit CPN ECT NTRS IS: CE Teg I ee ae AYN apaqa pup unaloy-si4ioy] uDlg 
AIAING JUDWUIOAOD B 0} SaIVY [eSNJdY YIM SUONIPUOD [eoNI[Og pue dIWIOUOD Jo uOHLay oy) SuLO[dxq 

€rl a eitey{s:"0) 1 Lei) by ae a, 0 cele 86) a) 2 leliea whe, a) ete. et et ay eh ecetiehinieh em Nile) wee telte: Wiel eile Lops elie fer ok FEN UW Kel Le gare ects Aazyag 'Y yupne pup u“affavyo¢ awa DION ‘UIT ua q-] 
Aaains woddng pjtyp e& ul uonedionieduoy Jo s}oajjq pue sasned 

BZ EEE nnn eee t ener nn entree eter ener nner errs esnn ene n essere: 429f] ap Uli 
ADAING [BUONLUIOU] UL JO S}[NSdY ‘spucIL, ssuodsoy seUONeUIO}U] 
ce g0R]2q 


CZ EEE n etree tree nnn ttt reenter eset ee tennessee ere ecees sjeuanof 12410 Uy 
CL] Eten ttn nett nner rennet erent teen etna SMAIADY BABAIJOS pue Yoog 

0) A uuDUNaN) SPY 
sONsners [eIOYJO ul stskyeuy swiaisXs parddy 

18 syle eWera: ee e..¥. 0] wile lielie) abc. (e\lel/si'el eile) .e) eles) ene (9) vite whe seh elevisiiec ere le je. .e! 6. .61'e) aioe) ieee fone hier her eg elieiben oud Teieeced ene an sie net se) leita a bia AaupjoA DAT pup oaly 40Kk0W 
eCOLIOWY YVON Ulajseq Ul eyeVq UOTISOdag ANJ[NS 194 JO SUISIDY URIsakeg 

L9 wholes ©. ale (elke se iaralel Bye) mye iaihel elle (ae. 4 ale teha ie iele}ur es) «) ate sPeirageke ie heieleesa) ©. 6) €| ‘aleve: #i.e!/e Je, eJe!c+,-a)\q) 0) ¢\v 6ite\ 6 bicelles v shi) emelelts 0 cee) ©) wikedisiietfolce dellwdeM@ieaw cuten wii pasyliq 11M 
SMOIAIOU] AQAING Ul SUOT}OBIOIU] [RQI9A SUIAPNIS JO} POI MON V 

jG site ce fe. 1) eke ie, fo) epee alee 1s tsiis: (oie, ee le, 'eln aioe lev cele te le lo eitel ome lo, “Gilet @.iv, io) el. ofi¢, jel imi leh ale ete \6) 69! /0°,6)'6' 0) (6,46 a) 10a 6) 6: -4) :.v ie (ie) (6: \0\ eke sayxdg Apuany puv sumjoy UlADW 
Ayyend Adaing Jo uonluyaq oy) Sulpuayxq 

6£ Ciel wave! e:'ep a, 09 (ele .¢ lel eho is 1e1e lekepies le) eaele Tel toil Sizeme gs) loMkvaret Oe. .6 6.0. (o: 16 G0) 4. pe .0'..0) @ fe Ae ine leherenin le) ie kvna ge yajdi AYIOUN J pup “DIG Auuyor ‘“uadnoy Gi YOUN 
sotouasy [eonsneis ‘SQ ul sooXoldurg Jo AdAIng & JO} [leUI-q pure [Ie JO uOstIVdWIOD vy 

Sec pssnyy °S 1p1aqy 
soaneulaipy posodoig suowy uosueduios & pur JoIWUINSY ONeY UONe[Ndog sULY dy} JO UONROYIpo|] Sulonpel-selg MON VW 

[DDE EDD ene nr eter etree tenet trent tenet eee t eee JaylDy “y piavg 


YIOMOWLI UOISsaBay IvIUI'T PIzi[eiousayH ke SUIS; SIOJUINIS| voTY [[eWIS Jo UONeZIULSIO 


6661 “TI Joquinyy ‘ST ouInjoA 
$}u9}U07) 


pleog [eUOPY oy} JO SIOqUIDUI pure SsdodJOJo1 JUBpUddapuUT 
AQ POMOIASI A[SNOIJOSI oe sjduosnueul [[Y ‘poziseyduio ose suoNeziuesio [VoONsNes JoyjO pue sdoyjo [euoneu ye sonsnejs Jo uononpod 
24] 0} JUSUTIOd sonssI Joyo pue AsOTOpoyjoW! AdAInS ‘suoneorydde pue ASojopoyjow jeonsnels ur sozipetoads yey) Ajouenb Aprepoyps & si SOr 


UIpIMS SINSHeIS Aq poysyqng MIAdY [euOeUAI}UT UY 


SOILSILVLS TVIOMAO JO TVNANOL 


‘uonoepal P| 19 atydesZoyAjoep Pe] ‘UOTVeUIPIOOD Fv] & 1Odde 


Ing] Inod ‘sasveusui sap sgidne sajgnbus sap sapoyisul sap uOIsSIAIG ek] ap Avy ‘DH ‘amway] ‘q ‘atqeie’y ‘SD ‘a[noH ‘f ‘[Iaqsog ‘De 
JOULSSTRUUOIAI IIOU JOWILIAX9 IIISOp UO JUDWII[CUL] “((UOTONPeI 19 SI[[IIOIJJO SanSur] sop UOISIAIC) I[NvaLag “] 19 (UOISNIJIp ey 
OP UOISIAIC) I[slosnesg ‘f :666[ Inod onaal ve] ap solguINU sap UONONpoid P| & snqiNUOD JUO INb xnad0 JUSUISTeS9 SIOIOUIOI UC 


Ae[quisiy, “A 
suOWUT], “4d 
asogouL “V 
Aequie], “J-"f 
uvipuryongs ‘WD 
s1qreyos “TAA 
[epules “q-"D 
urqny ‘a'd 
T42pod “W' A 
Ayn ‘NW 
uosey ‘V 
yor “T 

991 'H 

§ SOmev’T “J 
ag[[BAr] “q 
ayonoley 
jour] “N 


OJSWNU 8d SURG 


sap9oaqd § 


skeor ‘WL 

§ Za[eZUODH “WW 
ysnod ‘H’f 
apinsuryy ‘q'd 
UPUIATJUIDH “If 
OUIqUIey) *f 

Aed aa 
dyxoqQss0I1q ‘f-"f 
stuoq ‘f 

uinseq ‘g ‘YJ 
as8pa]10D TW 
eddeuuryd ‘Nn’ 
sulled "WW 
Wossig “T 
eddefervarseg ‘9° y 
SUOISULIY “f 
eluoyy “¢ 


:syUIOfpe sniajoVpal ja SPIOOSse SINd}Oepal SUDTIOUY 


AST 


ApISAIAIU() PADAADY ‘KYSAR[SCZ, “VW 
piupajcsuuad fo Ayissaaluy) ‘OWNULT, “FY 

ppouny anbysyoig ‘NOX X 

daquag yosvasay uoiuidy¢ JDUOIIDA ‘INOM ‘WY 
AJISAIAIUL PPV SVxXAL ‘BURA 'S 

‘DUT JDISAM ‘BIDQSYCA ‘f 

snsuay ays fo nvaing ‘Sf ‘eA ‘f'd 

xassq fo Gissaaiuy “ewlaA “SA 

‘QUI ‘IOIsSaM ‘eye A “Y 

SISOS L0GvT fo nvaing ‘SQ “IayonNp ‘oO 
uoDvwUsofu], ] 

ap askjpuy ] ap ja anbysynls 0] ap ajDUuONDN 21097 ‘ILL ‘A 


ppouny anbysyojg ‘a81aqouL “VW x 


ppouv,y anbysiynis ‘Kequyey, ‘J-'£ 

AJISABAIUT MAlgaH] ‘AOJYSIIAS “WW 

ppouvy anbysynj¢s ‘jaxMsS ‘qd 

ppouvn,y anbysiypis ‘ystpueis “T 

uojdwupyinos fo kjissaaluy:] ‘IOUUTYS “['D 

AJISAIAIU] AASDALY UOUS ‘IIS “Y 

ppouvn,y anbysyvig ‘ysuls ‘d'W 

‘QUT ‘IWIsaM “YUBUIS “D'V 

DINSNOIST 

a DYDASOAH ap OdlajIsvAg On}SUT “CATIS ‘N’d'1'd 
UOSIPDI - UIsUOISI, fO K1SABAIU|] ‘OVUS ‘[ 
AJISAIAIUL] AALASAY UAAISAM, ASDD ‘YSURIPIS “f 
punjyony fo M1ssaaluyy ‘NOIS “Y 

aINJNSUT UDGAL) AY “UdINIYIS ‘f'] 

sajasuy SoT - niusofyoy) fo pisaaauy ‘IaXUDYOS *N 
sanbiuouosa 

sapnia sap ja anbiysivjs 0] ap jouoyou Injysuy ‘K1O\NeS ‘OC 
[D241UOY ap gi1S4aaluy) ‘TepurRs “A-"D 

‘IOSSY %? apuvsg ‘apues ‘H 

VS) YIAVaSay SUOIDIUNUUOZ 112g ‘9Bpurs “| 
IH 1adoyZ - durjoind Yon fo Ansaaauy) “urqny “qd 
ppoun,y anbysyvig ‘soKoy ‘qd 

uapamyg SI14S11DIS “USO *{ 

snsuag ay Jo nvaing ‘Sf ‘UOsUuIgoYy “DH 

ppouv, anbysiyvjg ‘s\iaqoy D 

[DAD] ayissaaluy) “WSIATY “d-"T 

AJISABAIU]] UOJAJADD ‘OCY WNL 

ppouvny anbysynj¢ \inoouey “| 

ppoun anbysynjs ‘a{[[Aquuand) ‘g 

pj4aqly fo Assaaiuy) ‘peselg ‘N'O'N 

ApISdaAluy) Ma1gaH] ‘UUCULIDJJIJg “q 

dTT 8unox » Isusq ‘Budd “J 

AQUa8Y UO1JIAJOAd [DJUAUMUOAIAUT “$f ‘UIS|O “WV 
JavAs] ‘sousynis fo nvaing JDAJUaD ‘UeUIeN *D 
aINjsuy DuyIaIAjOg 4ajSad4OM “WIeIpUeN *g 

Ajo] ‘v1ssad fo Apissaaluys) ‘Weueywoyy “AO 

ppouny anbysynj¢ ‘Kouojoy ‘f£ 


KK HS 


ppouv,y anbisivjg ‘SIInoyII\q “d 
ppouvy anbysiynis ‘epkey “4 
ppouv,y anbysinig ‘jue Hx 
snsuag ayj fo nvaing “Sf ‘d2[R 
AJISABAIU() AIDIG DUOZUY ‘IYOT'S x 
saysyojg fo nvaing ud DAISNY ‘IOUT “S$ 
ppoun, anbysiynig ‘aa{[ear’T] 
ppoun, anbysiyvnj¢ ‘ayonowey] Wx 
ujooury - vysvagan fo kpisaaaluyey “Wye 
ppouvy anbysynis ‘ayjadeyoe’y y 
snsuag ayl fo noaing ‘S'/) ‘1oWery ‘WW 
ppouvy anbijsivj¢ ‘Ieaoy ‘f 
ppouvy anbysiyvjg ‘NAdQVAOY “We x 
IDIALIY SIISIDIG JDAN]IJNIABY JDUOIDN NOY “S'd x 
‘QUI ‘IwIsafyy “UOIeY “HO 
‘Quy ‘Jwjsamy ‘surypnye ‘q 
DIIUIS DiUMapvIY ‘BueMH ‘S-'f 
JIC [DINSNDIS ]DAAPAY SSIMG “IISI[NY 
YA ‘sousunig jouoyoy 40f af WOH 
ppouny anbysinig ‘no[soupIy “WW x 
Ajissaaluyy KasspPy ‘Na[sey °S 
puvjtuvpy fo {pisiaaluy:) ‘S2A0ID “WY 
IINJISU] AIIUDD [DUOIIDA ‘S'-Q ‘preqneln g x 
ppouvn,y anbysivjgs ‘Ul[assoD *4-"f 
ppouvy anbysinj¢ ‘OUIqUIeD *f 
AIsdaAluy) aJDIS DMO] ‘IID VM x 
ppouvy anbysyvnjg ‘OvAacdisy “A 
Ansdaaluy) WPY Soxay ‘suntq “TL « 
ppouvy anbysiynj¢ ‘Mo1d ‘d'f 
SINSIDIS AOQUT fo nvaing ‘§":) ‘UeujIOg ‘VY 
ppouvy anbusunis Yq ‘dx 
sanbiwouoza 
sapnja sap ja anbysyvjs D] ap JouoYou InjYSUT ‘I[[AOQ “O-'f x 
ppouvy anbysiynys ‘yeuulsaq “VW 
SINSIDIG UOIDINPY A0f 4a]UaD JOUOIYAY ‘UBYOD “Wh 
pu1say fo Auissaaluy ‘UsyD ‘D 
uojdupyinos fo Aisaaaluy) ‘siaquieyd “yY 
ppouny anbysiyvig ‘IIeD “N'Y 
snsuay ay fo nvaing ‘Sf: ‘[JaMIUeD ‘ff ‘d 
‘Duy ‘IDISaM “AOI “WL 
AJISABAIU() JDUOIIDN UDIDAISNY “IOMI “Sf 
ppouv,y anbiysynjig ‘auo\syoelg ['D x 
ppouny anbysiyni¢ ‘Jopulg “W'd x 
IININSU] aJSuYIA YIAVASAY “IMU “ 
uojdupynos fo Anssaauy) ‘19819g *X 
OUDIUGC Usaisay fO Gisaaauycy ‘asnoul[eg ‘Wd x 
snsuay ayj fo nvaing ‘$A ‘Tl2d MA 
dajuay YIAvasay uoluidg¢ JoUoIYAY ‘reyleg ‘q 
ppouv,y suoioaly ‘SUONSULIY *£ 
snsuag ay fo nvaing wal ‘JOPUeXITYV ‘DO 
AJISAIAIU(] AIDIS UaaID BuyMog VWIQlV ‘f 


“stoy oun .p snjd gdionsed ve auuosiad vy] anb anbrpur onbstiajse uQ “6661 
a9uur | JUvINp spoNIe uN .p anbyLW9 ev] asey ap aidaoor quo nb ‘sajuvains sauuosiad so] JOIOJOUWIOI asap ajanbua_,p sanbiuyra J 


SLNANGAD qaNaa 


LS¢ 


‘QTI-LII ‘77 ‘atgnbua,p sanbiuysa J 

‘IO[AR], Op uONesUeoUT] ke] Ip 3a oJluyyorl np sapoyeul sop 

UOSIeIedWIOD :o8eIed ap SINDJeUINSd sap DdULLIRA B] op UONeUINS| 
(9661) ‘A-D “TVGNUYS 19 “WW ‘NOTOOUIGIH “Wd “TANN.LS 

‘OTI-LOI ‘7 ‘aignbua,p 

sanbiuysay ‘aseuuor[nueyos sed sajyanbua sa_ suep ase[eo 
@P sINaBUINS so] espuerdWOD *(9661) ‘VD “THOW 19 “O'V ‘HONIS 


“SI-€ ‘07 ‘alanbua, p sanbiuysa J suonnyos 32 saulg[qoid :suoIse1 
soined soy (7661) ‘fH “THLNVW ?° “'f ‘ONIGINVD “dW ‘HONIS 

“puelOd JO IdJJO [BONSHeIS [eIUID :MUSIEMA “PL I-S6 

‘| ‘usisagq Kaaung pun sousyvig valy [jos uo aouasafuoD 

oyfuaing §=jouoipusajut §=ssuipaado0ig ‘swieizoid_ = [elapoy 
"S° Ul sJOJeUINSA RoI [[eUIS JO 981) “(Z661) “TM “A TAIVHOS 

“‘SEIIOA-JosULIdS :YJOX MON “surdiung Kaaing paisissy Japow 
(7661) ‘f “NVWLAYM 1 “ad ‘NOSSNAMS “d-'D “TVGNUVS 

"P8T-69T ‘1S ‘UONDIDOSSY [DINSUDIS 

updidauy ay fo Joudnor “yuauaoR{da1 ynoyytM sattyIqeqoid 
SUIAIVA YIM Surduies ur siojeurnsa owiog (9C6I1) ‘d ‘fVuy 


06£-6LE ‘BI ‘BAyyunS ‘uauIs0R[daI jnOYIM Sur;dures 
UI sIoyWINSS poelopsouNn puke peJ9PIO (L661) ‘NW ‘AHLYNW 


‘ZOT- 161 ‘SS ‘Maiaay JooNsNDIG JoOUOYDULaIUT ‘SKOAINS J[CIS-d3IE| 
ul uonsIpesd quatoyse Surjdues-ysog (L861) “A’D ‘TYVWNVLNOW 
"86-€6 ‘pz ‘alanbua,p sanbiuysa, ‘sanbisiso] sastje1guas 
UOISsaIs9I op UONRUINS (8661) V ‘NANV{ISA 3° “Yd ‘NENOLHAT 
“epeurg onbysieis “oddey ‘waisXs uoneuns” 
pezyeiouey ayy Jo saimonng (1661) “VW ‘NOTOOUICIH 
“AOTEAA OK 
MON “Sallag aud] JDINSUDIS 01 UuoNINpOAIUT (9661) “‘V “A “YATINA 
“g Soligs 
‘{ja120¢ poousynis jokoy ayi fo jousnor ‘anvered VY ‘Surjdures 
Ayqiqeqoud ur sjapow isnqoy (L661) ‘AM SLLANNAd 1° “dd ‘HLA 
“20JO Aorjog Teonsneis “aspng pure uoWEseUR] JO 9DIJO 7O'd 
‘UOISUIYseAA ‘SUIeISOId [eIOpd{ UI SIOJCUINSS JOOIIPU] “(€661) 
AXODOTOCGOHLAW TVOLLSILVLIS NO daLLINWNODO TV ead 
‘VOC-18I 
‘7 ‘TI ‘sousynig po1yff[o fo ousnor “epeued sousiers ye wiaysAs 
UONBUINSS PozieJouss ev Joj soydiourtid [eoIso;opoyIay] (S661) 
‘dD “TIVGNUYS 2 “WW ‘NOTOOUIGIH “WA ‘OVAR.LSA 
‘epeurd onbysiyeis ‘oddey ‘sjuresuod punog pue 
uoneIqieD Jopuy) sIYystaM-3 Jo UoNR|NI|eD (p661) W'A ‘OVAS.LSA 


AIHd VYOOI TAIL 


SUOIEWISS Sa] INOd sasIeIIXNe SUONEWWOJUI SEP & SINODSI 97] ";eEPUIeS Je OBAD]SY 0Sz 


Fee © Aonb 
SUON[OUOD sNOU ‘sylTeB9U YOU JOS a0Ip = SOULI9] XNOP $2] 
anbsing JOG a RG: ‘Oued De Ecco eee 


(P) ) 1 
ap ‘O= 1) 10, 07%, Mg gy = 1G) Wg a"% 
anb = ‘sareurp1o gris so] nA ele Il 


Oe a= MP) } Hee 
fay ei BC 0 Kilt Ke 4-24 


tA, _t 
tO ee Re 


ounsugq 
(Mg 1(P) gq) Ox = See OF = Pad W108 SNe ak 
i rh Olas 0 r= MP) N0 | 7 >¥ inod MP) i ALK 


1 suoud}go snou Oe 9 anbsind ‘s10] eal “i ae D) 
i, no Ory ie ‘A SUOAR SnoU ‘soulIa) sap 
salvo sap aonb 31s ou [I puenb ‘ayinsug *7 ¥ ¥ Sey snoy unod 
In p = "Ip no ‘UOssIog us aseuuol[nueyse | Inod aryttdurts 
os worssardxa || stew q 3 suep onbyeipenb owioj 
aun igaar ‘4 ‘Jerquad ug “uy, = "0 = 70 19 ‘uoynueysg,| 
suep 7 10 ¥ SaUN Sap UOISNTOUI,p su[Iqeqoid ev] sUsISOp 
My no Mus, =v ya ‘snossap-10 anbiydxe YoIssa1s9J 
op NpIsgz un 389 AP yo (IP cg ae “eh pty) 220 
=A S10 SUOAB SNON Us= 600 0) neg 
=f 10) ak 0. ie oy ake “a HOTT p 
iuautadnoss a] Ins apuoy Os. oe e pele aie: ye] 
="3 no Mats pn Y= a ap 10[ke], ap souRLIeA ey] 
Fred suouSIsap snou ‘7 ‘| = fanog |" awQd09U) Np aanalg 


V AXUNNV 


“suOlsassns jo sonbiewial sasnatogid sind] ap $1n9}9] 
xnop 32 JUuIo[pe Joyo Ud INd}OKpsl 9] JUDWIITeS9 SUOIOIOWIII 
SNON ‘opens onbnsneig op WoNspuny] “Ss jo opuRlULy 
anbnsyeis op uauojya] “y ‘epeueg onbnsneis op ysulg “V 
19 NO[ZOIIPI “V ‘WIA 908 SUOISSNOSIP ap sIdIJ9UIq SUOAR 
snou ‘gsodxa juasaid np saepl sap uOT}e[NULIOJ eB] SURG 


SINGING aang 


‘sprod-tun 
owia3shs np souaeadjod ev] op nua} ajdwios ‘agaaie 
QLQO]S JLOVSIJJO UN ,P BUTINL | JOINSS JUDWIUUOD ITOARS B 
‘grqerogidde souryodun aun ev nb uonsanb oun spioqge sed 
SUOAR ,U SnoU ‘gsodxa Juasaid a] sue “splod-run aISajeNs P| 
Inod agagjea afeqoys aovolyo oun .p UoTUI}qO | 9p xneJUSU 
-EpUO} S]UDWIZI9 Sop jUOS UONeULIOJUI.p syusednoI3 
Sop UONIUIJap ek] “NoVINs ‘Ja X Sa[qeUeA sap uOT}OaTIS 
VT ‘jJalagjul.p sourewop xnedioutd sap osiqissod anb 
jurjne yusysoiddel as UONeULIOJUI,p syudtUadnoIs say anb 
99 B IQIOJUI INO} sUOAR snoU onb (["L dWai09Y}) aNUOWEp 
JUDUIASSAIdX9 SUOAR SNON “JQIDJUI,P SATQuieA so] sajno} 
JO SOUILUOP Sa] SNO} INOd g}OvOIJJa QUUOG oUN jURINSSE 


6c 


spiod op onbiun afquiasud un o1InsuOd ap ajU9} ‘aydurts 
snjd dnooneag ‘sprod-tun a1sajens ey] “swojja,p dnoonevaq 
JUDANOS dBIX9 JUSUI}sSNlv Pp dT9POW ANdT[IOW Np syoIaYyooI 
ey onb sored ‘jQ19}UI,p so[qeleA jo sourewop sinorisn{d 
jueyodwio0s aygnbua oun snod onbneid sinofno, sed 
1S9,U UOTOIpeid op a1sajes ev] aonb nuaynos suoOAR SNON 


SNOILVONVWWOOUYA LH NOISSNOSIG 6 


“O[Qpoul 
np xtoys eg anb ajueyodu snd jso omelixne uoneul 
-10JUI,p syquenb ey ‘(¢°g) Jasi[yN .p yowed a[qissaooe uot} 
-PULIOJUI | anbs10] (7°) AIstoyo op aonb Anawa oun gyITeaI US 
WeIIS 9D ‘(Z') Inod anb ained snjd yuawsayqerogidde yuow 
-a][aniiqey 3so souRLIeA Pv] ‘(¢°g) Inod a310} snd dnooneaq 
4Sso UOTFeWIOJUT | onbsing “(¢°g) Inod ourewiop np neaaiu ne 
nuuod ag Wop xX [e}0} 9] steur *(Z°g) Inod yWJns uone[ndod 
RP] op neosalu ne xX [e}0} UL) “dTlelIxne UONeWIOJUI.p 
SoUdIaJJIp saquenb sap yuIsIxa s]j “sprod-run sinayeultysa 
sap xnap sno} jos (¢°g) 10 (7'Q) :sprod-tun s[suPT 

‘gyeronio 
souryodut oun sed e.u (UOISSaIs91 Op sayapowl xnop 
amud x1oyo un 4sa Inb) xno ajuda XIOY9 JJ ‘(a[qissaooe JuRId 
QUNUILUOD SIIVITIXNe UONPULIOJUI INV]) SaTqissaooe XIOYO 
sap xnoap sno} UOS (¢€°g) 10 ([°8) aNbsIOT ‘Isury “uoNeUL 
-1OJul.p sjuswgta sonbyanb ins apuoj as a[[a,nbsso] apquis 
sed jsa,U aj0UNSIp ajuad ap uoTeUINSd | IBD ([°g) Iorayoid 
ayer ua ywesnod uo ‘aurewop yed un inog ‘senbryd 
-PISOW SP SUOTJVULIOJUI Sa] JURAINS ‘aseJUdOINOd ap sjulod 
xnop no un. nb srojied jueusiaye ,U ‘a}TUUI] S$) Sd DOURLIBA 
RP] ap isa Inb 99 Anod (¢°g) ap aBelURAR | ‘SIOJaINO], “([°g) B 
jusWIsANeIedwod ‘aourweA oyjed snd oun juswefeniiqey 
129 UOISSOIZ9I Op NplIsai np udkow sued yyod snjd un 
ayodwiod [I uanbgsuos Ieg ‘sgisnfe juos sanquresed ap snjd 
onbsind juawajsnle .p sfapowl Anayrow! UN B& puodsa0d (¢°g) 
onb jinsud;s [J “dJOUNSIP SUISTIO | Be BaUUOPIOO9 ouN Nb UaIqG 
Issne a}0UTSIp ajuad oun ajioduwi09 surewop onbeyo janbey 
SUBP I[QPOU UN sd (¢°g) B II] B[Qpoul a] ‘ourewop oenbeyo 
Inod sa}DUNSIP SUIZIIO | @ S9UUOPIOOD Sap sIeU OUNUIUOD 
ajuad aun SdAR UOISSIIS9I OP B[Qpow uN jso ([°g) zB 
QI] BQpoul J] ‘JUVoel-snos UOISsaIZ9I Ip s[Qpoul np 3so nb 
90 INOd JUSIOJFIP STI STeUU ‘OITeTTIXNe UOPULOJUI.p aWUeNb 
QUIQUI BI JOSTTNN S|] ‘soesul] UONdIpeid ap sinayewNse 
sop xnoap sno} jUuOs (¢€°g8) 19 (T°) ‘JuoIpeid o[sue J 

‘sptod-tun a8ur | (11)19 JnoIpeid a[Zur | 
(1) :sajSue xnep snos Lav A yo SAN? { rareduoo suop 
suoanod snon ‘outewop enbeys inod a}duNsIp ourS10 | & 
dQUUOPIOOS UN Ja dJOUNSIP ajued oun Jaysnfe .p juejouuied 


Oop InayeuNse un,p wW8e,s ae do no 
. Ps Ps 
(ES vinnie aly Shy re hig ag cea 
suoae snon ‘g ‘T= Pp “(Px PN) 


jso SUOTBUITSO GJ Sa] Inod asinbai UONeULIOJUT,| ‘aI3g}e1s 


666 Leiquieoep ‘ayenbue,p senbiuyos | 


ne | 12 oun,| Inog ‘sanbnuapt quos sprod-tun snayeunsa | 
12 uoNoIpgid ap Anayeursa,| nb pusidde snou [-9 suIQI09y} 
3] ‘ainjonns ay90 syoduios *x onbsing ‘uoNeuLosur.p 
yuowiednoss un so ourewop onbeyo jo ‘(x ‘y) = x 
1S9 9SEq OP INd}D9A 9J 19-S¥d 90 SUR] *y Sa[ Sno}Inod | = *9 
anb stosoddnsisnow' ya 5 Cx ot ex oes x Moy ate 
auelixne imajosa swwI0d suosiogid snoN gq seg 


“‘UOneULIOJUT .p snjd JUaUOD ([°g) sTeUL ‘oTeT]IXne 
IN9JO9A SUIQUI I] INS JUSPUOJ ds xNap say *(Z'g) sprod-run 
INDCWYSI,| WP II B DINdWOJUI JUOWId}OU sDOUIILA 
oUN JUSWIIeUIPIO BWOdWIOD ([°g) JHoIpeid InayeuIT}sa J 
‘agus uoneindod ey ap Injao & INaLgJUuI NedAIU UNONe 
B g[qiuodsip 31e19 ,U X [e10} 9] IS JOST[NN Wespneyj snou [I,nb 
INJ99 sd JOSIIP InsjeuNsa yoQ ?**S Dak POR OAT: igi 


v 


(78) (EITC OF ees, 

quataop ’77 ourewop 9 Inod sprod-run snayeunsd J 
‘uonetndod e] ap neaatu ne nuuod [e10) un yso *x7{ = x no 
(XIN PN IN) UoRUOJUL | a3Ixe (p'¢) sprod-tun 
sINdJeuUINss sop sjquissua,, ‘juowajulIoluog ZY seg 


‘sptod op swiaisXs aidoid uos 
auodwio0s surewop anbeys ‘s[nu uou spiod sap juaatodsa1 
(?AQ ap salao JuawaINas sed uOU 19) sauTeLUOp sa] sno} suBp 
soguuoy]HueYyde saytun sa] anbsind joosIpul so InayeuNsd 
yD ‘one | & sUIeWIOp UN.p JaleA yUdANed sUISIIO.| 
B Sd9QUUOP1009 sa] onb sipur} ‘gy souTeWIOp Sap sTquIasUd ,| 
JInod sunwiwW0d uolssaisa1 op ajued oun ay10dWI09 ajusse 

. pxx = Ae hs 
-snos uorssoiga1 ey “Pg! aK jee oe ux EEricg RO 


(1g) (xP # Py) Hf end ROE Ne 


quataop ’7 ourewop 
3] Inod uonorpeid op inayeunss J “auTeWOp np nedaru 
N& NUUOD [e}0} UN sd %y/0% = "My? =?y no‘g*, =p 
“(Py Par) uONeULIOJUI,| a3Ix9 ‘Gg syNoIpeid ourewop op 
sINdIVUINSE {Sap (¢'p) BIquasud,| ‘UaWaIUIO[UOD [YW seO 


‘sonbnuapt sed yuos ou (ZV $e) 
sptod-1un inayeumnss | 19 (TV $e9) JuoIpeid anayeurnsa | ‘SJO] 
saq “¥ sa sno} inod | = "2 suosoddns snouja (7x ‘%g) = "x 
aerfixne indjo9A suWWIOD suosiogid snoN YW SseO 


(IQ 6 1g) - %9 aurewop 
ap InsyeoyHUapt | JUdWe[ese suostfun snoy *"9 “=~ 10 
Par Kp a Bk Pay Ayn AR = Sy no Gk rs 1) eh 
Stes tf eis) Reg 69) Cras) “k 
=P?“c “:gqueains uonejou = e]~—s SuOSTNN = snoN 
"€°S 19 pp SUOTIDES Sap UONONISUOD Op JUUINSIe one | 
NO UN] Op ople,| & INdJeUII}Sa | SUBP SOUTRWIOP sap snuUUOS 
IIe} ve] JoI0d1O9ut suoAnod snou ‘snossap-1d g Sed a] NO Y 
SkO 9] SULP SUNOS *xoIIeI[IXNe INdIO9A 9] JULTNULIOJ UT 
‘2 ep uonnsed oun juenqysuo0s 
C 19191UI,p saurewop sap inod ‘q**‘*, = p‘? A ‘al[te1 | ap 
jofns ne UONRULIOJUL,| ap JUSWIETeS9 9}STxO [I,nb srewosep 
suosoddns snou ‘ourewop np neaatu ne jos ‘uone;ndod 


Po Gelare 


R] Op NVIAIU Ne OS NUUOD [e}0} UN jURVOdWIOD aANIsOd 
SinofNo} 39 J][OUUOISUSLUTPIUN X Seq Op oITRI[IXNe o[QVLIeA 
BR] ed vy ‘oulelixne uoNneWOjUI,p snjd oaae Z UOTOeS PB] 
ap ajduraxa | & SUOUINOJaI SnoU ‘UONDes ayUasgud BT SURG 


SANIVIWOG Sdd ATTIVLI VT Ad LafnAs NV 
SNOILVWYOANI.G NOILVYOdYOONI $°8 


"SO[QUIOAR] 
Issne ong sed ou op juonbsi ‘asiogid uoneunsa oun.p 
SUONIPUOD Sa] JUOS INb ‘saUIeWOp sj} op 19 ‘UONBULIOJUI,p 
sjUsWIodnoIs $90 Jopusosue) JUdANad jQI9]UI,p SoUTeUIOp 
sane .p ‘slojainoy, “uoneULOJUI.p sjusuIadnoI3 suMU09 
yueSITNN sot us syURyodw sauteWOp sap Inod saoRoTTJo 
SUONLUINSA Sap I1u9}qo suoAnod snou ye19U99 US Nb onbiput 
[I stew ‘sopetogds Zasse SUOMIpUOD Sap aBIx9 [°1 sWIQIOSY} 
Y] ‘XIOYO 90 ap uONOUO]J Ua sprod-1uN sUIQISAS 9] JO[NDTRO 
R uode] ap UONLULIOJUI,p s}UsWIOdNOIS ap s]qUIAsUAa [Nes 
un (Jaida00e SUOASP SNOU NO) JUSUaITeUIPIO sUO)dad0R snoU 
‘UOWaIgIoUOD “y exouue | e ons (ev) ap sanoid vy 
“ 82] 
snoj inod | = 79 10 ‘quawianne Q = "9 19 y aIeNSs eT ap dAgIaI 
yarn is | = g no C¥gs MQ «~ Mg) ayes ap Inayeoly 
-WUSPI,| ‘SouelfIxne sopqeuea sone .p snjd us ‘amnypour ze 
uodey ap tuygp iso “x ts CMM A) s EHIME T) A ISSWaLl 
inod (q) ‘({-"»)/[ = "2 onb uompuos ef e CMIM?z), 
= (aM? T) A. sOSSIOg OD esvuuornueyo9,| inod  (e) 
7yins Inb 39 B UO SIO] Seq (t‘L=f£"'Q snod nuuos eseq 
op arrerixne peo} un sa x 2% = 'y 19 19I91UL,p sUTeLIOp 
gpisa’Q no ‘93°Q3'2 3" aonb s[a1 sanbuosjanb uon 
-eULIOJUI,p syuawadnols sap “7 35'7Q log *[*, aWIaI0ay TL, 


LIGA? 7 ap JojAv], op 
goueruea ey ousisap (SUS 7) 4 ‘auraroayy a] sueq ‘JeI[NseI 
np uonuago | nod yueywodu yso *9 np xtoyo aj onb 19}0u 
VW (LSSVA) 9ynens efduns onoyegre edeuuolnueysg | 
19 (a]]1e) BT Op aInsour oun ysa "2 no ‘720% UOISNfoUr,p 
suiqeqoid dane) UOSsIOg op a8vUUOT[NULYIE | oIIP-e-1S9,9 
‘g8epuos op suejd xnop op sen [°, owleosy) oy 
Jed d so1put | suodseyduras snou ts (¢°¢) ted guuop js Ag no 


(TL) PK IAZ An ic Cas A 


Jed 9uuop js9 ‘Z no [ = tn 
yuowiodnos3 9 Ins spuoy ’4 ap sprod-tun inayeurnsa J *’7AQ 
1Q19)UI,p surewop np *7 anb «ayso.d snjd» sa ‘7 19 **A 
aonb gijieyep snjd nesaru un e uoMeUOsUT | ap wunoy '7A 
iury 93°93'93"7 :sanbiyoresgiy JUOs satquiasue so] 
anb jay “x 9% = x nuuoo asrerrxne [e10} un yueyodwios 
‘“7 pues snid UOHBULIOJUL Pp juowiodnols one uN jUSW 
-3[e39 suosgpisuog “x 7% = x nuuoo anerixne [e10) 
un jueyoduios ‘'4 guuop uoNeWOJUT,p JuoUednoIs un 
suep JusuolenUd stidutos 3sa ’77 anb Jal ‘Q aguUOT[HULYOS 
uonejndod x] ap ‘”77 1e19\UI,p QUIeUIOp UN suOIEpIsUOD 

"TL SWIIO9U} 9] 9WUOUT 9] 
QUIWOD ‘UONRULIOJUL,p JUDWIOdNOIS Np dUOJOUOUW UOT}DUOJ 


SUOIJEWISE Se] JNOd saslel|IXNe SUOIEWUOJUI SEP & SINODAI 97 :JEPUIeS Je OeAS]SA Srz 


oun jsd gourleA ey aonb siaquow jnod uo ‘siatjnonied 
seo sop sued ‘ained 3s douRLIeA ev] Sn{d ‘UONeWIOJUT ,p 
juswednois un,p aydsoiddei as ourewop un snjd ‘sos 
uy °Z UONdeS BP] ap a[durexa ,| a1yUOW 3] SWS ‘sprod-run 
INDJCUITISS, | OP BoURLIeA PL] INS I[qQeIapIsuOd sOUaNIJUI 
OUN ddJOX9 UONPULIOJUI,p sJUOWdNOIS sap NRdAIU IT 


YWOTAVL Ad WONVIAVA 
VTdd ANOLONOW ALaTadOudd “2 


jgaubuuce! sed juos ou sinoyeUINse xnop 
say (tx OS 0 0 ale agy[rergp snyd uoneuuojut | 
asixa TNANTIT anb sipury ‘, ("x ane ola POs Myf" ( omen 
-IXN® UONBULIOJU | 98Ixo LAA 1K tires DE ee ap 
]e10} Jorwaid Mp HORUS? Re SIO] Saq * Cx x7"Q) 
="x wos “quia ="q ‘apta uou et aun 
yuewoduios 7 10 'q sourewop xnap sfdurexa sed suosep 
-ISUOD “JUdYoNRAsYoO sourewop sez onbsioy sed juaulajeIgues 
onbydde .s ou swiei0ay) a] ‘uOnPeULIOJUI,p syuoWodnols 
SWIWIOD souleWOp op jJURWOduT sfquiasua uN juesTTON 
ud sprod-run swiaisfs 9] JOUIWLIOI9p SUOLIASp snou ‘afqissod 
np oinsauw ey suep ‘onb onbipur [°9 swigiosy) aT ‘sIWO 
quos sjteiap say ?’s -—s 3 y say sno} nod g= "3 10 "say 
nod 8 = "8 = "8 onbjuenuoul us aanaid ey Henge e 


op'x Ox 1p pee 
Oy py” Ke *POy sane ((19/70x | oe (Be Oy ie 13 po 


Tht Sai Ke “Lge Ne asrianhip 4 ‘sonbruapt quos (°C) 
red quuop “84, sprod-1un snoyeumnsa,| 19 (¢°¢) red euuOR 
aaaaNrip 


4 aa op snayeUINse,] SIO] Seq ep 


inod nuuod aseq ap Jat10190A e101 uN sa Mx’ (=x anb 
[ar urerpixne anaqoaa un * (Ox 70g 6+ We t+ WyetTQ) 
="x¥ og ‘Q ep uonnmd oun  juannsuos 


inb saurewop sap 49 “"“"7 “" "A Nog [9 aUaA0ayT, 


‘sonbruapt 9it[eel us jus s[t,.nb onbiput snossap-to 
JOUOUD | ‘SIOJOINO], “JUSWIWIDISTJIP S}IN.SUOD JOS Xnap S23] 
anbsind stnboe inod aipuaid ay sed jned ou uo ‘uoneuojur 
WU FI WosI]NN s[t.s sway {UONeNIs oO suep 
sanbnuapr juos 3x 49 RANT anb ao-1sq “Ox aseq ap 
IN9199A 9] INod uoNRUIOJUT,p JUoUIAdNOIs UN Jsa ouTeUIOp 
onbeyo ‘gq ‘*, =p ‘x "% xnej0) say aseq ap sinajo0A 
Se] Inod quousssogu sorssreNs xnep se] “«ureWop 
anbeyos inod nuuod ong uop x ee, onb asoddns 
OSNANIT? XB SINOAL gJ ‘SouTeLLLOP GJ S2J SNO} Inod uoNeUINse 
gun suosedaid snou onbsioy ‘Isury ‘sed canara 
au souleWiop sat enbsind «nuuos ang Wop x ‘2 
% puodsarioo «nuuoa ang wop *x'?{>» LCRANTIP A 
mod s0uesixa,| ‘alinsugq ‘«ourewop onbeys inod nuuos 
ang uop “x 1%» B puodsaios ‘«nuuos ang nop *x2%>» 
SMX Inod aouestxe,] si] seq “y giun,| nod nuuos 
aseq ap Nain 9] 189 x NO (x Mg #2" My We +z MQ) 
= "x yo y oun, mod ourewop op snayeoynuop! 
IMayoaa gp ,(77%Q “7? Q &*M"Q) = %Q WOS ‘|Q ap UONTUed oun 
yuemnsuos ‘779 «a « "9 ‘souremop Gg SuoIEpIsuoDd 


Lve 


“JOIUOUL 9] SUOTTL 
snou oumuo0s 7x alrel[ixne in9}99A Np sammjonsns soureyi99 
Inod xnese juOs s]I stew ‘sanbyuapr juoweeigues sed 
juos ou Law 4 CawaNr1P A sinayewnse sa] ‘uonejndod 
B] ap neaaru ne yejoy un **x"% asixe HAM? A anb sipury 
‘QUIRULOP Np NvaArU ne [eI0) UN “7x iT essxons Ney 
OUIQUI B] JUDWUITeSsaoqu sed 3sa,U OIeI]IXNe ‘uoneuLoyur,p 
ginuenb xy ‘srojonoy, ** x orrerpixne 1n9}99A SWIQUI a] XNOp 
sno} quasyyn AM, yg TANT TC ICQ -uoneuNsa,| suep 
dasi[un surerfixne uoNeUosuI,p suenb ey 19 aMeTIXNe 
IN9JOIA BJ OUD UOTOUNSIP ve] JousI[NOS ap sod I] 
‘saqedioutid suonednosogid 
sa] sed juos ou ajqissod anb sauuog Issne suonoipaid ap 
UONUAIGO | 19 BJapoul ap jusUIa)snIv J ‘a[qissod np oinsoul 
PB] 91NO} SUP SIILI[IXNY UOTPULIOJUI | 9p aqo[sua Inb sprod 
ap sulaysAs UN,p UOTJONIYSUOD PR] IS9 SVO 9d SUP UONLATOU 
vy] ‘algnbua,| op ’€ sajqeiea sa] soinoi ev sptod ap arias 
aun suonbrydde snou ‘sprod-1un a1Zeyens ey ap isa Inb 99 
inog 74 ap (a|'Xf= "€ suonoipeid souuog ap uonuengo || 
1so uondIpaid op algaiens Rl op JUBATIOU IND}ORJ VT “(p'S) 
sed guuop +x sprod-tun inayeurysa,| 39 (¢"p) red guuop 
ee aureauly UOTOIpeid ap InsyeuINsa | Os ‘auTeEWOp 
uN.p ]B10) a] Inod sjusgJjIp yuaW|qissod sunoyeuNss 
XNOP JUUILIUS SJUSUINSIe SdD “OUTeUIOP UN, Pp [e}0} 9] INod 
aueguly slapuod InoyeuINsd UN Pp UOTJONI}SUOD I JULSLIOARJ 


SJUDUINSIe XNop SUTLUeXa SUOAR SNOU ‘¢ 19 f SUOT}OES XNY 


SYAITAOILAVd SV) SAd WNOd SGIOd-INN 
WOAALVINILSA.T Ad La NOLLOIGdad Ad 
YNALVWILSA.T Ad AONATVAINOA °9 


yi) tes 


(S'S) Sey ata Yt 
ed juouladnors, te 
y ee sa] Inod ‘(¢'¢) 9p suouaigo snow mOmiy o Tee 
ots 20/2x 1x My Roe E Hele epee cae 
XNv}0} sone sap sed uou sieur ‘ “Ov ‘adnois 99 nod nuuos 
[2101 np juoIpuadgp d jusurodnois np sayun sap sinajoery 
SX] ‘SIOJ BP] B UN SgfNoyeo og JUsAned (Z'¢) Jed souuOp 
"3 sinoyovy soy anb sonbseuras wey UO (S661) [epueS 
9 NO[soMpIy ‘oeasdisq ‘Q ep uonnsed oun jueniNsuod 
UONLULIOJUL ,p syUdtUadnols ap [eloads seo a] sueq ‘d uoNeUL 
-10JUI.p Le eanor 3] Inod cues ee OP [911099A ie 
gy so Mx ee %Y no (My ly - 1X AT 2 
jso nuuos ang Wop nb eA [e101 oJ Naaeee 
= "¢4, anb ya d yuowodnosd un .P siquioul yso y 9yTUN | 
Is [= 4. anb 19} mane op arose ou un yso “A 
0 CO TEA 62 Wey AT to WoT) — Ux Jed quUOp 180 19 I X/ 
seed apmysanc onerprxne Ind}99A 9s] ‘syuowednoi3 
L<d ASIX9 I$ 39 ‘] Xf UOISUDUTIP ap 1S9 ase dP INIJOOA J] IS 
YgIQIUT Pp 
soulewop xne sonbruspt ae sed ou op juonbsi asepuos 
op aseq PL IP UOTeWIOJUI.[ INS s9puo} UOTFeWIOJUT.p 
sjustuadnois say “UoNbgsuod Jeg ‘UONPOIJISSe[D Op JUasULYO 
SouUN SoUuTe}aO ‘sastidamus-sajgnbus sa] sued ‘soyjousnpul 


666 Laiquasep ‘ajenbua,p senbiuyoe | 


SASSPID SAP d1J9 JUdANAd JQI9]UI Pp SaUTRUIOP Sea] ‘snssap-1d 
a[dwiaxd,| sueq “uoneUOjUl,p sjuawednols say jUapuas 
-SUBI] SOUTRUOP Sa] [e1QUdS Ud SIeW ‘oUTeWOP UN aye Ined 
UONRWNOJUL Pp JUdWIadNOIS UA ‘s}UdITJIp s}daou0d sap yUOS 
IQIQIUI ,.P SOUTLLOP Sa] 19 UONPWUOJUI .p sjuoWednoIs say] 
‘uoneindod vy] ap onbiydeis0ea3 uolstatpqns 
aun gjduiaxe ied ‘“Q 10 'qQ sed yap s8o13esep 
snjd neaatu ne anqis as aseq ap INs}9eA ap yofns ne uot 
-eunsogut,| «(2x AY My Ny 07 My 1%) = y 1g -argnua 
uone[ndod ey] op neaatu ne aniis as aseq ap 1nd199< a] Inod 
uoneumojur, “(x 2% x7) = x Ins apuoj os uoneU 
-189,] I§ ‘astidanua,p iniq nusaal a] = "x 39 sgko[duia,p 
aiquiou 9] = "x no aseq ap [aUUOIsUdUIIpIg 1Nd199A UN,p ¥ 
astidanua | Inod ingyen ey asa (“x *"x) = 7x no astudanue 
-ajygnbus oun.p tnjao ‘ajduiaxa one UN SUOIEPISUOD *¥ Sd] 
snoj inod | = 7°x jueyodwios uoneMojut,p syuswednols3 
Sop juos sonbissejo neosalu puodds ap sayeNs say] 
“UOTBULIOJUT.p syuouIadno13 
SOP NKIAIU NP 39 VSeq AP Sd][90JO9A SaTqeURA Sap UOTIUOJ 
So splod-tun oulayshs np soja /T “alelfixne uoneu 
-IOJUL,| OP NEIAIU J] JUDUTULIAJap syUsWIOdNOIS say “nuUOD 
aseq OP [AIJ0}D9A [e}0] UN JULOdWIOD UONeP[Ndod-snos 
dUN SUWUOD UONPULIOJUI,p JudUSdNoOIs UN sUOSsIUIJap SNON 
‘aseq ap Inajoaa gjadde 39 x d10U INd}99A UN JUaNITSUOD x 
soqeuiva Say ‘uoneindod ap syuswiadnoi3-snos ap a[quiasua 
un Inod j10s ‘7 asaNUe UOTe[ndod x] Inod os x sajquieA 
sInaisnid no dun,p snuUuOd xne}0} Sop aqo[BUI Y [9110}N9A 
jeioyay IM" x nod {s 3:73" = "m} sptod-tun owasis 
9] Jofnoqeo Be jueasras *x% = y aulelfixne [d110}99A [v10} 
NP dINjoNA}s BP] JOUTWILXS B SUOUDA Ua SNON *L UONIeS P| ap 
I'L 9ulg109u} <] onbrput ,| swu09 ‘spuvis snjd syuswadnoi3 
sap Inod snuuos xnej0} saq anb saovoyyja snjd UI; 
suoneunss sap juesinpoid synod snjd syusuiednoi3 sap 
Inod snuuod xnve}0} sey ‘[eigues uq ‘setidoidde uonejndod 
op sjuswednois sap Inod aiel[Ixne UOTPULIOJUI 9UN Pp 9II[IG 
-Issao0e | op puedap sprod-tun aulajsAs np gioevotyje,T 


UOHVULIOJUL.p SJUaWIadNOIN, S'S 


“SalUdIaJIp JUsua[quiogidde sayjanjouod suoneuinse sap 
sed JUSUIA[eIDUYS JUSUTE.UD ,U 19-XNO SIU ‘sJUDIOIJIP JUS 
-31989| splod ap souraysAs sap inpoid sour}sIp ve] ap aNsow 
anbeyD (9661) IYO 39 ysurg sed 19 “(9661) [epurES 12 
NO|[SOIIPIH ‘JaxMS Jed USWIUIIDEI SdaNTRAdD 19 SddJOPISUOD 
919 JUO SOURISIP Op soiNsoU soNe sINaiIsn[g “UoONTOS 
oun 9a}stxo [I,nbsioy, synisod sptod spuvss sa] ja sjnesou 
splod so] JoWAg,p Jouled vlad “InajesinN,| Jed saruiyep 
SOI] Sa] JUS *%7 saz ja ™m sat no ‘say anod 7s *ms"n 
UOTLWWI] Ip BUIeNUOD RI OP 39 aBRIeO Op aUIeIUOD 
Pl OP DAIOSSI SNOS DPSTUIUTW JSd UOTIOUOJ BT “(P66I 
OPAD]Sq JIOA) sptod sap SHopprapN wore UU ap ainpgooid 
oun mera FOS 71 (gq) ae Antes: 1 Be aes Seay 
op "3" = "m sptod say suouaigo snou ‘*n/, Comin) 2K 
Sasl[elgues salied SdIpUuIOU! Sap dINsoU k{ SUIWIOD 
WUIJSP 9S doUR}SIP op UOTIDUO] v] aNbsJO'T “YY NUUOD [9LI10}99A 
[210] np ojoexa uOoNeUINsSd oUN dssInpoid uoNeIapuod 
ap owiaishs neaanou af enb o8txe nb y= "x"m'% 


ISP[LI 9p JJUILIUOD e] ap aAsasai snos ‘7M sptod xneaanou 
saj19 " xneurlsio spiod sa] anus sourisip ve] 9p asnsow! oun 
SUOSTUIIUILU 19 SUOSSIULJOP SNON “YX SIIXNe UONPULIOJUL | 
B sInodel yueAe ua atIpow say aja 30 “u/] =" aseq 
ap sprod say yedap ap jurod sumu09 & aseyeo ap oinpeadoid 
ey 7x2% = xX nuuod [e}0} 9] Ans spuoj sptod ap owaysAs uN 
alnpod e was Inb [noyeo ap ainpgooid oun jsa a8vleo aT 


Splod sap 199.19 ap UOSRJ DUIUIOD asE[eI IT op’s 


fQ Jueuuonnsed soureurop 


Ino nO Ino sap nod giAnIppy 
(7 sayqeuea 
Ino UON uON $9] $9)n0} Inod) sprod-1uq 
Ino, Ino UON (7€ snod) somegut spiog 
: N27 S83 aurerpixne 
pal ( tx A sno} inod "x UONPULIOJUI Ud SUIOSag 
aure9ut| uo 
LAMP, — GAYANITP ¢ Caud? ¢ 
moajewns| 
LIAN? 


A ap ya arteguty (GauANITP 7) aawaP Xap 
‘grregury uou 9444?) ap uosteseduroz 
Z neaqe | 

. LIMP A apie Cad NITP 1 ep «daud Xap 
sonbusuig}oesed sa] ouinsgi Z nea[qe) a] “SOATBIISIUILUpE 
S9OINOS OP S91] SNUUOD XNe}0} Sap apie | e UONeIgpuod 
op sulaysAs a] Ja[noyeo ap gsI[qGO uUdIq 1sd UO ‘asepUOS 
ap aseq B] ap saqUN say $9}n0o} Inod sayqissaooe sed yuOs ou 
"x sinaea sat anbsioy ‘snjd aq °’€ sajqeiea sap ounoeyo 
Inod «jeuimdo» uoneigpuod ap eurayds un Jayorayo op 
g[N o1aN3 Jsd,U [I UaANOS “uNOddO sdura} Ud sUOTFeUSO 
souuog op Joredaid op jourad adits a139ye.s 31199 sTeul 
‘PK sgiqeliea sap sunoevyo inod aovoryjo snid 9] sed 1sa,u 
spiod-1un ouraysAs a] ‘sajgnbus sinaisnid suep a[[ayoe.p 
SOIUIOU0D9 Sap JasI]eaI ap youLIod onbrun spiod ap owiaysAs 
UN (S661) IepureS 19 No[soprH ‘ovasisg Jed 19 (1661) 
no[soipipy Jed aytiosp onb ajjai AOS np ssojopoyjow 
RP] op aseq ev] sWIOJ sprod-1un oswayshs uN.p d9pI,T 

‘2 ap Jaljnsei sjquiasus-snos un ajuasgidas nb surewlop 
un Inod juareyjIp sft ‘stojayno} ‘[eigues uq ‘(¢'p) sTeaUT] 
OAUD Inajeunsa,| e juapuodsa1i0o xnap saq] ‘sonbyuept 
yuos (pS) sptod-1un inayewinsa | 19 (Sp) utesuI] UOTOIpoid 
op IndJewINsd | ‘Q o1gWUS UONR[Ndod vy] 3S9 oUTeWIOP ZI IS 
‘sagiapuod 4 singfea ap UOIOUOJ US UOTINSUOD PB INIOSSOI 
Wey (p's) suep ons inb [JAAP IdIpul JT ‘Janus 3n0o} s 
uoyTHueYos,| ap uonouos ua 4" z ap (gourteA yo nbn} 
-durAse gsterg wou 219}9eIed) aseq ap sanbusneis saigiidord 
so] JoUIWo}ap op younlod ejag «mM = 4 TH tz 
anbsind i eh aILog +=yuouaye39_ «suoAnod snon 
PIT RCN gens ok anbsind synsneyxe jo syisnfoxe 
JUSUOTTONINU Aeon Sap Inod JuIppe jsa [I ‘UoKONsUOD 
es ied aq ‘ourewop np Juowenbriun jueusaold ¢ saguuop 
sop asian ji,nbsind oorp inayeusa un.p wse,s |] 


(ps) 1p ea 


SUONEWIISS Sa| INOd Seslel|IxNe SUOI}EUUOJUI SAP & SINODAI 97] ‘JePUUeS Jo OBAS\Sy Orz 


qed 1urjop 
PX aUIeWIOP ap [k10) Np sprod-run inayeuNsa | SUOUS}GO SNON 
-? surewop 9] anod saauuop xne 73" = ™™ uonesrapuod 
op owaisks a suonbyddy ‘sayeynos no gziqruodsip 
UONPULIOJUI | 9]NO} JUatUgsOddns aqojsua Inb Y nuUOd [e10} 
3] Ins spuoj as UONeIapuod ap sulaysAs 99 Jed og[NdIY9A 
UONVULIOJUT, JT “oUreWIOp UN Be sJeTTnoNIed ’€ s[quieA 
ano} e& sanbrydde sind ‘stoy aun sgjnojeo ong judAnod 
sq] *€ sinaea sap sed uou stew "x7 = x nuuoo [e}0) np 
19 SaguUOT[NURYDE saitUN sey Inod *x sap juapuadgap ‘(Z’s) 
qed squuop “3 saj no‘*8 "py = "m quos ({°¢) ap splod sa] 


saurewop sa] nod sprod-tun anajyewiysyq ¢°S 


-P€ satqeliea Sd] Saino} Inod syeynse1 
suog op Jouuop jueAnod juaeAdjod sptod ap owayshs 
UN JUASHOAR] suOneIspIsuod sag °’€ aqetea anbeyo 
Inod sjounstp spiod ap sauraysAs sap Jo193 op 30 Josedaid 
ap spowumwod sinofno} sed jsa,uU |] “AoURLIvA P| Op sajUepuod 
-S91109 sUORUINSS Saq sdwiod K ‘’€ satqetiea sa] soyno} 
Inod juawepides jo jusuWeINOD saaiedgid ang WUdATOp 
SUOTJBUIT}SO Saq ‘algnbua,p sjeInsal soy UOWIOpIdel JasnjjIp 
ap jurywodut sa [J “| UONSes eR] B IUIJap aonb Ja) sulewop 
ne osatynonied ’€ aqeiea oun J9910 yNey [I 19QI9IUI,p 
oulewop onbeyo nod 39 ‘sag[[IeVaes] SaINdY Sd] 19 SASIOA 
S]JUSU9}IE1} Soy aUTUIOD A SatqelIeA sasneiquiou ap inod 
SUOIJEUINSS Sap JUdJISS9D9U saTeJUSWIOUIBANOS sajgnbue 
sop ywednid ey] ‘ayjayoa opueis e sanbysneis soguuop 
ap uononpoid ve] suep JUSTUSAUODUI UN SWIWIOD SI9pPIsSUOd 
ang.p onbsu [I seu ‘aovoja juowayeutoU 3sa ‘(¢°¢) 
red guuop G¥dNrir A Anod aumuuos ‘sourewop syusi9yJIp 
inod syounsip sprod op souraysXs sop & sinode1 oT 


spiod ap anbiun ajquissua un,p asejUeAe,.J 7S 


(19 SWUgI09Y}) 9 UOTIDas 
eR] & ofdwioxd uN eIdANON Ud UG ‘JOOIIP INayeWIsd uN 
qUSTADp (¢°S) ‘seo [a] un sueq “’s - s 3 y Inod g = 3 anb 
3[[21 aIMONnNs sun syodwos 7x snbssoy stuaAins yUdAnod 
suondaoxa saq *a}991IPUI Jos UOTRWINSa | anb ajqissod jsa 
[E uanbgsuoo seg *”3 sjnu uou spiod sap 110A9001 JuaAned 
((Q19}UI Pp DUIeWOP Np saT[ao JUSUTNas sed) s UOTTHURYDE,| 
ap soiun say sayno) (11) {’7 suIeWOp np Issne sew 
‘s ap 19 y op JUaWa[Nes UOU pusdep 3 aonb sored “ouNsIp 
aplog op owiaisAs un asoddns surewiop enbeyo G) (€ C) SuEP 

pe spiod sap sjoodse pen suojou sno * “7 ,(” ee 'X) = = Py 
9’s-saysQ=Vo?sayis [=e a) 


Q@ no *a/*xPy + 
= "3 saae "38" ="m srewlosap isa splod 2 no 


(¢"¢) ae CES 

SULIOJ BT SNOS 
oeguly uoleiapuod sed Jswtidxa,s juowesyese jnad (¢'p) 
sed guuop Se eae QUIeWIOp ap UONOIpgid ap inayeuINsd J 
xy 9T = y aMRI[IXNe [e101 9] BBIxO [NOTeO ng] anb 19 (sao) 
“Bg[v OUOP 1UOS S|1) § ap 19 ¥ Op STOJ LT juapuadgp "3 so] 


enb Jajou y ° "oj Te lett Ce “L 0 , HEX Vea VP 


Svc 


(7S) 19 / eis St 


oaae ‘13% = "mM no 


¥ s ddaudNit 
Mm <= 4 


SIO[e SUOAB SNON “SegAtTosqo 


T€ sIng[eA Sap sIIeaUIT do9puod sUTUIOS sUN sUTWIOO 


NANIT{ Jorgpisuoo suoanod snon ‘ana ap jutod anne un 


anboag (¢'p) sed aquuop CFY4NTI A ep arleguiy SULIOJ eT 


(log) 


stegul] ODAAD 
INd}VUIS,| ap UOWeIIpUOd ap s1Inpsd01d BT'S 


SdIOd 4d 
AdIV.T VY NOILONULSNOD °S 


‘9 uoNas BT & o[duraxe un vIsANON UC *{’s 3 y: 74} 
yuouanbrun jueyssssgu ‘joomp odd] np isa GFTYANTIP 
inod (cp) uorssardxa | 7x ourerrxne in9j90a np sornjonas 
SOUILIIID INOg ‘OUILUIOP Np INaII9}xa,| & Sagi « saguUOp 
sap ins anjied us apuoj as_g anbsio] yoMpur 3s9 bet So mA 
anb yinsud,s |] “yoUIpul yso Jt ‘uaWeNNY ‘uonsenb ua 
apouied ey] 39 oureWIOp ZI Nod 1g19\UT ,P J[QeLILA LI Bp sINaTeA 
sap asian jI,s juawonbiun yop 3s ourewop un nod 
INdVUINSA | “(€66 1) ABOFOpoMEY [eonsHeIS UO sayTWWIOD 
[e1apay 2] Jed 19 (7661) a1qQreyos Jed seidope sIZojou 
-IUI9] B[ UO[IS “S}OOIIPUT NO s}daIIP SUILIOD salapIsUOD 
JUSANOS jUOS souTeWIOp sap nod sinayeUINsd sa] 

‘s1oaid san ane nods NF <csioexe 
suonotpaid sap unpoid a[apour 2] 1g ‘a8epuos ap aseq ze] 
suep sgstooid xnap sno} juos souvusyedde .p oureulop 9] 19 

Tx NO SRO 9] SUBP SLILUIOD S99UUOPOIOIU Sap 110s ema 
g0inos 9un,p wos simied e ‘nuuod wos * x AT = ‘5% 
je101 of aonb asoddns (cy) ap uononnsuod ey 


(Sp) (gqix-")"0 Rice q?x- Soria 


(6 “U9 “7661 “1109 19 [epulRS 0A) 
JUSIADP (pp) IsUTY “(Z'p) Jed guuUOp jsa gq Qo so "x = "¢ 
‘queaut] uonotpeid oun,p yeroads seo aj sueq ‘(['p) sed 
guuop agus uonr[ndod ey ap inayeumnsa,| ‘4 eB ope89 
}S9 SOUIRWIOP $99 ap a[quidsua UN Inod (pp) sINayeUINSE 
Sop SUIWUOS eT ‘Ip jUsWeNNY ‘uoNe[ndod x] ueUUONNIed 
soureulop op s[quissua un snod syAnIppe.p jnoelqo,] 
yeysnes (pp) anayeunss,, ‘uononnsuos es sed oq 


n ASG eGo, 


suous}go snou ‘(["~) suep ’s sed s 
yo "fq sed 72 Wedselduias ug ‘auIeWOp [Nes 99 ap yueUdAOId 
(74-74) snptsarsepye "¢ sop sastqon, p amnyeuynoy sa ft ‘oynonred 
QUIVUIOP UN }Sd aIqQIO eT onbsioT ‘anbuosjenb sidoidde 
Q[Qpoul uN.p sped a] suep ‘7 sJenNUS sIUIy UONe[Ndod 
e] Inod saguruuayep 919 UO "4 sanagid sinayeA sap :1INs 
QUIWUOD JINISUOD 9S JNOIpeid ouleWOp op INa}eUINSA "J 


(pp) "(4 - ") 


666 Leiquiaoep ‘ajanbua,p senbiuyoo, 


“OQUIRUOP UN,P [10 Np sprod-tun snayeunsa | 
suleue inb onbrun uonesigpuod ap jusunsiv ,| suojuasaid 
snou ‘¢°¢ WORDS RT Y ‘OUIeWIOp UN.p [e}10} Np JNoIpsid 
iNoyeUII}Se | SuyeUD INb JNoIpeid yuWINSIe | suosInpoNuI 
snou ‘uoNdes ajUasgid ve] sueq ‘sonbnuapr sed juswayelgues 
JUOS SU jUdI[NSoI Ud INnb oUTeWIOp op siNa}eWINSE soy 
sIeul ‘([*p) sed guuop “447 Hayy inayewnsa,| wedap op 
jurlod suIWI09 Jua\dope xnap sainoy, ‘asepuos op urjd 2] Ans 
QPUOJ OUIRWOP Op INajeUII}sd UN dIINSUOD op JUd}eULIEd 
sojduiis sonbruysa} xnoq ‘sourewiop ap siquiou puei3 un 
Inod suoneunss sap uayIssaogu saygnbua sap uednyd eT] 


aulewop un .nod 
UOHVUISI,| 39 UONIIpsid op JusUINSIe.T pp 


(8661) usuelia, 19 UOUOYST 
op opnj9,[ onbipur., sumu0s ‘Wad snjd juatAap ourewop 
3] onbsioy iesA yUOWIEI[NONIed squias BAD ‘sanbieuw 
snjd jsd oouRleA PR] Op UONUMUIP ay00 ‘snossap-19 
o1199p ‘AUTRWIOp UN,p [e}0} NP UONeUNT}sa | Inod ‘stojaynoL 
“QUIRSUI] B[QPOUW UN B JUSWIIATLIAI SIIVOUI] UOU sTepow UN ,p 
juouajsn{e | Inod souvuea e] op UONNUTUIpP a[qrej ouN nb & 
Au [lt ‘X agua uoNendod vy] ap [e101 a] awiNsd UO | anbsJo] 
anb anuoul UO (1661) NeuUeg 39 YUL 12 (3661) UoURlIoA 
yo usu0 Yo] C4 7) snptso1 sap gues np aijtei ey 
op puodgp soueiiea ey onb soled ‘aysnfe uarq j10s w a[apouw 
aj onb jueyodu jso [I ‘soueLeA eI op ona op julod ng 

“OMCLYIXNE UONLULIOJUL | 
op neoalu oj Jed sgsneo ‘][ neaqe} a] suep ‘sarqeiogidde 
SQq] SJoJJo xne JUSWIDANeIedUIOD soUuRWOdUII .p nad ap juOsS 
SODUSIDJJIP SOD ‘snjd ne asejus0I1nod ap sjutod sanbyanb 
op WeI9 sIe9UI] OAYHO Anayewnsa,| e woddei sed uones 
-olfaue | anb gasasqo yuo sjI ‘ayduts anbystsoy uotoUoJ 
Rl Op I[PWIXeU VOUL[QUIOSIPIA B JUSWa\snfe UN 39 aIIeUIG € 
I[QUURA oUN ‘oTRdSIJ UONLOIJLI9A Op saguUOPp sop JuRYOdUIOS 
onbuidwsa opnjg oun sueq “uOosIeI] ap UONoUoJ ey] 
mera (¢)5 no (Yx"g +++ "x'g) 9 = sonagad singer 
sap juesinpoid ‘JYTO sejgpour sap juswiaysnfe | guruexs 
1U0 (66[) NeuUsg 39 YUL ‘UONeZaIse .p onbuosjenb nesatu 
un e x ap uoneindod x] ap [e10} o] aNTeUUOD JUSS] Guus op 
sed j1JJns Ou [I ‘aITeQUIT SJQPOU Ne JUSWIdIIEIUOD “Y SI] SNO} 
Inod juSUWIa|[aNpPIAIpUI SanuUOD ag JUdATOp "xX sarTeITIXNe 
sIng[ea sat onbsind sgqjlteyap snjd oeyrxne uoNeuLojul 
aun asoddns [I ‘stojaynoy, ‘ayenbua .p saguuop sasnoiquiou 
op inod juowsjsnfe sinajjrou un WuINOJ [I 39 aIST]eOI 
snd $9 d[Q@pOU! VD “aITeJUSUIY]O d][PAIOIUI | SURP JUSWII|qG 
-PLIVAUL JUDANOI) 9s [eIWOUNTNU sNbNysIso] s[apoul 9] Inod 
"¢ soy ‘auteguiy juowaysnle | e JUaWaIIeNUOD ‘alleguI] DFYO 
InayeuNsd,| aonb sovoryja snd jusWIs1gpoul Jsa INd}eWINsSE 
ya0 aonb gnbipur yuo sanbiurdwia sayoioyool sina] ‘({'p) 
SULP SWIWIOD INd}eUINSA,| JNsUOD jUO str *€ saqURI[NSE 
sonagid singjea sop opie, e139 ,()gi‘'g) = gq s0unse 
Inod sourjquiasivia op woddel np sigpuod swyieso] un 
gstjan quo sy] *w <p =1 anod (‘g 7x) dxa "C7 (‘g 7x) dxo 
=(1=")q=(g|"f Jermounfnu anbnsisoy  afapou 
un gisnfe yuo (g66]) UsUefIaA 39 UdUOIYIT ‘so[qissod 
SINI[VA W JULUINSSP 1QI19]UT,p onbu0sgyVo s[qvueA ouN INog 


“QUTV9UT] SVD Ne gIedUIOS 919 B dIIVOUT] UOU Sed J] ‘s]U9D9I 
XNBARI] SUTeIOO sued ‘(["~) OP UOTOUO] Ud ‘alIeaUTT Seo 
9[ SUBP SUIUUOD “INd]BWINSd,| SUOSINI}SUOD SNOU 19 ‘7 3 ¥ SP 
sno inod (g|"x)f= " sanagid sinajea sa] aynsua suopnoyeo 
SnON ‘g ep g ANoIeUMs UN oUUOP Joped0id op UOdSe] 
39D (9661) J91INJ enbydxe v J umu09 *9/,((g|"x)f- *) 
To*{ sgumeo sop ogigpuod owuos ey ostium 
uo :onbneid a1sajens oun jUdINoUIap sast[eIoUues sale9 
soIpuloul say ‘onbruyse} anne oun no PITTO epoyjeur vy 
Jed gisnfe ang jnad w afapowi 9] ‘astesul] UOU sed J] SURG 


ailegul] UOU ajApoy| ¢"h 


(L861) UeurUoyy Jed oJUSIEIJIP UOSe] Op agNo]eo 
geumndo juowonbyo\dwAse uonnjos oun dace aplouloo 
(¢p) ‘Ts’us({ - ‘u) anayoey 9] nod aytey uondsoxe ‘s10;y 
‘nuuos “x "{ ye}0) uN juRWOdWOD sameTIXne so[qeieA 
saline sa] soino) aqojsua "x 19 GQ = “9 1onb sues ‘y ares 
BI SUBP ANON 9S ¥ IS | = HS no Neb ap cow meee caer) 
="x suousid snou 39 ‘y aens ey op y sa 
sno) unod 1 - “f/{ = 72/{ suousid snou ‘ayeurur JoOyAR], 
Op oURLIVA Pk] ITU9}GO,p Ulye ‘sIO] saq “WH “ ‘[ = y Inod 
“ny us ff adeuuol[nueyos,p suoMoeIy sap 1a Y sayens 
sop jueyoduros grynens ofduis o1oyegye aseuUOT[HUeYDE ,p 
ueyd un ‘ajduiexe Jed ‘suolgpisuod ‘aseuuoy[Nueyse .p ueyd 
Np 9911] UONVULIOJUI | 9p oINpoUT yesaap 7x ap UoNRoIJIO9ds 
ey “GRANITT ap so[Ae], op sourwea vy juastutur nb 
xnewndo "9 sap 1aanon suoanod snou ‘aSepuos ap sued 
SUIe1IO9 INog ‘nad uN jUSUTE[Nas sTeU ‘QoURLIvA BT DOUANTJUI 
iD epmcuye a0 Cy 4D Ce fork — ¥ 00 


(Ep) © CX-X)+"h=( gq) x-"4)"0 ees PB ey 


‘olesull OFAOD 


InoyeuINsd,| QUUOP (["p) UONONsUOD ap odioulid 9] 49 


‘gx = "¢ quos sonagud sinajea soy “9/7 x" x"0°{ = *7 no 


. s Ss 
(Zp) doy fe ado yl Gat 1 oy 
ouuop vlad ‘saatidoidde 
soamtsod sajuzjsuos sap quos 79 sei no *a/,(g 1x - *4)"D°% 
Jastumium inod g JoAnoyN op uses TT ‘orleouty 
3]Qpoul np sanauiesed sap uoNeuINsa | Inod juswoyeULIOU 
JISI]INN IS9 SASI[VIIUS S9LILO SOIPUIOW Sap S9poyIeU VT 


AAEQUT] IPO, Zh 


“aueguly UoU 3S9 [I Ionb sues ‘g 7x = (g| */ 
Is oIegUuI] 3S9 s[QpOUl oT “(II) 39 (1) xXIoYd s[qnop 
Np svo 9] suep X op (sesterq UOU sTeUIUTUT SoURTIRA) [eUdo 
InayeuNsd uN ItUa}qo JUSUTWIOD sed jes aU UG “a]epoul 
uN INS 9gpuoJ INa}eUISS,p Noy] ne sepow sed gysIsse 
Inajeullysa,p ajied uo “uonbgsuod eg “UOU NO «IeIA» }I0S 
Ww a[Qpoul a] anb ‘asepuos op uryd np iso mnb 90 snod gsieiq 
uou JUsWenbnoldurAse InayeuNse un jsd,c- ‘sonagid snayea 
Sap INS spUO] as UOTONSUOD e] onb eI 9] JOUSI[NOS op Ulye 


OA) op nal] ne GAad Ipur,| suosipn snon (O_aAD) 
QSI[eIQUES UOISSOIZ9I Op INd}eWINsd,.| Op wse.s I] 


SUO!EWISS Sa| INOd SesleIIIXNe SUOIFEWOJU! SAP & SINODAI 97] :;eEPUeS Je ORAS\Sy prac 


(1b) C6 - 14)"0 ee. 1 rey 
SUOAY SNOU “SNpIsel sop 
auIWOS BT Inod LH ep snayeunse [39 *¢ quesljNN ug “Q 3 ¥ 
Sq sno} mnod nuuos ysa *x onb sored atqissod isa vjag 
‘2. 2x anbeyo inod ‘(g|"x)f= "¢ onagad nayea aun oynsue 
SUOTNITVD SNON ‘J op INaIeUIN]sa sUIIOD g SUOUAaIGO snou 
‘{s3y¥ ito) uoT[HUeYdI .p soguuop sop ope | V 
‘Sajapoul 
sonoweied ap NUUODUT 1Nd}09A UN Ysa J 19 JasTOQId UONOUOJ 
aun Iso (G|)f ‘uw a[Qpoul np sIped 9] suep saduRJedsea sap 
mayessdo J 3s“ no “(g|"x) f= (g ‘*x|"0"q aonb uodsey op 
d[Qpour un juvysnle ud oMel]IXNe UOTWOJUI | op sonua}qo 
juos 7" sanagid sinafea sa] ‘s 3 y anbeyo snod a8epuos 
ap aseq Be] op aagiar ‘x aonb suosoddns snoyn *y yun J snod 
mngjea vs Tx WOS ‘[ Sf UOISUSUIP op oITeI[IXNe 1N3199A 9] 
‘x 0S ‘(t1) odei9,] & aUeLIOdUIT jS9 SET IXNe UONPULIOJUI TJ 
(LS61) Ayuny sed ya (9¢61) fey sed sorapisuoo sinaq 
-PUII}SO Sd] JUOS sazTIqissod sane. ‘a[eUWTUTW sOURTIvA 
op gsteIq uOU xIOYd UNONe 9}SIx9,U [J ‘[euUINdO sed jso,uU 
jeuuonuaauod x1oyo a9 *("n - "€) "0" + "17% = 4 suuop 
nb ‘LH ap Anayeurnsa | 3S9 (1) adej9 | e janyqey xloyd YT 


“9uyiqissod aayne oun 

NO JOURTQUIDSIBIA SP WINWIXeW ‘ITD ‘(sastes9ues) 

Soued soipuloul sajeapoul 90 Jaysnfe inod sgsiign 

anbruyos} ey (q) 39 ‘*1l 39 *€ anus UONeal e] JURSsITqeId 

J[Qpoul 9] (ke) :s}aJOA xnop aodwi0d x1oyo 99 °"« op 
quaysoiddes as inb ™n sinajea sop JOANON SUOASP SNON (It) 

an _ Ome 

SNpIsoI sop oulwos ey Inod InayewNsa un IIstoYyo 
SUOASP Snou ‘alloyeg[e UOU suTWIOD "M jURIEpIsSUOD (1) 


JUBUDIUTeUL JUdSOdUIT 
xIOyo Xnop “uoWaTTenjdsou0D ‘uOeUINSS dUN dyISSad9U 
("nd - %€)?% anad snd snptsai sap oumwos vy 39 ‘JueUTOp 
sua) af sa "7% onuuoo owos ef no ‘(n-"4)"% 
+"1{= X sioje suoae snoy ‘asepuos ap ued 2 Ins 
agpuoy souereA aad snjd oun juswoduio0s 19 “4 sinayeA soy 
anb suusXou us sijad snjd quos “x - 74 snpises say anbstnd 
“i” @ 0 ap ¥ sulUN | op «aUIO | JURSe[dap» Ud INd}eUINSO ,| 
SIIN.ISUOD Op JULIUS} S9J} SIOTL 4S9 [J ‘WoWOAneUTxoIdde .nb 
}S9,U 99 Is oUIgUI ‘UONe[Ndod ve] ap sa}UN sa] $9jno} Inod 
™€ ap oyooiddes as nb “1 sinayea oun JaANoN assind uo,] 
anb suosoddns sreur ‘nuuoo sed jso,u " ‘saguuo;jnueyse 
uoU S9IIUN sap qso Inb 99 nog ‘sagatosqo juos {s3y 274} 
saguuop soy *u/] = "py a8euUOT[NULYD9,p sprod 9] y sIIUN,| 
® JueuUOp ‘s UOT[HUeYDS UN aI UQ “"4"% =X ‘orETUO 
uonendod x] ap [e10} a] 9sIA UONPUINSO | onb suosoddng 


a1gUs UO}ne[ndod ey] nod 
UOeWIYSd,| Jo UOIIpsid ap yusWINSIe To 'p 


ATAGOW Ad LNAWALSALV UVd 
SHANALAO SHNAAAd SHNATVA 
4d NOILLONOW NA NOILONULSNOOD “bp 


eve 


"2 uONOaS 
BI & sepsJoge jso uoNsanb aneD gx snod ourerixne 
uoneuojur,, ap snjd ua “’x suep ya '’x suep agiod 
-JOOUI d][9-IS9 SOUTRLIOP Sap dI]Ie1 BI JUSUTIOD “ouIeI] 
-IXNV UONLULIOJUL,| Bp JUSUIE[P aINe UN Jsa (QUTeWOp 
J] suep soyun.p oiquiou) ouleWwOp np aie) eq ‘¢ 


‘L UOINDAS PT B Dap1OgR Isa UONsaNnb ana_d {aaa snjd 
nesatu ap juowednois un,nb ayned snjd yuowa}o1Ys 
QOURLIVA OUN BIOUUOP INILIQJUI NVIATU op JUsUIEdNOI3 
un sajjanbsa] suep SUOT}IPUOD Sap [I-}-dISTXY “BOURLIVA 
ey Inod souryodun,| op & UOTRWOJUI,p jUoWadnoI3 
np neaatu aj enb anuow s[dwiexa J ‘a1anue uonejndod 
ey yso.o “x smod yo ‘uoneuojul,p juawednols 9] 
yso ourewiop 9] ‘!? & INOg ‘NuUOd js9 xX [eI0} 9] eT[anbey 
inod uonejndod-snos ve] awwi0s uONeUOJUI,p JUS 
-adno1s 3] SUOSSIUIJap SNOU ‘QUUOP oUTeWOp UN INog ‘7 


Q19¢ 
‘p SUOTIOS XN SagpJOge UOS suOTsaNb saD {suonENits 
SOUIvIION SUep sanbyUapI sIndjeUINsd sop JUoUTeIUO 
sodiouiid xnap sao aonb 90-1sq {S[eUUOISUSUIIpH| NU 
SOIIVI[IXNY SINIJOVA Sap [eIQU9S IPed oT sURp ‘UOT 
-onijsuod ap sadiourd xnap sa] yuos spond “adwexa | 
anbipul,| SWUWOD “USUIWSIaJJIP sa jUsOdWIOD as 
S] 19 ‘UOTONNSUOD Ing] Jed ap sJUdIEJJIP JOS S[I IO “49 
X BUS SATIISOd UOTR[SOD 9UN Pp JOIdI¥aUgq JUIIeIAOP 
Xnap Soj ‘ISUTY °X dIIeI[Ixne s[quleA OWQUI PB] JUSSITNN 
gfduioxe , op “x 19 '’x onel op sinayeunsa soy *| 


:X [QUUOISUSUIPH[NUW SIIeI[IXNe INdJO9A UN Pp [eIQUaS Sed 
3] Inod ‘stor suouruexd Ud snou ‘asodxa juasaid a] sueq 
“suotjsonb sinarsnyd JUsAg [NOS | NeI][qR} Np s}ey[Nsol SIT 


ATM WNAXA.T UVd SAMAATINOS SNOILSANO  *€ 


‘QOULIIRA P| Op 1Sa INb 90 Anod sayqetoaidde saoual9jjIp 
SOP SUILIUD SITLTIXNE UONLULIOJUL | OP NVIAIU J] ‘aUOD IeVg 
“sourwoduit kee JUSUWIDATIL[AI JS VJ9POW! Np Xx1oyo Z| “Ip 
aaa qv, +/y Is SUIQUI SoIUEIJJIP San sed yUOolas ou 
sonar “Pay St 8G p29 = eT 1K8 = 1s (TZ) tod 
anb uonewrxoidde .p aipio augur np) safe3a quos (°? DA 
Eg oey,\ UNE TP X 9p Seog] Sup ouTeLLIOp 2| nod ajounsip 
ajued oun yo 7’ ap seo a] suep ozgnua uoNrndod ey 
nod sunumuos ajued oun :juasef-snos uoIssai89l op 2[Qpoul 
np sages soucsayyip ey '?x anod aswmwos uolNnueyosg,| 
ap ourewop oned ey ins qusulg[nes sed uou Jo ayduoo ne s 
uo][WUeYDE | Ins Oe, asx oa > = Y sued ey ap uon 
SHES pao re ie Sy een 1S9 auTIqrssod one 
sug *’x ‘ourewop np neearu te OIeI[IXNe UONLULIOJUL | 
ddAR IINIWSUOD Jnoed uO, onb asepuos ap urd a] UOTaS 
JURIBIOAUOD INd}BUINSE [Nas a] sed yso.u |” onb s9}0u y 
‘a1atjue uoneindod ey Sida ouTeWOp Np 
sov[dap as nuUOd oIIel]Ixne [210] Np neaatu 9] aonb ainsauw & 
JUSWAPIdel SNUTWIP I9[PLION JUSWII}IOJ ITET[IXN V[qQeIeA 


666 | eiquisoep ‘ajanbua,.p senbiuyos | 


PR] & SINODAI NP IsvjURAL J ‘OUIeWIOP Ne Indtadns nesatu 
UN & OIeI[Ixne [e}0} uN aOduw09 Inb Injao ke ajqeiajaid ys9 
SUIVWOP NP NVIAIU Ne IIeI[IXNe [e}0} J] JUeLOdWIOD INo}eUL 
-89,] aonb a1a38ns a[dwioxa, J ‘ourewiop a] Inod one ap 
INgeUWINSd UN JanjVSuod Anod xnvj}0} $90 op one | NO uN] 
Jasijqn suoanod snon ‘airerpsuajut uoneyndod-snos anne 
93NO} NO s1QHUS UOHR[Ndod ve] ‘oureWOp 9s Inod — nedatu 
jenb oywoduit.u eB omelyIxne [e}0] uN Jafnoyeo ap afqissod 
Iso [I ‘Q 3y onbeyo snod *x ayjIe1 eT ap aantsod oinsow 
dUN WUINOJ ISepuUosS ap seq PI JUOp ajJgnbus ouN sue 
“QUIBWIOP Np NRdAIU Ne UOTeWISa 
aun Inod sovoIjJo san sed jso,U v[a0 Joa ‘uoNeindod vy] ap 
NedATU Ne dierpIxne uoeUOsuT oun ze jodde yey ©’ x nae 
-1N89 J ‘a[qelea 0199 ap iefns ne uoeUOJUT,| Op NeoArU 
J] SSeIURARP JO ‘A9[9LOD JUOWOWOJ sIIeT[IXNe o[QRLUIeA 
oUN B SINODAI J] SUTOW 3Sd a}dUI09 INnb 90 sieU 4URADDEp 
antesed yned “x ap yuawiapues onetd aq “xtoyo Ineyprow 
un sajuasgidai jnad ‘*? A AUIP-R-1S9,9 ‘sed yey oy ou inb 
BSS UN ‘99191109 JUSUSUOJ SHANI Se oun e 
jodde yey ¢ ys IS OUIQUI ‘Juonbgsuod Jeg “| >7*a90/ 7*a0 onb 
piI< My 71 x = yw onbsioy ‘a[duroxa sed ‘asnpoid as ynad 
ejag “*’x aonb apuei3 snjd souelea oun s1aZ0dwWI09 ynod 
Px anb ({°Z) op aed e 10)e]SUOD ap gIIORJ ISO [I ‘| NesTQeI 
np sajjeo aonb sonne suonrpuos sop suep ‘ayo uq 


ooO;oT OOS OS? LOI OO'T OOT OOT OOT OT 
Cran OS eS SINT OSOY OSS Coe (rt ‘0 
GU OT ee XO O€rI OFL OBE E9'T €0 
COM yO Ie SO: COM OV'8l O16 O09F OTE 10 
$60 060 080 OL0O S60 060 080 OL‘ Ca 
Pa Pi 
PAPA PA; PA 


SQOULLIVA Sop ONRY 
ae np saneryjer 
ay[ie) eT sd AV/ Ne a PURRGD 3] suep « ya x aUS 


UONK]IIO9 PT Lee er Tat (" "DA =, “USSsVa 
un inod *?z yo x‘! jueredwios saoueeA sop soney 


[ neaqey, 


‘snjd no 6‘Q ap 1sa uONR[a109 
ey anbsioy *’x anb sovoryya snjd yuowsr19pow onb 
yso.u “x “(¢‘Q = ?g) uoneindod x] ap sniow ey yUIONe 
SUIeWIOP Np gI[Ie1 eI Is sugUI ste ‘(¢‘9 19 ['0 = "¢q) 
sjjed snjd sourewop sep anod a qenbiewial JUSWI9IIT] 
-noried sa ouguiougud a9 ° any LH 9p snoyeurnso d a 
g]J20 onb ayned snd sured ev soueueA oun syodu09 ¢ a ¥6 


‘oumnpoid 
9s jnad vja9 ayjanbr] e assajIA PI 1S9,9 ‘oIpusidins ynad 
inbag °'?x anb aoroyyja surow jos “’x anb yueussdins 
sed qs9,U [J ‘o1UeWSne UONr[aI09 eT onb 39 onuTWTIp 
aurewop np are} ey anbssoj nouns ““¢ ap ajjao anb 
aynad snjd uowiajqerogidde soueurea oun oyoduios |” 5 ame 

‘yins inb 90 anbipur | neayqei 9] ‘s‘Q sg 
a[le} op sourewop sey Inog ‘uoneindod ve] suep sumu09 


QUIVULOP 2] SURP dIQe{qUIAas UONTIedgI suN aI0dWI0D x anb 


}2 QUIRWOP Z| SULP d}ITIGeIIVA OUIQUI PI iieises x 30 4 
anb suosoddns snou ‘sous ug * | = ax 2 = a 1x9 anb 
19 | = 2x/"9x =? anb sasoddns vg opie "4 ap sinayea 
SJUDIDJJIP Inod saouvleA sto) soy atedwioo | nesqei aT 
‘IoIRdW0d So] op aplovj Is sed js9.u [I ‘saneuiesed sinaisnjd 
op juapuedap ‘¢‘z‘{ =f? x), soourliea say onbsing 

“ “SB SIOJ] S98] SURP SagsITNN 
319 wo [=/N/(1-°N) 0 ’d =N/"N 3(T-N/(T-°N) 
suonewrxoidde sa] ‘a}9ex9 LH op doUvIIeA PI Op a[Nodep 
*?r7 inod uorssaidxa J ‘sastesury anbysneys ve] op sourueA 
L] OP aIp-B-3S9,9 “JO[AR], op souLLIeA P| ap justnosep “7 19 
IP ry SOULIa] So] ‘a[dutaxe sed ‘6 19 9 samideyo (766 [) UENO, 
2 uOssuaMS ‘Tepwes op Spe, I @ sanuaigo ang duoAnod 
suotssaidxa sag 2x g= qq 39 %x/"9x=?w no 


Anda 


Ana) {[0'a9)+"W7- a+ the? yu? wl adc- T= ?H 


=) aon 


PCS Ie l= 

S1O|@ SUOAR SNON “JURPUOdSaLIOD UONRIPLIOD ap JWAIOIJa09 
gy 2*g'2*5/’2%o Pa qos ‘ourewop Bp ulas ne x ap 
é & [2p UORELTEA ap SIUSI911J209, a my fll Cea eka 
ny, "aK "x5 no ag //2* Py ve SEA 
a sa] JaloualyyjIp ap youtred fig son Ines 9] 389 "Hy 19 
aUIeUOp 9] Suep A ap aoURLIA B] ISO (| - Pu)/ 66 - Deh 
= iS ‘QuIeUIOp Np sANLel aIIIeI eT Iso A/?’N = ’d NO 


(1'2) Pay SANIT - WN = (PDA 


e said 

nad ve puodsa0s ‘¢ ‘7 ‘| = f inod Pr Op SOULIIVA BT 
y ‘gasitin sed 
1SO,U SIIeIIxne UONeUOJUI | anbsind sovotJo SUIOW JUDO] 
-PULIOU $9 [I ‘adsepuos ap ueyd np 3so tnb 90 nod gsterq sed 
1S9,U [I,S OW me LH) uosdwoy]-zAloH op inoyewnsa | 
isolees 4 “big (es eee a ap eI[20 anb ayed jnJd jos soueLRA es 
onb 20 & jUsWISATIINVUI sugpucne snou snow: Seri? snjd 
suoneuLojul sap e jadde yey '”’x onbsing **’x nod stnbar 
uoneindod vy ap neaaru ne [e10} s] JUOANOS suOssteUUOD 
snou stew ‘!” & 9p jwoulass![qeig | Inod aqruodsip sinofno} 
sed 3S0,U SUIVUIOP NP NRdAIU Ne [e}0] FT ‘SoATENSTUTWIpE 
saguuop op sdInos oun a] dwiexa Jed ‘sinod ua ajgnbus | anb 
ane VdINOS 9UN ,p d9IT} 1S9 aUeI]IxNe UOeULOJUI | onbsIo] 
ajduioo ap ously Ud aud UOT}OUNSIP 91390 ‘JUdUIA}QINUOD 
peas PR] Op Neaalu ne y oleryixne 1501 ne jadde yey 
ne anb spur} ‘ourewop np neaaru ne ’y omerixne [e10) 
ne jadde y1ey IP InoyeuINse,] “esepuos op ueyd 9] uojas 
JU93I9AUOS sno} JUOS SUS SlOmisomg oe fA Xk 
= Oy yo Px ree T= ei Ay AT x ee LIN 


= 4° (un) = “x Px" (un) = “Px POT UN) ="?4 20 
a 2p 
Par y =a (Xx) = 4 
Py Py =*P4 (Hy /Px) = Lyi 


SUOIFEWISE Sa} INOd SauIeI|IXNe SUOIEUUOJU! SAP & SINODAI 97] :|EPULS Ja OBAB]SJ ATA 


“epeUurD “OLO WIM (OuIUO) ‘eMeNg ‘epeuLD anbysneig ‘[epures “q-"D 19 OvAaIS| WIOIIA | 


:asepuos 
ap ueyd 9] Ans SppUO} SNOSSap-19 SINICUINSA SION $2] qudsa J 
Be suoae snoyn 74° (=? sJOWINSE Ine} snou [I Jenboy 
inod ’77 1Q19)UI,p oUTeUIOp UN sUOJEpIsuOD SNON “7 3 ¥ 
sno} inod ujyy="0 anb aos ap ‘Q ap snied e uv ayrei op s 
uo][HueYyse un Jam Inod (YSsyA) Bla sues s[dUIIS OI10} 
-e9[e OSVUUO][HURYDE UN sUOSTTNN snoN *€ 1QIDIUT,p BTqQuITeA 
PR] & QANISOd UOSe] Ap B9T9109 19 SATISOd JUDUUDIOLNS X BIJOU 
-UOISUSUIPIUN dITeITIXNe s]qeueA oun suosoddns ‘surewop 
op [e}0} uN nod InayeuNsa uN ,p souLLIeA PI ap sofqeiogidde 
SIOUDIOJJIP Sop JouIeIUS JUdANAd SIIeTIXNe UONPWIOJUI ,p 
XNVOAIU SJUDIOJJIP JUSWWUOS oUOW yINs INnb afdurexa ’T 


AUALLVI Na 
FAUNA. LNVAUAS AIdWNAXA “7 


‘PQ aurewop np sagjas nb s uoyNUeYoE | op ated ey] 
189.) QS NG. x Fahd 10 OK = 1/0 = Py 
d1L109 s1oye suoanod snoyn °’7 99 IS Q= "x 19 ‘’ 34 IS 
ty = x suoav snou ‘allel[ixne a[qeleA oun 4s9 X Is ‘SUIQUI 
oq "nay ts o= "410 ‘ay is = 4 aus atuysp “A 
aurewiop ne sidoud a[qeuea P| JastyNN,p spouruod ysa [<Q 
‘QUIvUUOP UN Joe) ap jusowW ny 747% = 4 uoNe[ndod 
V] ap [e101 a] JoUINSa sUO[NOA snoN “¥ 9IUN,| Inod 
ingfea vs ysa 7 39 “€ agIOU IS9 IQIDIUI,p sJquuea eT “Q3°7A 
oeniqie uonetndod-snos oun,p 1se,s nod [J "y919}UI,.p 


surewiop un 7 10g ‘uoweansedsar *u/] = "p19 “uw sg}0U 
JUOS ¥ SUN | op adevUuUO][HULYDE ,p splod 9] 39 UOTSNOUI .p 
guiqeqoid ey “72 ap 91 Ise s aystfiqeqosd uojjHueYog 
un ‘egpuos uonejndod ey “{A"‘¥" “T}=Q Mog 
“SOJOOIIP SOTRUOISOI 
SUOTRUIT]SA Sap UOISIOgId BT JoZOIfgUIe Inod soadrerixne 
soquuop Sap JasI[4N WeJIAop UO ‘afqissod np sinsouw eT sued 
‘gouanbgsuod Ud SNdUOd aI]Q JUDIVIADP ISeUUOT[NULYSE ,p 
suv[d soy 39 ‘ayqeuaAuod UOIsIO9Id oUN JURIJJO SoTPUOISII 
SUOIJVWUINSS sap Joredaid B ITAIOS JUDIRIAOP SUOT[HURYIE 
Sg] ‘etqissod onb juvjny ‘asepuos op uryd 9] Ins sopuoj sou 
-1]S9 (UONRLIVA OP SJUDIOIJJ9O9) *A*D SAP JUASTTNN si 39 ‘QUUOp 
aist[iqeqoid asepuos op ueyd un,p uoToUoj Ud sain sgyede1 
SUO][NULYIE ,.P 9}X9}U0D J] SUBP SaguUOPp Se] JUd}QIdIA\UI ST] 
‘asepuos op uryd J Ins ssgpuoj sayuRpuOodsa0d saoUdIOJUT 
S93] 12 SINd}eUUT}sd sap Joredgid eB sanqiqey jUOs aygnbua .p 
saguuop op sinajonpoid sop ywednyjd ey ‘sonbieural yrej 
U0 | (P661) [IULJ 19 OUIQUIeDH ‘YSUIS dUTOD ‘a[qissod 
np oinsow ey] suep osepuos op urd ne jueyodde as 
sodrioutid sap ins jUapuoj as uoTstogid v] Op 9xUUOD dINSOU 
PR] Jo SUOTJVUUN|SO Sa] ‘anbnstyeIs eT op xneainqg sop yednyid 
R] sued ‘so[eyUoWIaUJOANOS saygnbue sap yednyid ey nod 
sonbnsiejs op uoneredgid ey op ajurwodui souesixe oun 
JUOS SOJUDIIJJIP SOT[1e] op Sourewop Jed suolewNss say] 


NOILONGOUINI ‘T 


‘sprod-iun inoayeuise ‘uonoIpeid ap InayeuINse ‘UONeULIOJUT,p sjusWOdnoIs ‘orrerIxne 
UONCULIOJUL | OP NVIATU ‘oIIeT[IXNe UOTeULIOJUI ‘asepuoOs ap ue] 9] Ins sgpuo} OUTeWOp Jed UONeUINS| :SATO SLOW 


‘gignus uone{ndod e] e surewop np 


sovidap as UONeULIOJUI ,p JUdWIDdNOIS a] aNb UOTAS JUDLUDUOJOUOU DJUSUIBNe OUTUIOP ap [e}0} NP soUBLRA P| ‘sadUe}SUODIIO 
souteyieo suep ‘onb jUaNUOUISp siInojne saT ‘s2oevoyJo suoneulNsa sop Joredgid yndA uO] IS JQIOIUI.p SoUTeWOp sop 
a[qissod snyd a] Jayooidde as yuatesAap 19-xndDd ‘snuUOD soITeT]Ixne xnvjo} & suONe[ndod-snos sop suIWIOD UOTRULIOJUI.p 
sjJusWodnoJs say JUDSSIUTJOP SINdINe Sa] “SONUUOD JUOS SoITeI]IXNe SUOTeULIOJUI So] janbay 1nod (anbuogyjenb ssretpauLi9jut 
nesalu ‘uoNeindod ve] op nesaAlu ‘dUIeEWIOP NP NdAIU) NLIAIU I] }SO DOULLIVA BS Op [eIONIO yOadse uN ‘Jor[NoNIed us 
‘sprod-1un Inayeuisa | op so Inb 99 nog ‘oureWOp Jed suoeUII}sa sap UOISIOgId eT] DUTWIO}Op splod ap sUIa}sA$ 9] J99IO B 
JURAIOS SIIeI[IXNe UONeULIOJUL TJ ‘anbuoosjenb ourewiop sed asepuos ap urd 9] Ins sagpuoj sayuepuodsa09 suoeUINsd sa] 39 
sayjanjouod suoneuiyse sop Joredaid ap jowod inb ‘epeued onbysnyeis ap ({Os) uoneuinsa .p ast[eiguas oula}sAS np ope 
9 SUP I9STIIIN 1S9 O][_ JOJ9IUL,P So[QeUeA SasnaIquiou sa] Inod sptod ap saulaisAs sjUsJJJIp opNoyed uo | onb sed asoddns 
du aT[2 ,nbsind a]jayse opuess ve sanbnsneys sp uonesedaid ey inod sja1oUu0d saseUeAR Sop OIJJO dId9}eIIS SIQIUIAP 90D 
"y 9U1UN | JUBUD]UOD soUTeWIOp Jed sUONRUINSS Sa] S9]NO} op [NoTed a] suep *€ sinayea sa] soyno} B sprod owgUI 9] anbijdde 
inb ‘sprod-tun inayewinsa un ysa swarxnap x] ‘sagasasqout *€ sap suonoipeid sauuog ap 19 ajapoul op juowa)snfe ,p odiouud 
UN ,P UONOUOJ Ud 9NINIsUOD ‘aITeQUT| UONOIPeid op INdJeWINSd,| 1S9 JoTWIOId oT "19I9IUT,P sTGeUIeA eT op "A sagarasqo sINITeA 
Sap Sollegul] Sogigpuod SOWIWOS Sop SWIWOD SIUTJP JUOS SINdJeUINSd XNap SdD “]Ik19P Ud XNap JUSALIOYp ud Jo aSEpUOS op 
ued 9] Ins sapuoj sINdJeUIN}sa pp sodA} STON] JUUIIO sINayNe sa] ‘esepuos ap ued 9] Ins segpuoj sourewop Jed suoneunsa,p 
uonesedaid ey] inod sarelpixne suoNeulojul sap B sinodal np sjueyodur sjoadse sureyiao oururexa gsodxa juasgid aT 


asad 


VIVGNUYVS “H-"0 ? OVAALSH W YOLOIA 


asepuos ap uvyd 3] Ans sagpuo] sauIeWMOp Jed suoneUIse 
SI] ANOd soiel[IXne SUOTBULIOJUI Sap B SIN0III 9’T 


lve 


epeuey enbijsneis 
0S2-L pe “dd ‘Z Qu ‘Sz OA 
6661 aquiscep ‘ajanbuse,p senbiuyos | 


= 
ud aka} potent a 
ar 6.4 ory a. Se wie 
Of, Yon peaee IGA we Be sireoMo 
re a0 ae a 
ty he tt toy i, ee ae ee ee ee 
Pi, paelares uae anne ee 
5 Rad RA ® pal ee oo a 
hl ~atevthinigeok -—) lL ee ee \ ’ 12 
Ape FER ge Qeinty Are «Yee Se ee 2 ee 
ee i 


. dy Wee ina Ces (hey _ 
NARA SRDS NEA Aiipareids Cin adeis ons nena fairer 
‘i PTA yi" | pw ber tid Pee SY ee 7) 4 
; 2 ie a ee ol ae oh aay ~ 

p yee 1 


i fo geen ae ey al oF ee 7 of tw ' ‘ ‘ th { ‘Go ap 
| ~_ M Fase aida as ; awe baad aa dues 

Welw br Hie OF abil B66! : ; 
ps ‘ Pantin ape) i is c i ’ 0 af a 7). 


mbit i 


f ’ Koy a v Tha Leones, icine rie 
ad : ' 
. erie As : sont erie 
hace Paplifee wiih e il 
rat Slnceimredcn ‘ re ICE, ak CoN . y ‘ 
Sl ie ion A SLUR WARE A> Ft KF RY ASS i *? 


ah iG pict wavs nie wien = 
ecm ge age Te (Yu Twi ois Gi ‘ wrens Oh Oren ys ( wih - 
Weer Ce Gee ye pian oy TY). ov . 
bai halle tis 1) oad ' REE VOR. ey Her! ii ry 


Topp vairy < : mALRAe TR U Warhe f 


ers ! as Amt 4 Mc , y iEeWicey rere DA heru ; ' . — 
£ > fs eK "' he YT oP va) wise nhl’ WO 


cae a7 0 eet sd ema Apa ote ee in mh yeas ats) A) 
. is ' T 


‘ We qe oar ow) . 
yp se ae; Ta OeNs Mus reas os ten’ Fh vepcuie 

coe aa tien eg CPi» yy wor “5 4 . me ¥ 7 
phir rut wi oe ; Pha tg ot 
PSA BI TEe a, ?. 8 
N Caypeaniave G ( oe opi! a\ 


» a aE . aul a p ot .? ’ » i yy 
ie Al Ke ‘ tit) th. re. ei ~ 5 ake y' Taq! lof 
is PRE ( - 
Ta ; is iMag 2 3 
7 deh. “Imarl Ve Any Want. ar 


So wapaiy Be t.gre fe Oot ae Cea 90 Cw 
Rate pre Rar LN’. Patty spanned ete earl A Oip2= jp .an - 
sgurouiete gia MPS on 
Veta | Are 
URE GH O66 YE. 118. Basie tet 
ee ee Te ee Le 
Sas ae lv et te 
codeine Tee — 0 a is ——— pon hs 
p - " ear? aren yf eM Mr! est Aad Jietsos 
en ae oh rol) her) were pps pom own, 


Se a eee eo 
apa ae 


WICGEESC 

‘SL ‘q saliasg ‘Kja1209 Jpousiymis jokoy ay fo JoUuAnor ‘dZIS 

0} yeuotsodoid Ajyiqegoid yA eyeNS ULYIM WOIJ JUDUIIOe [dor 
ynoyWM UoHsIPg  ‘(€C6I) ‘Wid AGNNUYD 1° “dA ‘SALVA 

"OS-ZS ‘BI ‘SousDIg joAnIjnoUsy 

fo Mai0g upipuy ayy fo Jouanor ‘santyiqeqoid SutArea YIM 
Suljdures usyM souRLIeA JY} JO aeUIT}SA Oy] UG _“(€S61) Y'V ‘NAS 

‘OCL-9FI ‘TI 

‘sousyn¢ fo }Dunor uMiapuIpuDos “Sutdures AQAINS Ul S1OJeUISS 
JO WO} ONOUISOD “(P861) "TY “LHOTYM 39 “AD “TVGNUYS 

‘OOET-6871 “16 “UONDIDOSSY JDIUSIIDIS 

updldauy ayl fo jousnog “Burdures Aytyiqeqoid yenboun ut 
SoURLIBA o[CUIIS YIM sIOJUINSS J2IOYJA (9661) “A~—O “TVGNUVS 

"LEE-LLE ‘LS ‘DylJawolg ‘s[OPOU! UOISsaIBOI IedUI] UIe}IIO 
Jopun Aroay) surjdues uoneindod ay1uy ug (OL61) WY “TIVAOU 

‘6VS-OPS ‘PO ‘UOIIDIIOSSY ]DINSDIS 

updiuawuy ay fo JouAnor “s\tun OM} JO Surdures Ayypiqeqoid 

Jenboun ut siojyeulsd soueLIeA pue sIOJUINSS JO sariI[Iqeis 
oui Jo Apnys jeoutdwa uy (6961) “Td ‘SSHTAVA “NN ‘OVY 

‘9S- Lp UOISSNISIP DOA Yp-€Z “09 “A SALVE “Ka190g JvoUSUDIS 

jpdoy ayl fo Joudnor ‘s[apout [aao[HTNUL ut santpiqeqoid uoNseyas 

fenboun Joy Sunysie (8661) f ‘HSVAVA 9 “H ‘NIALSATOO 
“Cd ‘“SHWTIOH “FO “YANNINS “d ‘NNVWudassdddd 

‘96-68 “LL ‘UONDIIOSSY [DINSIDIS 

upIldawUy ay] fO JouAnor ‘japour uoNe[ndodiodns uolssoiso1 
oy) Jopun usisap Aeaing (7861) WM ‘MATIN 1 “LO ‘IIVSI 

"C$89-€99 ‘Lp ‘UOIIDIIOSSY JVINSUDIG UDIIMAUY AY] 

fo JOUANOL ‘ISIQATUN d}IUL] B WOIJ UDUDOe] dad NOY Sul[dwes 
Jo uoneziyesoues y (7661) ‘fd ‘NOSdINOHL ?9 “Dd ‘ZLIAYOH 

"8LC-697 

‘LI ‘q soulas ‘Kja190¢ Joousynis jokoy ayy fo jousnor ‘suoyetndod 
auuy Wor Sulfdures yo Aosy) poytun y “(CS61) ‘d’A “AGINVGOO 

ZEI-LIL “LE ‘D Sug ‘Ayyuns 
‘AaAins adures 10} stsAyeue uolssaisay “(SL61) WM ‘MATIN 

‘9G-[p INS UOISSNOSIP 99Av [Z-¢ 

‘09 ‘gq SOLIag ‘Ja1009 JoosuHjs jokoy ay) fo Joudnor “surjdues 
Ayyiqeqoid ut sjapouw isnqoy (8661) “AM “LLANNAd 1° “dC ‘HLYIA 

‘T8E-OLE “LB “UONDIIOSSY 

JDIUSYDIS ubIUaUy aYyl fo JoUAnor “Suljdwies AdAIns Ul 
S1OJUIT}Sa UONBIGYeD (7661) “A-D “TVWANUYS 19 “O-f ‘ATTIAAG 

‘TE-€ ‘TI ‘sousupis poryff[oE fo jouanor “sKaains yusurystqeisa 
asodindnynur 10J SuNYystom-ased Isngoy (9661) “TY ‘SYAATNVHO 

‘0C9-S19 

‘¢Q ‘pyljawmoig ‘suoyeindod ayuly Jo} UOeWNSd UOISSdISII 

POZI[LIDUIS PUL UONLUINSS IOUdIOJJIP POZI[e19UIS UO S}[NSOI SUIOS 
(9L61) ‘Hf ‘NVAWLAYM 1 “d-D “TIVAONUYS “W-D “TASSVO 

‘CI ‘BeLOA 

-losulids SYIOX MIN SIUSIDIG Ul SAJON IANJIIT ‘SA1J1J1GDGOA 
jonbauy yi Surduvg (861) W‘AINVH “AU YAMA 


6€¢ 


"Le-SE ‘LO ‘anbysins ap ajpuoypusajuyl anaay 
‘Sul[dwies poouryeq poynens “sa Wopuel poyneng {ooudrojUl 
peseq-uonoipaid 10 paseg-usisoq (6661) “MYA “AMA 


"909-685 “ASTI HIOK MON “(NOD “S'd 19 9SP2T[0D ‘[W 
‘uosuensiuyD “y ‘eddeuuryD ‘Ng ‘Jopurg “yd ‘X0D 'D'€ “spq) 
‘spoylayp Kaaing ssauisng suep Q¢ onideyd ‘adudJaJUL poseq 
-[Opoul puke paseq-usIsop SuluIqUIOD ($661) “MUM “YAMAYNG 

“SI6-116 “PL “YONDIIOSSY 

Jooysyvis upoiuauy ayy fo Jousnor ‘SKaAINS a]eOS BIE] 
JOJ sudIsop a[dures Isnqos Jo ssejD VY “(6L61) ‘MUM YAMANT 

“LOOI-SP9OT C9 ‘UONDIIOSSY [DINSHDIS 

updluauy ayl fo Jousnor “(pf 10 ¢ = u¥) Surdues Ajtyiqeqoid 

jenboun ul sioyeuisa sourweA puke sIOyeUINsd JO sontyiqeis 
ay) Jo Apmis yeourduia uy “(OL61) M'N'f ‘OVE 19 “Td ‘SSATAVE 


HIHd VaSDOITELa 


‘uonyejuasaid e] anb tsure nuajyuod 9] 
JUDULI|GeISPISUOD IOIOI[SWUe ,pP sTULIAd qUO tu INb sipuojoidde 
SOIIPJUSUIWUOD sap ‘afoe.] op uoTejUsseid osotueid ve] 
Op SIO] ‘WJ JUO SINdJVUILULXS XNap 39 JULOl[pe INa}Oepal UA) 
‘yoloid 9] JULINP SJUDWIDSVINODUD SIN] AIP 19 S[IaSUOD SINI] 
ap Jopulg "V'd 19 NOY “S'd ‘WIN 19 USTAM “HV Anessojoid 
9] onb sure ‘owayqgoid 99 JaIpnye & JoseINOOUA UW B JoTWoId 
3] a30 & Inb ‘siaquieyD “TY Inassajoid a] alo1dWIdI of 


S.INGINGD Yona 


‘anbrayise oseyeo np snpusyeut uoneordde anne 
dUN JSa Sarqiey JUa|GeidasoeUI syIsod sptod sap jo 
sjuesou spiod sap uoneurunys,[ op uoneoytduns ey (AT 


"JOOIOJ SUBS SOUTPWOP SpueIs xne o[v39 JUUIONbY 
-euIO]Ne Sd JUasSOduIOD say Inb soureuUOp sined sap 
SUOTJLUITISS SOP OUILUOS PB] ‘SaUTeLIOp SpueIs xne sanb 
-1[dde sinayeuisa sap onbryayjse asryeo ne apgooid 
uOd,| Ig ‘««anbneyUAs» no Jnorpeaid yuautaind syapour 
un Ins yuatndde s saurewiop syed xne sanbijdde xnao 
anb spur) ‘asepuos ap uryd 3] Ans sapuoj JudWIIeU 
-Ip1O JUSIOS SOUIRLLOp SpueIs xne sanbidde sinayeur 
-1]89 saj onb jueuuojs sed jsa,u [I uanbgsuod Ieg 
‘(6661 Jamoig) sourewop s}jed say 3a suoy]MURYoS 
sned say nod ‘ynorpeid afapou a] Ins sapuo} d][99 39 
SUO][HURYDE SpurIS So] Inod a] qeiy snyd jusWeTeI9Uas 
So asepuos op uvjd a Ins sspuoj uONeUINsSa,J = (I 

[-ajdurexo 
un jso ud (¢) 19 (Z) SuOIssaidxa say jURsITesE 
ua nuajygo S°°Yg ay ‘Jnorpaid sjapour 9] Ans sapuoy 
3[]29 B,nb aSepuos op urjd og] ins sapuoy doualayur, | 


666| eiquiecep ‘ajenbuse,p senbiuyoe | 


B ualq Issne gidepe Inayeutjsa uN jsa_ ,O JOUINSO 

Inod gudoidde snjd af g op inayeumnsa | ‘OqYO 

INdJeUINSE 3no} Inod yuajstx9 suondo sao anb uarg] 

‘adA) OAYHO Anoyeuinss,| op asepuos op urjd ne 

d9l[ DOURLIVA eT onb UoWIOOROTJJa snyd Jd JUOWIATIOVJ 

snjd saguinsa ‘xnap saino} ‘ane yuoAned Jnorpeid 

Q[QPOW Nev I9I] DoURTIvA eS JO ONAQId DOURTIvA BS C(I 
‘asepuos ap uryd 

3] Ins anb tsure Jopeid afapow uN Ins spuoj sUTLOD 

JUdWaIe[D geI1dIaJUI ag s10je jned InayewINsd /T (I 


“sarqeiiqnpul sosejurar sinaisnid 
qusaid Indyeusd [OANOU 9] STeul ‘aINaT[IoW sured B ang 
g[quias syORoIIJa,T “one oun Jed ajuRystxa “7 SOLU P| 
Jaoev[duias ap a[quireynos ong issne yeunod [139 ‘“] - i 
red agov|duias ang Wop seynusioy sap oun.| ep _,° TT souyew 
eT] “sHOjjo.p nod spuewiap onbneyjse o8e[eo & INa}eUII}SO 
us ody OAYO IMaeunysa un,p uoneuojsury ey] 


NOILVATVAD °*L 


“'y ne sayjouuonsodosd ang quaresaap ‘21 soy ajanbe] uoyjas 
geundo jusWoNe Isa RP] & AISopow jivd9 uN.p xlid ne 
QUIQUI ‘OT[Ie} RP] SOAR JUSWUApIdel yUd}USWIBNe INb UOISNOUI,p 
soniqeqoid sap Jasin ,p 1ay1A9 .p Juapnid a]quuas [I ‘a1ues 
90 op sogtiedde soired sap juanjour saatyeorfdxa sayqeiiea 
So] puenb ynouns ‘juepudday ‘aygnbua,p sajjae1 suonIpuod 
So] suep JudtUareI onb ‘adtoutid ua ‘aaJasqo ,s dU SAasNainosi 
ISSNe SUONIPUOD ap I[qUIdsUd UL) “aI[Ie} BP] SoA JUSUEpIdes 
JUIILJUSUISNe UOISNOU!.p saipIqeqoid sa] ‘suoy[HURYdE ,p 
sojquiasud XIS sap xnap nod ‘ja (saannqiUOd safoo 
-L13B SUOI}E}O[Axd sap JUSWIdIQuIOUEp UN Jd UOTONpod ap 
aInsoul oun JuRUsIdUIOD sUNSeYD) saguedde said sinatsnyd 
quate}dui0d saaneotdxe sa[qeuea $20 ap xnvI0} SZ] ‘OO = U 
Q][Ie) op suoT[HUeYDSE sap Inod saaneoi[dxe sapqelea [| op 
IAIOS 1S9,S UD *XNIINOSI JUSWSIOT[NOIWIed 11e}9 sIUUNOS 939 
® [I Janbne 3s9} 9] sreul ‘sprlod sao JUSWISUIOJIUN IOUTUITS ,p 
stuliod sed &.U «JTVWOSOQOD» aonb resA 3s9 [J] “satquidaoovul 
aseuUoT[NnueYsE .p splod sop uoTeUIUI[Y,| suJa0UO0D INb 


29 U9 «TYOSOD>» & SINSHQJUr JUOS «HAY» Jo «AN Td” 
onb stew ‘ajqeieduiod 3s9 uorstoeid Ina] anb sroye 330U UO 


“so]quuasua sarne say inod ayeury “9 a]quiasua | 1nod aneipsuuajuy , 


7 €'8 18‘ oP S‘8 Es‘ 
6'P er r3'I o's GE €8'I 
9'r 6L Z6'I o'r 6'8 SLI 
9°¢ L'8 9r'0 aS Eg 69'0 
vs r'8 r1‘0 aS 78 81‘0 
9°91 BLS Oz‘€- E91 8°67 10'0 
SEI v'IZ v6'I- rel r'07 Lv't- 
LUI 107 0¢‘0- fast Z‘0Z 750: 
‘SI IP LET Z‘SI Cte ZE‘l 
rT I'Iz S70 rll E07 7'0- 
COI ZLI rie 6'6 691 70'l 
8°6 r'vl se‘0 8°6 Srl LZ'0 
06 9€I 10'0- 06 S‘€l 60'0- 
601 ‘81 ZL‘0 s‘Ol OLI 76'0 
66 s‘rI 60'I 66 s‘rI SO'l 
v9 601 tel a) r'Il Ss‘ 
9°9 r‘0l L6'l 9°9 r'0l 00'7 
eh r‘Il 6r'7 r'L O'€I (oe 
OL oT SZ‘0 O'L vil 0s‘0 
‘8 OCI 80'0- ‘8 ‘ZI 10°0- 
69 s‘Ol SE O'L Ol cre 
Ss L'6 Z6'T (hs L‘6 £67 
0'9 8‘8 6L'I 0'9 6'8 ES‘ 
CY. al L9'0 EL TI 66'0 
r'9 66 €1'0 r'9 66 ZZ'0 
% % % % % % 
VWa Woda" sig uwWAG WOdY stelg 
49[2ULJ/orre pou] ore ny 


(o60 ASA) 9 91qQuiesuq 
(cp9 ASA) ¢ aIqQuiesuq 
(ooo ASd~) p e[quesuq 
«ewido» ¢ squiasuq 
«STWOIdWIOD» 7 a]quiosuq 


(q60 ASA) 9 9IqQuiesuq 
(cpo ASA) $ a1Quesuq 
(o90 ASA) p Aquiesuq 
«TeUINdQ» ¢ s[quissuq 
«SMUOIdWIOD» 7 s[quiasuq 


(y60 ASA ~) 9 91QuIesuq 
(cp9 ASA) ¢ aIQuiesuq 
(o90 ASA ~) p AIqQuesuq 
«TeuNdQ» ¢ s[quiesuq 
«STWOIdWIOD» Z d[quiosuq 


(g69 ASA x) 9 a[quiesuq 
(cpo TSA) ¢ AIQuiasuq 
(099 ASA~) p 91Quiesuq 
«feundo» ¢ sjquiosugq 
«STUIOIGWIOD» 7 squiosuq 


(y69 ASA ~) 9 91Quiesuq 
(zo ASA) ¢ aQuiesuq 
(ooo TSA) F P1Quiesuq 
«TeundgQ» ¢ s[quiasuq 
«STWOIduIOD» Z sjquiesuq 


SUOT[HUeYSE ,p s[quIosuq 


TVOSOO (,241eIPsULIDIUT NO) s[eULy 19 ]eNIUL SUONeUISA sap dyOKIyIA 


p neayqey, 


seyeBoul ayyiqeqoid dene eHheuuo||}UeYIS,| ap Sed a] SUeP BNbIeUIse eHeE|eO 87 IaMalg 


[e10} “nusAdy 


SIONIE] SUIAOG ‘NUSADY 


SUIAO ‘NUDADY 


OPURIA B SUIAOG ‘NUSADY 


9[q ‘NUSADY 


agipnig a1qeue A 


8E¢e 


‘“TVOSOO» 19 “OFUD» “AN TdIA» JUSWISUIWUIOU ‘sa[qeuRA 
Sa] saqnoy inod sptod sawigui soy oitnpoid ap sajqedes 


sajduuis snyjd say sinayeuysd stot] xne d}ILUI] 9S UO,| IS 
“S9]QVIUIRA So] $9]NO} 
Inod anbneuwgisAks tu ajueseiog tu jsa,u 9yOWedns IN9] 
‘uepuedag ‘anbineureied uou a8r[ed Ing] ap nua} a}dwi09 
sipuane A,s issne inv] Jt BWIWIOD ‘sInatiadns jusWaTeI9UgS 
JUOS UOS]eAA-PALILPEN ap SINdyeWINssd xnop sa] enb spur} 
‘Inorpaid ajapouw nv ai] steiq UOS ap Nua} ajdwWi0d aIpusne 
AS VJ [I SUIWIOD “INaLIJUl JUDWIATeIQUES ISO «Y_OCTY» 
‘WOdY Ans juswonbiun spuoj as uo,] IS ‘somne so] Ins 
anbneuraysks ade]URAL UNSNL ILOAP ,U JUITQUIAS «TWOSOO” 
19 «GN Id “Od” “OLLVU» Sineyeunsa sa] 
"Say qivy JUDWdJaI[NOIWIed ysa sagUUOTIDETIS 
solaniey suoneyojdxa,p aiquwou af puenb ouuskow ve] 
e woddei sed sjuviOdUl SyeVd9 Pp I[[OUUOISVIIO BOUdISIXO | 
IP JOUSIOUIN} JUD|QUIAS ‘salQTIe] SUOTR}O[dxa Sap NUdADI ap 
g[qeuea ey Inod sno} ‘sayqrej JUdWaTJOUUONddoxe sone SION 
SIT °89‘0 & ZS‘Q ap SNayoinoj ve] suep ‘sed say] sno} onbsaid 
suep ‘aquio} WWOT.1 & WING.] Op ONe1 IT “syeI[NsoI sreANeU 
ZASSE Pp QUUOP 9 JIQUIOSUd | ‘AYDURADI UY *(ASnoINoY WOJ 
QOUIPIOUION DUN JUDWIOUILLIOO STeW ‘AdUaPIOUIOD Jed jUSW 
-a,duits aoueredde ua) sauituddns ang juaanad sajqeidaooeul 
splod say ajjanbe], sane ayloey ve] onb PWOW,| euUseou09 
inb 90 ua uaIq Issne ‘sayeudo anbsaid uorsnjoul,p 
dyIqeqoid sap IOAR JUDTGQUIaS ¢ 19 p SaTquUIasUa so 
“Sa]quuasua sa] sno} Inod (WWY %) esejUs.Inod us njosqe 
UdAOLL 11B99,| INS 19 9 19 ¢ “p SATQuUasUd Sa] sqide ,_p onua}qo 
UO][NULYE Pp SUOTJBLIN]SA Sap UOISIOOId B] INS sxgUUOpP sop 
WUINOJ [I Jed ‘¢ Nevalqr} J] Issne ajg[dwiod p nes[qe) aT 
‘puvis snjd 
3] IS9 [I,nb (ayeury onb sure apentul Inayea) g a[quidsua | op 
314 Op 9UDA P| Op Nudd oJ ANOd 4s9,9 19 ‘WIOT.1 OP WII & 
INILIDJUL Sd SILIG NP ged JJ ‘Svd Sa] Sno} suRq ‘*sd;quasuS 
sone sat inod sulow no ¢¢‘Q B& 30 ‘Ie eB Safqis 
-SOdUII SUOT[URYDE Sd] BUIDNUOD INb 3d Ud BUIAIXNap assvjO 
as inb ‘¢ afquiasua,| Inod %¢Z‘| eB ‘Ide e safqissoduit 
suo][uRYyoe p g a[quiasua,| Inod %IZ‘¢E & aesa jso aTIO 
‘QIgIe] UONLILO[AX9 sap NUdAAI Np svd oJ] suRC ‘ase}UIOINOd 
ap jurod un.p sian ne dINILIOJUI jSd DITeIPSUIOUL/aTeULy 
UOTLID | 19 BPNIUI UOTLID | BUS sIvIq Np UOTeLIeA 
Rl ‘SolIHIE] SUOTIE}TO][dx9 Sap NUdADI 9] anNb sane sapqeuea 
So] Sajno} Inod anb anuow yp neojqe) a] ‘oureyun sptod 
un 9nqliyye & Ing] UO Nb dosed ‘apnzsd daAv SaQUUOT}OIIaS 
939 sed quo ,u inb sanbidAye sastidanua sap suadeap ne ‘asep 
-UOS op ur] ne JUSWIIANLIAI VsIvIG Sd aNbIAYISA BSeTRO B 
INayeuUINsa | ‘sayquidasoeul spiod sap uoneurunys | sady 
‘31g ap sooinONpoid suonryoldxa 
So] Inod ‘ainsau sIpULOW UN sup ‘AUIQUI Op Sd Ud [J 
“ONUIWUIP ‘JudWIWUONbYsUOd ‘eB UOT[HULYDE | OP I [IOI S][Ie} P| 
anb 3a oulejiun sprod un Jonge sana juos as sajqeidasoeul 
splod sop jurke sastidanus,p juessio1o oiquiou un,nb 
dINSdW & IVOAY ap ajuonbeasaqns spider uonrjususne | v9 
(€ I[qudsuUd | SUP JUDWdIAI[NIIVIed) saguUONSTas SdIVIIL] 
suoneioldxa,p siquiou yyed ne oanp 3so sozoniey suon 
-e}O]dx9 sap NUdAdI Np suONeUsa soy Inod «~WOSQO» 


LES 


ap Svd VJ SUP adAJasqgo UONRIOLIIEp PY “3dA} «OAYO» 
Inayeunsa | Inod onb sure ‘apentul UOISIOA B] INod sonusa}qo 
Sa]Joo Bk SaTqriquias WOJ yWOosS «TYOSOO” sp soaeuly 
SUOISIOA XNap Sa] Inod sanuaigo IIOTY Sep uednyid eT 


L'8 viv 181 11 al oeuly 
€8 Ge OL VII O11 9[entuy 
‘TVOSOD 
can Sas LSI 68 6 TI UVEGdMN 
EL LAO 9°SI 16 CTI CaUMN 
611 SLY ENG 96 iS {Sr aod 
08 Ve v9 Vil 611 GN IdW 
78 GS Li O11 OTT oye ks(9) 
6L (ESE 6 SI TOI VOI OILVa 
«feundg» ¢ ajquiasugq 
v8 WIRE al OTI 66 ayeuly 
7°8 £07 Srl ara 66 seytuy 
‘TVOSOO 
18 Lol Tvl OTT COI UVeEadMN 
18 86 Tvl CT Sol CaMN 
86 Ree 9°S1 O'el TEI aOdla 
68 C07 mal STI SOI AN Id 
V8 €07 srl 61 66 roe: (9) 
€8 T6l CS OTT 00! OILVa 
«SIWOIdWIOD» Z a|quiasuq 
Ll O'LI 9S CT Srl UVeadMN 
o'r CLI 6 SI [es O'S CaMN 
LSI ei 0°91 9°€T LSI (OIG IR: | 
Ss O'ST OLI 1°97 9ET EN Idw 
ELI O'sT OLI 1°97 9°EI Js Rs £9) 
L‘9l vri 16! 6 87 Lvl OILVa 
(Asse9) [ 19S 
SIDI] QPUvIA 
[ejoL SUIAOG SUIAQ_& SUIAOG 1g Inayewinysq 


‘OP DUDA LI op snudADy 


Quawanbiun siaquieyd op xneulsiio oquiasuq) 
sojuepuodsai09 uoNeindod ap sinajea sop o3ejus0Inod ua sagIpnie 
SaTQULIRA Sap so9ieUNsa UONe[ndod op souuskowl sop WOAY 


¢ neaiqeL 


“sa{quiasua sane sa] sno} Inod avury ‘g a[quuasud,| Inod aire1pau9} uy, 
‘gqeidacovul sseuuo]|NuLYyo9,p sprod ja) un surowl nev 

JULUDJUOD SUOT[HULYIE So] SULP d}TUN | & SINLIJUT SO INA|LA v] JUOP aseuUO] 
-[Wuvy9,p spiod ap suaXow sarquiou say yUOS sasayjuaied anu saajJIYO SIT 
“g[noyeo uoU “o'U 


$.. ~ : 4 oe (g6 0a SA ~) 
(Git) OU (LO) eis oe au 9 a]quiasuq 
, +A hs (cy9ASA~) 
(00%) co (49°) Ir ou pi ¢ JJquiasuq 
5 : ‘ ues. . (99S >) 
OO AQUEDY Be ay ES p a1quosug 
SEO OLS) ‘ ‘ eI, 
(GB PEPST MOVE) A6V (18S) 1 6 oA (CLG) 1G heal ecetccact 
Re THON Titty ae Beli one's «STUOIGWIOD» 
OST) ¥O ZI) ss (Eg T) OCCS TES Zz aquiosugq 
(ou) ‘ou (7p) LL (Ler) jft, Yee) tLe She 
¢ © | 21quwesug 
<9[CUly 

pea oyentuy 

suoj[nueYo?,P 
TVOSOO HOCIa/aN TdN Daa o[quiosuy 


sopqeidaoovul asvuUo]]NueYse ,p 
splod sap juvud]U0D sUO][MURYIE ,p dde]UDIINOd 


Z neayqey, 


666| dquadep ‘ajenbua,p senbiuyos | 


“SINIJBUIT}SS SazjNe .p Inod (9661) 
sioquivyd sed sagiqnd sajjao & IWOAY $90 Jareduios ap 
youulad ¢ neafqe} a] “sajqeidaoovul aseuUO][NUeYSE,p splod 
$9] J[qIssod np ainsauw Pv] SUeP SUILITTS TOAR saide nb jueae 
udIq Issne *“JWOSOQO» Anod FORAY sey snopes ve uO 

‘JUDUITNIs SUOTILIDII XNap saide saaaja JUSWITqQeL 
-jdosoevul efap juos Joye) & sarqissoduut suoj[MUeYdI ,p 19 
sajqeidaoovul sptod ap saatasqo Sa‘QuIOU S23] Ler msc ‘ll) 
9 g[quIssud,| INOg “«GNTdW» no «OqyYHO» sinod onb 
g[qrey snjd yuoWw]qviapIsuod sd «TWOSOQO» Jnod ayentut 
JOUSPIOUL | ‘WUBpUadad ‘¢ a[quIdsUd | INOg “«“TWOSOO» no 
«QAYH» Inod onb «qn Tq» Inod aipurow jUswa}au 1s9 
splod sa[qrej sd0 ap a]eIIUI DOUDpIOUI | ‘7 B[quasud | INog 
“«<FOCIY» stew «Gn IdW» snjd ssoye jso,u Ind}euiNsa | 
SIRW ‘O[[NU JUSWISULIOJIUN 1S9 «F_OCTA/AN IdW» Jnod 
auepuodsao0d a[euly BUIPIOU!, JT “«“TVWOSOO» 1° «FOCIa 
/ANTdW> “OAD” sinayewnss say inod sajqeidasorur 
sprlod sop geuiul asouaprioul., ayUOW Z neo[qe) a7] 


atainsinod uou asAyjeuy 06:0 ASC > 
PSI 9 Or Z uonnuieday 
6C7 I 96 I 
6S 0 L81 0 9 a[quiasuq 
G I I v 
v I € € su9 ASA 
91 0 I Z uonniedsy 
LL 0 I¢ I 
Ive 0 OT 0) ¢ a[quiasugq 
9 0 0 € 090 ASA” 
v1 0 II G uonniedsy 
08 0 cS I 
CTE 0 8st 0 b a[quiasuq 
6£ 8 8 9 
6£ L 8 ¢ 
8V L €l v 
SL v L7é £ «ajewindo» 
bel I 8Y G uontieday 
€0€ I OOT I 
1OL 0 977 0 € a[quiesug 
€ G Cc v «Stuosdw09d 
91 0) if t ap» 
67 0 81 4 uontuedsy 
Lol 0 c8 I 
967 0 LLT 0 7 B[quissugq 
suo]]HuUeYyo9 
sop | > aseuuo]]n 


sa\sidap Ja}1e1) 
a[guiosua |. 2” " -uvyoe,p sprod 
@ safqissodurt 3 j 
Inod | >sprod * E “sap uvua}u09 
“~~ suoj[nuryse .p 
Sap JULUSIUOI to suoy]Queyo9 .p 
suoynueysg,p ANON 


O1QUON 
dIQUION 


suOnesgit.p Suo[|NULYo?,p 
IQUION a quiasugq 


saqqeidasovul TYDSOO 
aseuUol[ Nuys p splod sap aalssois0id uoneWs| 


[ neayqey, 


"10-9]]99 
RB g[es9 uoU seu ‘gIIUN,| ap ayooid jso,U UOISN[OUL,p 


aupiqeqoid ounone ‘iaruaid a] nod 1v9 ‘g ajquiasua,| 
Inod anb ¢ ajquiasua | nod n3re surow jos autajqoid a] anb 
I[QUIaS [J “9 B[qQuUdsUA | Inod anb yuaWI9}g;dUI09 saipUO jo 
}SO,S OU UONVUILUT[S,p 9pOyJOW! BY “| NeI]PQe} Ne saIsNq]I 
}S9 sapqeidaooevur spiod sap auigjqoid np ajjaes aayod ey] 
(‘JUOWA}UZ] JJUSWISNe aja Is anb uONLWO]dxa | op ay]IeI P| 
ap UONUOJ US JUDWIOpIdel aJUDWISNe UOISNOUL,p auIqeqoid 
RI IS a[qiey snjd iso saguuoroajas soratye] suoNeWoldxa ,p 
siquiou gf anb usiq Is ‘aljiey aed ap ane Be aourpud) 
JUO S2IQIR] SUOTIEOTdxXd soy] ‘aljeusny u_) ‘“ogIIIe] 
OLISNPUL | IP J[IO} J[[Ie} Vl 9p DANSaUW L] Op 39 SaIVMIR] suoN 
-P10[d x9 ,p SIQUIOU NP UOT}DUO] Ud SIO] P| B g[eO ANayeWINsO 
un Jatioads inod synisod spiod say] sno} yuednoisai ‘10s 
[nb yanb ‘ajquiasua un Jajnoyeo ap ayqissoduut yusuanbiso] 
}12}9 [I ‘SUONIPUOD sad sue “dUUdAOUL PI B dINaLIadns ay]Ie} 
IP SIINO} JUSILID SOWLIDJ S101) Soy onb Ja sIQNIe] BNISNpul, | 
INOd saguuolda[as 919 JUSIVAR JUSUI[NIS SOULIDJ SIO] NO sed 
Sd] Suep dJUASOId 3S9,$ BIPNOSaAl B BLOLJIp snjd a] sue]qoid 
XY] ‘uoNeIgpuod ap sjUatdIyJa09 QQ sep sinatsnyd no un 
Inod ajqeidacoe ayayoinoj ve] SuBP JURQUIO) INeyeA sUNONe 
Joanoy nd eu uo ‘ane e sdwia} ap ‘stojayno} ‘ayun.| 
B sInotiadns no xne39 ‘sno} JUSWDTJONYIA NO “««“TYOSOO» 
spiod sa] sno} aipual e ‘uOT]MURYd9 | WLos onbyanb ‘asAyeue 
MIIUWap Ud ‘ISSNdI B UO ‘9g B[GUIdSUA,| ap Svd d] SURP JNeS 
‘AV ISO)” 
JO SINDJCUINSA SION $99 IUD S9][99 1UOS PIO, P SOULIA} S29] 
aus sayusutyed suostesedwiod say ‘sajqeidacovur aseuuo]]y 
-ueyod,p splod say] Jour Inod yuowonbiun «EY yVyaMN» 
19 «<EQMN» ““<GOCTY” WUnponutr ev sraquieyg sulWO0D 
"Sa[qe[quias UOJ PIO sep iuasinpoid ‘sanbynuapr anbsaid 
JUOS SI]NULIOJ Say JOP ‘« NAYO» 19 «TWOSOO» ‘e[quiesus | 
suepq ‘9 & Z g[quiasua say nod (uolMAGIvI DiIJawsod 
Inod) «JWOSOO» ‘anbneyjse asvyeo Jed inoyeuysd | gpnoyeo 
SUOAR SNOU ‘sIaquivYyD ep epnie,[ & JUsW[dWOD UY 
““FTOCIY» Anayewinsa | 
Inod sgjnojeo sptod xne uosjeA-eAelepeN op sonbiy 
-suvied uou sjuswaysnfei say sonbijdde e juajsisuos inb 
“<OUWVGMN? 12 «CQ AN? ‘Sinayewinss xnap ja (ajqeidaoor 
dNeYoINOJ eT suBP JaquIO} op sprod sa] sno} ev youLIad Inb 
AOAIY UOIssais91 op Inayeut}sd uN dIIp-k-3S9 9) «FO CTY» 
Inayeuinsa,| ‘(asieiq uoU dsIleguUI] INa}OIpsid INdT[IOWL) 
“AN Id WW Ineyeuinsa | ‘[ASq ‘seo 90 suep ‘juey9 2 s]quLea 
Pl ‘(Z661) [epuses 39 a[IAaq Jed sastjnn asejeo sed uoNeW 
-1S9,| op ajueveA argued ey e enbyuapt] ad} «Qqyo» 
InayeUINsa,| JOS sIaquivyD sed sasyNN («OL L YY enb 
anne) sinoyewunsea buto say ‘ane | & sdIpnie s[qeuea ouN.p 
JUDIOIJIP sseuUo][NUeYdE ,_p splod sa] onb suas 30 ud juLsIey 
-SIJLSUL JUDUI][IIUISS9 JURIAPISUOD Z| ‘SINDJVUISS sane _p 
B UOsTeIVdWOD eB] INOd dOUdIDJOI Op ANI[BA SUTLUOD JUoUIOND 
-IUN ONRI 99 g[NI[ed B I] “(2[q Op 9UDA PL] Op NuUdAaI JI Inod 
2[q Bp Sase}OaY Sa] SUILUOD) ddIpNId a[qeueA onbeyod ap are} 
-uowig|ddns ajjainyeu ajqeiea anbeyo ins apuoj as inb LH 
juanonb sed inayeuinysd | 1S9 “«OLLVy» gjodde ‘1anueid a7 


sajeBau! ayjiqeqoid cane aHheuuO||iJUeYOS,| ap Sed 8] SUeP aNbIJaujse abejeo 97 aMalg 96Z 


‘SJUDIOIJIP SINDJCUINSS XIS IP JUBAIOS 9S UD ¢€ B | SaTquIosUa 
sap unoeys inod (IWOY) suusAow anbyeipenb Inoawa | 
JO aseuUOo[[HURYdS.p splod say gnojeo eB sioquivyD 
‘g[agpoul 90 Be .Nb jie) UO ,U IOI SagjUasaid 
suosivieduiod sa] ‘yap puvis snjd a] asod tnb tnyjao jure 
J[Qpouwl 9D “S[NU UOU STILNSNpU sINo}eoIpul das jo ‘sIONIe] 
SUIAOQ OP 19 SPURIA B SUIAOG AP ‘SUIAO ,P SAIQUIOU $2] “3[q OP 
SAILIDOY ,P AIQUIOU JJ IIOARS B ‘sautejyuaaddns sayqeuea | | 
aidwioo sinoyeuinsa sas oiInysuod nod siaquivyo Jed 
d9SI[IN ([) IJapowW Np suUOIsIaA XNap Sap spuvis snid eT] 
‘Q B[QUIaSUa | Bp IN[aI0 ‘pues snid 9] 19 
p I Quiasud | ap Injao 3sa ad snjd 9] Inajoas aT “aIquioUsp 
JUSUD}QTdWIOD ~INnd}99s UN Issne ojSIXd [I ‘seo onbeyo 
sued ‘06‘0 B ‘9 a[quiasua | Inod 39 ¢/‘Q & ‘¢ a[quiasua | 
Inod ‘99‘9 @ ae3a sa aoURssInd 99199 ‘f s[quIasUd.| 
Inog “GSq Np aileuuonoes souerssind oun ke sajjouuon 
-1odoid juos ayquiasua onbeypo e ssanbrydde uorsnyout .p seit] 
-Iqeqoid sa] ‘safoouse suoneo[dxa QQ] ep suoT[MUeYseE 
OOS Issne xno juvuaIdwoo ‘soireyuowyddns a[quiasus 
SION] QUUOTJOITaS B UO ‘apNyad ajUdsaid ev] Op sUly xNY 
(ASq) weyeainby daays A1q 92] 
1sd UOTBOT NES PT B Japgooid Inod sasipyN sje} op ajqeuea 
PT “sqoouse suonewoldxa QO, ep saynens sojdurts 
somlojege suo[nueYyos QOS pusiduIod s[quiasua onbeyD 
“SOQUUOT[NULYDE SdTOISe SUOTIEITO[AXd $6 SOP Sales 
SOILOJVY[V SUOT[MULYIE-SNOS ap SaTquIdsUd SIO.) op UdAOU 
NV UOIJLWINSS,p SdISaIVINS SASIOAIP gIedu0d B sIoquIeYyD 
*XNdINOSI Ja a[NN asATeue .p Jof[go uN saguUOp 
op sJquiasud | ap JUOJ sanbysta}o9RIVd sac_g ‘sed onbiyddes 
QU [I SoTJanbxne (SUIAOQ dP 12 SUIAO ,p 9JUDA P] OP SNUdADI) 
solne xnap jo ualq zasse onbijdde;s (1) afapow 3] sayjonb 
-xne (Siaey] synpoid ap 32 9[q ap d]UdA kL] Ap SNUdAdI) 
sa[qeliva xnap pusiduios saguuop ep s]quiasua, JT “(9661 
SIOQUILYD) O86 SeguuR sap UY P| & s9sI[BaI (STAY) Aeaing 
Ansnpuy Aled ueyensny | ap jo JUoW]januue sasi[edl 
(SIOVYV) AeaAing solWisnpuy Ssulzeig pue [eimynousy 
ULI[eNSNY .[ 9p Wped oJ suep soyoose suoneio[dxa p06 
op UOT[HULYSE UN,.p saidne sar{{fanoa1 uONONpoid ve] 1a sanb 
-MWIOU0D9 Sanbiyst19}OeIVD $3] INS S9QUUOP Sap asI]IIN SUDA 
SNON ‘SomWUOUOdY doINOSaY pure [eINy[NoUsy jo nesng 
urlfensny ,[ Jed sagstjeai sapoouse saygnbus xnap ap yUeUdA 
-O1d SOQUUOP AP SIAIOS SOWIWUOS SNOU sNoU ‘UOTeUIT}Sd,p 
sopoyjew sane.p e anbeujso aseyeo ied uoneuiso.p 
spousal RP] op ayovoysa., onbyeid uo saedwio0s nog 


SANNYLTVALSAV SATOOLTYDV 
SAUSTUdaaLINA SAT WAS SHANNOG 
ad NHAOW NV ANOMId NA AGALA “9 


‘asepuos op urd ne saneyjal (INO) 
suuskour onbueipenb inaia,] ap uonenbs.| suep ajqeio 
-oidde Inapuvis ap Steiq ap ULI} UN, Pp dvd 9] DIINPONUI Tu 
QsepUos op ur] nv ddl] DOULLIVA PY JUSLUD[[ILIO}VW 19] USUI 
-BNL SURS “JUSUIIIIMUS IOUTUUI[S So] “JoT|NoONIed asepuos ap 
uvjd un.p seo a] Suep ‘ya sayquidasovul spiod sap aouaproU! | 


SE¢e 


JUDUIS[QuIapIsuod diInpal Inod anbresyjse asvlVo & NAYO 
INSICUINSA | IP IIAJOS 9S ap JaseSIAUD Inad UO “JUdUaIapOU 
anb ajuswsne.U UOISN[OUl.p sapiqeqoid sap Ingea e| 
puen() ‘aipureso oj Wesinod ou uo nb ayqrey snjd ysa onbst 
a0 aonb Jasuad Be JUaUUOp aJURAINS UONDAS PR] B SajUasaId 
anbiiidwis apnig,| ap sjeinsai soy stews ‘asepuos op ueyd ne 
OP SIeiq UN dINPONUI,p Jasuep J] S1O[e NOD UD ‘sagagI2 
SINI[BA SQUILIIAD sed JUOIN[OUI,U splod say anb yuswNyosqe 
sed ynueses au sajqrey yuowiajqeidaoovur syjnisod sprod 
Sd] NO syHesou splod sa] UOSeJ 9999 Op JOUIWIITS .P We} IT 
‘netidoid ane sed apassod ou 
"ZI 2d OgUy snayeurnsa | inod afqeseduioo awisa} 
OX] ‘ouleylun Inapea oun issne & “Mm JUepUOodsaOd splod 
J] ‘aun | & ae3e 4S9 4 anb sloj onbeyo ‘anb ainsse (9) 
19 (¢) suep YAS | — I) away a] ‘[noje9 9] Jargdou ‘sind 
duun | & SajURpUOdsSdIOD “U Sap INI[BA PB] (QPOUIWOD ANI 
dyoIeWlap oun & ddRIB) Jaxtj nod uo ‘ayOs RV] ap afqeidao 
-Oeul 1Sa sptod 9] JUOp saqtUN sinatsn{d no sun yUaNUOD UO] 
-[Queyoe un nb sioj anbeyD ‘anbneyjise asejeo 9] JUvINODAI 
ud awigfqoid 90 jUaWa]qeispIsuod Jay] yndd uO 
“‘ynoipgid 
J[QPOU Ne IdI] DOURLIVA BL] OP B[QvJ9pIsuOD UONR]USWUSNe 
aun JUdUIeNUS JUd}saI IN sgylUN soy Inod samessadau SPAz]9 
snjd sjnisod sptod say 19 JUSUTWIeJSUOD JUD]UOISNe 9}IUN | 
@ SAX 1UOS splod sa] JUOP sayUN,p sIquioU Z| ‘SUONRISI 
sone .p @ apagooid uo] IS “soyqeidaooeul Issne xna WUOS 
Sg[Nd[VddI 9199,p JUoUUAIA Inb spiod ap siquuou onb je} US 
SUO]L}SUOD SNOU ‘s]UR}SAI Splod so] JUR[Nd]ed9I Ud 39 9TUN || 
R IN[eA Ina] JUeXI US satqeidasoeul splod sa] JOUTWUI[S Pp 
suodesso snou aonb yo anbnayjsa asvjeo ap iqns sed e.u 
Inb HOAYH Inayewinss un,p suoyed snou ts ‘uepusdag 
‘gqeidaoovul a9YoINOJ oUN SUeP JURqUIO} 
spiod sop anquye ev uo saljenbxne aseuuo][nueyoe.p 
SOUUN Sap B JUOWT[oINJZU Janbiydde ev spoyjyeul ke] ap Issne 
USS [[ “«Sd]ULIOQE SUOTIRAIOSGO» Pp Sed I] SUBP BBepUOS 
ap urd 9] Ins yuanUsoUod as Inb aygnbus,p suaronsneis 
op siquiou Jed satuuasep sop sindap senbrydde apoyjow Py] 
ap juswastogid 118k ,s [I “Ins uatg ‘onbidAye asreyuowgyddns 
auun.p on e saumiddns gyrun,| sojnofe e sind ‘sanuayjal 
uone[ndod ap sailun sap xnej0o} sap UOT}OUO} Ud sagT[Ro 
JUSIOS SoURISAI ISvUUOT[NULYOS,p salUuN saz oenb ayos 
ap ‘Mm sa Japnopesar & ‘aBepuos ap aseq ke] ap 1 UOTTHULYDE, | 
ap sun oneo Jowtiddns e ajsisuod [| >’ JUOp gaituN 
oun ve sanbiydde juowaysajruew ynej [t,nb spoujau ey] 
“UOT[NUeYS9 || 
suep og welinod ou aja uous ‘uoneindod ey op anied 
Qe] NOP ao ‘ueNOg ‘«aIvI JUDWIOUDAP» UN 3S9 UOT[N 
-uvyod,| Suep ddUasaid BS ‘[e10} NP soANeSaU SUOTFRWISO 
sop oilnpold juawaanoayja ined aja “Med juswUesTyyNs 
}S9 QUIVULOP 9] IS “dANRJUDS9IddI-3]UOD Isa aI[a,nbsind anb 
-1dAjye JUDWIapINsge jso JNeSU 3Sa Splod 3] JUOp ddseUUOTIN 
-uvyod Pp aUUN oun ‘UlJU “SUIQUI-a][a,p aaAnejUuassidal sed 
dUIQUI 1S9,U oT]9 Nbsind ‘anbidAye yUstusANIuLap so syUN | 
@ INDLQJUI ISO splod 9] JUOp sseUUOT[HULYDI.p d}IUN UA 
‘duluN one sunone ,p sanejuasaidal 4sa,U aT]O Jed ‘aytordAy 
Vl Op dU] VT B JUWIONbIUN jUR}d DUILIOD BdJOPISUOD 1s 


666 BIquiedap ‘ajenbua,p senbiuyos | 


({) autun | & [esa Iso sptod 9] JUOp aseUUOT[HULYSE,p diTUN 
auyQ ‘uoneindod ap sayiun .p aiquiou yned snyjd un,p «saan 
-PUISAIddI JUOS» saT[a steur ‘sanbidAy suW09 saglapIsuod 
a9 91099 JUdANad a] qIej snjd isa sprod 9] JUOp aseuUOT[N 
-uvydod .p sauun say ‘uoneindod ap saqrun ,p aiquiou puri3 
snd un.p «saanejuasaidal JUOS» sayja nb suas 39 ua ‘sanb 
-1d4} JU}9 SUIWIOD SagJapIsUOd ag JUaAnad (a]qIey Isa mM 
sajfenbsay inod ouop 19) aaa{2 Ise sptod 9] JUOp aseuUOT[N 
-URY99,P SANUN SY] “UOISNIUI.p sayfiqeqoid xne sansojeue 
SUID SaIapIsuod ang jUdAned ia ‘splod sap sasIaAul 
so] onb 99 e UONRoINsnf oun v A [I ‘oUOd ‘sap yuouaIdoid 
“ say onb sayuoutiad saygudoud sap saorpul sindy[lau ap JUOS 
spiod sao anb puajua-snos ‘'m ‘anbnayise ase[eo & ajapow 
np sptod sa] sjinysuo0s yUOSs JOP UOdSe] PI ‘WUepuadag 

"X OP SOUUO[OD Sap dIIB9UT] UOTOUOJ dUN JUSUTAT[ANIIqGeY 3S9 
Inb uonsuo} ‘aT]Ie} eB] op oNUUOD sINsaW 9UN Pp aytoI[dxa uoN 
-OUOJ oUN B JUaPUOdSaION UOISNOU! Pp Say[Iqeqoid say anb 
}9 XNOP SI] SNO} spueIS jUOS UOT[HURYDE,| 19 UONL[Ndod P| 
IS SOSTJLIDA JI}Q SUIOWUREU JUdANAd sasnaiNnoOsU Issne suOT} 
-Ipuod soq (‘uoneindod ev] ap sauuo][NUueYyoe UOU UONIeIy 
RI SUBP SaTqe[quas JUDWaTqeuUOSTIeI sajatdoid sap jueke 
souun | - at UOMAUD IaISIXe WeIAop [I “u suTIqeqoid 
PR] SOAR AISNIOUI 9seUUO][HULYOS ,p a}1UN 9)N0} Inod ‘adrouud 
20 UO[ag) ‘asepuOs op urd a] Ins dapuo} dOUdIOJUI.| 
pus}-snos tnb ayAtejuasgidel op adrouud 9] ayn suUI0S 
Jolgpisuod assind uo; onb inod sarjdurai ang ydAtop 
SOSNIINOBII SUONIPUOD sap onb susI[NOS (G66 [) Joma 


SATEH1IVA INAWA Ta V LdHOOVNI 
NO SHILVSAN ADVNNO TILINVHOU.d 
SdIOd SAG ANATIONd AT °S 


‘asodsip uo juop sajusuted 
uonje[ndod ap saguuop s2yJ Ins gpuoj aseyeo un ve JUuepsoold 
ud soxouUod suonrindod sa] Inod saumwuos sap 19 aNUUODUI 
oo ‘% aumos ve] ap xneroads sinayeumsa sap suinns 
-U0d Op ‘E UOINDES RP] B DUIWIOD ‘allessao9gu og WeIINOd 
[I ‘ojuvyoduit jso uoT[HUeYdE ,p suUdKOU ve] 19 UOTe[Ndod 
op suudXow P| oUS syedsIp RT Is \uepusdadg ‘fap Anaea 
9)no} Inod [| ='m aonb 39 uoy]NueYyos,| Suep Issne 9ANOIII 
9s uone[ndod ey ap ayun onbeyo puenb sjnu xneap sno} 
jusuUatAap sasodoid sinayeUItsa Soy “JUSWISPOWWUOS UOJ 

‘ailepuodes ashjeur | Inod juessoigiul 
389 Inaeullysd 199 ‘saguuoT[nueYss UOU sazTUN ool Inod 
'n Sa] anpeuUuod ef2d Inod sed ynvj au [t,nbsing * Jo —M) 
eed 72 389 {(A)p - (4) 99"97} op jnorpgud J]apoul ne 
991] DOULLIRA B] Op ‘aSepuos op uryd ne 39 JroIpaid sfapou 
Ne JWOUIOANPIAI JUSBIBAUOD aiOoUd sIveuI ‘aTdulIs sn{d 
INdJeUISd UN ‘OUD “SUOT[MURYDS spuvIS Sap sed o] SUP 
d[qvosi[sou 39 a][NU JUsWIaNbIOWdwAse 3sa (| |) sup UES 
20 ap UOIssaIdx9 SWIOIXNap P| eel SI9A JuoWIONbYO\duIAse 
pu} ln anbsind ‘ysa snjd tn?) ‘ayjnu sa asepuos op uryd ne 
dAJRIAI DoURIAdSa UOS Jd ‘LH INaJeuNsa UOs Jd UOTe[Ndod 
eR] nod /p SOP SUIWIOS PB] AUD DOUdIOJJIP Pv] aUasoIdal 
(I) suep sasoyjuored onus uorssaidxo osgtwieid ey] 


[{(A)p - (4) 92" 7} ap GA eB] inod snayeunsa un no 
9[NUIOJ 9uN stUa}go Inod (| [) No (QJ) Jast{NN,p a[qQtssod sed 
}S9,U [I,nb oy0s ap ‘squuo][MuRYyse UOU saytUN sa] Inod stuly 
-9p sed juos ou ‘M so ‘Juepuadap] °,9 Jed ,0 uedeldwos 
ud JHoIpeid sfapow nv JUSUIIATIRIAI s1UlaBJOAu03 uodsey op 
‘(6) OWIWOD 3n0O} ‘(Q]) JoWNse Ined uO ‘INTRA ouN JaInduit 
Ing] jnod uo J enb no 22 S29] WeuUOd uO | onb juesoddns uq 


(LI) 


lexece Ldn }- 


(o1) yo hs ep 
ip ( [ LON zs 
som coming 
N 
sal sof 


Ee G By im) {| , 
ee OPY, epee 
le SO ( Pitt) <a- 
I= sal 
GK CORT 
N 


O= 


z (Oz 6 Ce: 


1S9 S1QIUIOp 
91199 Op s[NULIOJ eB] ‘UOTIUIJap Jeg ‘anbiso] snd xtoyo 
UN 3$9 JNOIpsid s[Qpoul nv ddl] VoURTIVA PI “Jal[nonIed uo] 
-[Queyoe no} JasATeur Inod ‘stew ‘aseuUOT[HULYSS ,p uryd J] 
Jtjqeie Inod onagid soueweA ev] JoWINsd,.p studoidde 3s9 |] 


AILOIGHad ATAGOW NV FATT AONVIAVA = “P 


“INOJCUIT}SS 199 IOIOI[IUIe ,p a[qissod 
1S9 [I ‘xNap Sa] WeUUOD UO Is ‘XxnaTUI d109Ud ‘NO “% sap no 
‘2 Sap INJad swIWUOD ‘uoNe[ndod ap [e}0) uN ayeuOD uO IS ‘Seu 
‘sinodeI JoIWJap ud gsITHN ang smno{noy ynod 22 ee) 
44°" quo] ke] Pp LH Inowunse,y ° (1 _ hist uoIs 
-saidxa,] op uoneuIsa | B Ua) asod 3s nb sesGodt [Nas 9] 
Jo UOISSOIZ9I Jed aITeUIpPIO asATeUR | B JULINODAI UD QUIT]SO 
ang yned ,O ‘sanuUOd jUOS “xX Saf Sno} ap UOTTHURYIE,p 
SINIeA Sa] Is ‘Uepusdsd “(RGGI Yseqey 39 UlaIspjoyH 
‘SOUOH “JOUUTYS ‘UUPUIOJJIJq) s[epowul sa JOWINSE 
Inod sasud aig sioye JUSALOp sasatfNoted suonneoaid saq 
‘sajqtuodsip sed juos ou sajusutjyied saguuOp soureyao Is 
SJUSWIDUSTASUAI Sap IUINO] jnad UOT[HULYSE | ap UONDITaS 
RI ‘(aygnbua | ap uoNNdexa,| ap No UONdaduOdD PR] ap ssreY 
a][29 No Injao aonb suuosiad ane ouN No sWsTURSIO o1)Ne 
un Jed 991Nd9Ke SIIP-R-1S9 9) AIIepUODS dSATRUP Pp Svd UY 
TSA5 60 
BNOYOINOJ LI ap SIOYSP Ud JUSNITS 9S SaT[a IS JUDWIDIII] 
-nonied ‘souapnid s3ae Sagyiel) a119 JUSIVIAOP 19 DOURTIRA 
dJOJ ouN JUdWAT[aNIIQey JUajUaseId A op SUONRWINSE Soy 
‘uo]]QUeYde pueIsS UN.p juauustAord pale, is ane ‘yuepuod 
-9) ‘o[[NU sa “2 op SueI aI IO , WZ / Ad! x - ‘€) anus uonryal 
-109 ve] afanbe| inod A op moiea PR] URANO) Ud A ap a]sNqol 


sayeBeu! ayyiqeqoid ene eHheuuojl|ijUeYyoE,| ap seo a] Suep anbeujse ebejeo a7 emelg vez 


Inayewiyse un Jtus}qo jned uQ  “wWnuITUT ne .O IINpgd 
inb ajjao yuaWaressaogu sed vias ou A ap aANaT]IOW PI ANITeA 
B] SIVUL ‘Sa[qesedUiOd JUOIAS ~O AP SINATRA Sa] *U (SUOSIP) B 
aes IOS SUIWIOS Ina] anb 90 ev UOSe] ap aseUUOT[MURYIE ,p 
'n say astjewuiou uo ‘A ap sesoddns anayea anbeyp nod ‘1g 

Sui3u0 _[ sed enbsexd assed auejuowiaddns apqeiiea apnas 
aun ,p UONdUO] ua K OP UOISSOISAI Op d}101p ev] puenb ‘ajd 
-waxa Jed ‘ajqiej isa asepuos op uryd nev aij stetq a] anb jes 
uo sjonbsay] 1nod suoj[nueyse sijed ap sed 9] suep sjyeq[Nsal 
suog Zasse.p Jauuop jned gsodoid inayeunsa,| ‘asepuos 
ap uryd ne dl] sieiq ne snp SdULId} SOP UOTSSTWO | 1S9 (6) OP 
UONLUIWIA}ap eB] Suep naf ua anus Inb uotewtxoldde sjnas 
vponbsing “(C/T Tayfng aonye +" 4g xeovrdiaay? OPC 2g 
anb Ja) souasajaud ap sreur ‘29718g ap uonesiinn,] ans aseq 
UOISsaISal Op oIIeUIpIO auUeISOId uN,p Uasou Ne nuago 
29 ap Inayeurnsa,| ag ned ~o no SO pueis un ins 
apuoj dA 91199 op eee un }so ‘n( = yy) a6 onb 
(6) 9p JUSUOVIPSWUUT B[NOIEP [] (AP? ap Jnorpeid 
a[Qpoul ne set] aouerea vy onb yo nqd {(A) fp — (A)? 7} 
ap dA 2B] JOWINSd,p ‘xnanjondj [leak] ap sJopour uN yayyjo ua 
189 ([) Is ‘ajqesayoid yuonbasuoo sed yresojquias [J] (‘asepuos 
op uvyd ne a9] SOURIIRA PB] WINUWITUTW ne dIINpal B BYydIOYO 
uo puenb ‘vu ap x1oyo 2 Issne aynsnl aq) ‘osep 
-UOS Op uejd ne JUSWIIANLIAI gsIeIq uOU (A) op INDyeUINsa 
1no} nod (‘1 ap sinayea say guUOP quRIa) a[qIssod oyeuUTU 
onagid souRLeA eR] ajUasidal ‘(¢S6]) equIepoyH asUOWEp 
B® | SuUW0D ‘Inb ay]a0 onb ourgU PT Iso UOISSoIdxa 31190) 


(6) sols. Kee 
N 


Any 7 Le Ny ye ee 
(1,"u+ 2, 2 op adie 


{(A)z- (4)°™ DAV 


‘(P861 JUS 10 [ePURS “6/61 
JaMoIg) Wepuos op ue] nv JUSWdATLIAI YSTeIG UOU USUI 
-onbnoidwAse jo Jnorpaid afapoul ne JUSUIAATILIAI asteIq 
uou stoj ef visa (A)PF#9 7 anbsing ‘qNs sUIWIOD JaNUOUI 
3] yned uC Uy sop ajuepuadapur juowenbno\duisse sa 
‘(1) 9[gpour ne nb isure asepuos ap uvyd ne yusUIAULIOJUOD 
ourlIvA es yso Inb ‘“(Z786[) JoT[NJ 30 Hyesy Jed oruyep 
anb afar ‘{(4) 7 - (A)°29.7} ap (qa) enagid souriea 
eB] ‘Isa snjd in?) ‘aSepuos ap uryd ne ool] souvreA vs vB 
g[qvasi[sau uodey ap onb onqimuoo au ‘ouop ‘ya (A)PF"9 7 
INdBUINSS,| op JuoIpeid ajapour ne d9i] DouRLIRA PI B USL UA 


CE 


anqiUod au (SajUR}SUOD SIPIO JoTUSId Op UOISNIOUL,p Sai] 
-1qeqold say] JUaTUTeU UO J IS) BIN | B UOTIDEI[IS op opoyoUt 
oun. p “1 sap UONRLIRA RT SIOTR ‘SIJLIQA JUSUIO}NeX< 189 (|) 
[IVARI] OP B[apow 9g] Is ‘anb WJ a] Ans asodai inb sauafqoid 
S93] JajuOULINS op UdXOU oIINe UN SuOsOdoJd snoU ‘IOJ “axly 
WOS UOT[HULYSE,| ap a[Ie} eB] oNb juR[NOA JIJ99 No oI]IeI P| 
B SajjauuoNIOdo sd jUdUID}NvX9 JUSIOS SIPIO JaTWaId ap UOTS 
-N[OUL.p sai[iqeqoid say aonb yue[NOA UONIPUOd ke] JoYyoRIOI 
ap ‘sauefqoid say] Journojuod Inod ‘gsodoid e [epuies 
['\(89-Z9 “€861) 


JluR} 19 JOMIIg 19 (06) ORY 19 SsofAvg ‘(6961) sso[Avg 
12 ORY Issne Jay[{nsuod “x sat aUIE.U09 INb 99 ug ‘onbueu 
-91SAS DSCUUO][NULYE ,P SB Ud JUSWdIJII[NoWIed UOWOTIOVJ 
JIUSAINS JUdANAd say[NU SINdTvA SAP “IQ ‘a[[NU ys9 My Sol] 
-Iqeqold sap oun | Is asterq 3sa [I,nb 3a “he ap saqqrey sinoyea 
sop Jed asifiquisap JUSWATIORJ JSO ‘UOT[ULYI,| Op dI[Ie} e] 
oxIj UO puenb sje NsiI sINaT[lou say aUUOp INb In[Vo USUI 
-alleUIpso sa Inb “(EGG Apunsy 19 saye A “EC61 US) (OXS) 
ApUNIH-soye A-UdS Op DoURLIvA PL] OP INayeuINsd [| anb 13) 
-nofe suoanod snou ‘1939 Y] ‘asnalpysey s[qnop uONeUIOS 
dUN dtissao9u UONeSI{NN Ing] aNb yo JaNjeAag & SOTIOUJIpP SW 
-g[e19Uas JUOS *x say aonb Wey ne yUdUUAN Ss]! UaUIaTeUSU 
-epuoy ‘uorenis 33199 9sod anb sjuryoduit saweqoid so] 
atpuojoidde zasse ude] ap sipmie & (966[) [epures **u sap 
SUOTJOUOJ SAP XNap $a}no} JUaNbgsuod Jed yuOs HAYDN 19 LH 
SINIJVUNSS Sop adepuos ap uvyd ne sad] SIURTIVA So] 


le20e=4 
: ff) Al if d 
(3) “tua ~ fo] tr — ty) = (APPL 
I-f N 
:]U91]qQO 


uo Hee suep "3 uonenbs | sed ie sory dual uo] is anb ay0s 
ap ‘'2 sap inajooa of isa 3 no ‘(ayy + d(x) = (4) 
‘QOIJUI9A 189 ([) UOIssaldxs,| 1g —“uOT[MURYDE,, sURp Y¥ 
1a ( saytun sap uoIsn{oUT,p autofuod ayiqeqoad vy isa “ano 


[anal 


*wat) Ka OM io 
Lah iA 


1so (4)"4 ) ap a8epuos op urd ne sei] souRLIeA 
Bl ‘ue UOTINURYDE,| ep JNdAIJa,| OXIJ UO,| I ‘Jhorpgud 
J[QPOUL NV JUDUIDANLIII JUSIDYOO Jo gsteIq uOU J ap Ina} 
-Buun}se Ino} auasgudar OF g no MM Y{(K) TL - (X)L} 
+ (A) 4 7 = = (K)PT40 J zed guasaidaz ang jnod inayeunse [21 
uQ re % DULIOJUOS JHoIpaid ajQpour ne JUSWAANEIAI asTeIq 
UOU OAYH Inayeurnsa 3no} ap ajjao anb sure ‘(4)“4# 7 ap 
a8epuos op urd ne aol] souRLIRA | P1OgE,P SUOIEPISUO> 


(2) Cue - ely - 


HNAWaAd GONVIAVA LA 
HOVAGNOS AG NVWId AV CHT HONVIAVA “f 


WIS g ed SOY suosdy 
-uosgidai snou ‘juowiaypiarg *(£) 19S 7 red suosaquas 
-g1da1 9] snou ja onbnayyse aSeyeo ve ANoyeUINse JURUD\UIeU 
op inied e suosayjedde J snou ‘(Z766]) [epurRS 19 aA 
op asvjed Jed sndjyeUINsd Sap 19 (PR61) IUSUA 19 [ePuRS op 


sonbnayjise sinajeuise sap UONdeasiajUT | URIS (A)S°? 7 


666] eiqwacoep ‘ajenbus,p senbiuyoe | 


eel x — Lx 
exe 2 1 Xl X20 1-1) = M 
JUSUDUIWUOU ** AA 
Inod a[nw40} one ouUN Issne 9}SIxa [I ‘sajuaTeAInbg jUOS 
(€) 19 (Z) suotssaidxa say] onbsing ‘yney snjd sauuonuoU 
(Z) uonenbs,| sed ogjuassidal HAYH uoj vs snos 
(A)S° 7 inod aguuop sinu0] eB] w WNpar as “A'M JURId 
IWWIOD IULJap “Uepuodsa0d a8e[eo Jed InayeuNsa,] 12 


(SAGs Cat eal aye 
mExXE ZI, 1), xX) X20 1-5 Wl)? 1, oe 
“MQ 
9UUO = — 9p UOTNIOSII & 
P O= Go oP uonnIoss eT 
Ay u s & io u “me 
XE CT =) 1) °ZCT- | Die= 


quanqo uo ‘* mA 

2p WOHOUOJ UD JURALIgP Ug L2ZCT- {DD sed gorjduias 
189 °Z,- LH enb uondsoxe | 2 ‘(Z661) [epulRs 19 aTI[IANG 
ied a9stnin aspjeo ied uoneunse,| op ajuRLeA sigIWaId P| 
% puodsa109 uONUOJ 99D] ‘seuTUOIpUT sinsyeordn{nw 
ap dx] sous] ap mm9jo0A uN yso ¥ 19 (iu uOISn|OUL,P 
SOSIOAUI SoIqegoid sap u INnd}99A 9] 180 ye. Il = = ‘mm 
“M g8euUoT]QURYde,p splod sop u In91]90A 9] 1S9 “AM NO 


‘COMIX -" LX) NZ+ 


Cm-*s) 0 ZCT- LID, 2 -")=¢ 


1so ogtidoidde uonouoyj vy ‘tol sayorayses sJoefqo sap suly 
xne ‘SIVUL ‘OUTeIQIe BOUR}SIP Op UOTIUOJ OUN,p ‘«a]TWIXOId» 
R] uljap Inod ‘yas as UG “INaLIa ouUNONe.p sayorjiUd 
WOS ou splod sao sed aluljJap uOT]HUeYSE,p UOTRWINSA,| 
‘y Op SouUO[OD sap s[qeueA onbeyos Inod ‘anb uontpuoos e| 
yuesodut uo ‘1 sop gtqissod onb «aysoid» Issne inayeA oun 
asevuUo][NULYoE,p sprod xne JoUUOp kB dIIP-k-1S9,9 (7661) 
[epules 39 a[IAOq ap dse[Vo np spoyjow vy] sanbijdde e 
d}SISUOD Pad INIJVUI}Sd | Jo[NoTeo op UdAOU! ane UP) 
‘sareyNos sypeuuoNIOdold ay] e] 11Uu9}qQ0 ,.p 
emouuad ‘2 = '2 x10yo 9] soye “x ap souuojoo sap arreour] 
uOsIeUIqUIOS oUN ‘Z Op °Z SIUSUIPI SP] SNO} k aa 
-1odo1d yuos sjIp juatuardord "n Soy (II 9 ed = 
onb uarq Is ‘aylun., @ JUSWdATeIedWIOD salqrey saqnol 
UOS SoT]JO (II “(HAYH Anayewnsa,| ap asepuos ap ueyd ne 
SANLAI SOURLIVA P| LUNUITUILU Ne OJINPal B JURSIA Ud) *' xne 
soffouuonsodoid yuatos saya ,nb 30 eB UOSdSe} ap SdIStOYyd JUOS 
‘u Soy (LIS ‘sJarfnonsed yg19]uUI UN ajuasgid seoupye orsg 
routxoidde nad wah ‘aiqissod anb , ‘pn xne spouuonsodosd 
ISSNv JUSIOS 14k it) SOULIO} SO] Snb 80 B SUOSIA SNOU Is 
“STULL ‘oUTeANIQIe nod anbjanb Q109U9 189 “ZF Op TOY? aa 
“sinbos qso jr oumU09 “("“y - . “WD 1 


=10,0 39 IZ 1=/X_CX/X) X/Z,1 anb sus ap 
TZ PBI Ne CROKE ZX ONG OX 


WA “CI- ID °Z 7X 1-CX.X) XZ, T= 0,0 .CX,X) 
“XZ I= »D anbsind ‘anno uq ee ae AD; ‘ay = ‘O 
JOA asinbou uonoafoid op suwu0j el apassod mnb 


“RCT 2 


Ae 7 xe XC Lee ZX 
‘s1o]e “IVD ° x @p SouO[OD sap azTegUT] 
UOSIRUIQUIOD 93N0} silesgides Dp X= ae yay) ee gyeu 
-OSPIP SOLU BT ISO "ZF No ‘(“T- . PD “7, red Aah Ina\oey 
3] Joovjdural ap 9 Vv suep sastiduios uoyqnueys9 .P sangyea 
soy anb yuaNUOd au " Y NO ‘ eee WexnG bis, “WiX)= od 
‘q op gsieiq uou oiIeoul| imajeuinsa Indqyrow Np JIAIOS 
9s ap ‘aduuts snyd jo sovoryya snyd isa |] ‘sieiNsa1 suog ap 
sed ouuop ou aJa,nb anbiput uo (9g uoNdes BI B S}LIdap xndo 
® Soqe[quias) syuanbasqns sanbisidura s3saq say ste ‘sayy 
-USWINIISUI SOTQRLIA SOP JURSI[IN Ud JeI[NSaI 9d ITUA}qQO ,.p 

jueyoutiod apoyjsw sun gsodoid e& (C66[) JoMaIg 
“sinbai qs9 [I SUIWIOO ‘ OF 

C40,-CX,0) x-A1, 0: De CMY YP OCH ny 1 
anb uaiq Is ‘(“y - - “WD t =°0,0 anb jar‘, suototaddie 
snou onb sousl] ap rn un Teys1xe s1oye HOP [I ro O 
dp sausI] sap soedsa [14ND . I - LID: I puenb ojrejsnes 
19 UOIIPUODS 9109 “47 O,_CX, ‘%) JULIO} BI Op 189 pe 
ap uonoafosd ev] aonb asoddns uo] 1s ‘Q= (ae x='4) 

(fiqe toe, L IS sajesea 1uos (¢) 19 (Z) suoIssaidxo Seni 
(8661) neuueg 12 YUL lulyep 10 nb ‘steiq 
3] Side .p sfapour a] sed ages ‘ajatidoid ey] Issne apassod 
(£)S°° 7 -arepuooes ascyeur| ap svo a] Suep JUsWanbrun 
asod 9s a][aNUSAS SATIRULIOJUT dINJeU INE] ap UONsonb zy] 
anb uatrq Is ‘uoT[HUeYdE | anb saoinos sane .p a1 aJgnbua | 
ap uondsouos x] ap gsieyo aysijetoads a] aonb sinayea sop 
Jed juowasenus SOSUTULIAI9P 1UOS UOISN[OUL,P saiyiqeqoid 
sao aonb tor asoddns ug ° ‘uw eseuuoy[nueyos P soiyiqeqoid 
sap UX U d[eUOSRIP SOLNVUI BI ISO “ {J 19 ui) yop Helis 
meyeunsa,, se (K)SP 7 TXL= Xp 1 (A)L=A4T 
anb aos ap] soiejusuatddns sajqeuea op ‘juaUoA 
-noedsai uoy[Nueyse | nod 39 uonrjndod xy] nod ‘dxu ja 
dx N $a}Q[du09 saomneul say juos “x 19 X ‘A ap sungyea sap 
uo[[MURYD9,p 19 UONe[Ndod ap sunaj9—aA sat juos “A Ja A no 


(€) Sa GX qlaX wee side 


(@Qpiee s1OXe I epaik! P.e4 1 Daa 7 


‘onb yp juowaNe 
‘salesa JUSWONbDLUSUINU JUSIOS HAYH Ansyewinsa | 9p (OL61 
[JeAoy) eannoiped 39 sireUIpIo sauLIOJ say anb Jar ‘SO J ‘g 
9p INayeuINsa uN a4s1Xa [I,nb a81xa anbneyjsa aysodde ,7 
“QOURLIRA BP] Op SUOTIBU 
-1]S9,P I[QVUUOSTe BOYOINOJ ouN JUSWIT[aNIIQvy OUUOP | 39 
SL‘O ‘SO = A SuNg[eA SION soy Inod sjapow! np UONNOsSal VT 
“sauun Sajjad ap samoyegye syesoise sap SUIWIOD JUdLIOdWIOD 
aS SoIUN SapuvIS Sa] NO UOTeNIIS RT Be puodsai0S ¢‘Q = A 
INa[BA BT “jULISUOD $9 "3 uomeuea ap quaratyjooo a] ‘[ =A 
IS “[ 18 SQ agua stiduios 3sa A NO ‘,,2 SUOSIP ‘a][Te1 Op 
dInsou sun ,p sauUOp sourssind oun ke spauuoNsodo.d juos 


soyeBeul ayiqeqoid one eHeuuO|iJUeYOS,| ap Sed 9] SUeP ENbijaujse aBeyeo 87 eMelg PAA 


eyeNsny ‘OOZO LOW ‘AMSIOAIUA) [PUONEN uvITesny ‘ad1aWIWIOD pur soruouosg Jo Aj[novy ‘SOMaWOUOdY pur sonsneis jo juouedag ‘Imag MWY 


p sa aonb rasoddns ap juanbesjut sed jsa_,u [J (1) Jagpoul np 
piesai Ud “‘oJa ‘QOURLIVA FJ B ‘STRIQ 9p VoUaSQR | B UOISN][e 
UOJ «JNOIpaid sfepoul ne sol] BOULLIVA» Jd «fOIpaid poe 
NV JUSWIDANRIAI YSTeIq UOU» SUILUOS suoissaidxa sap ‘ 
suOSI]IN say snou onb sayjay, “wed ( 'n) Seip Issne suo]a} 
suosoiel SNON ‘sonuuod sagsoddns sinapuvis sap juos 
'n Sa] Ja onuUODUT aIIe[ROS INopuRIS oUN Iso on ‘ssonbipul 
sgjyatidoid say queAe osloyegye Indwa oun Lay laf guun | 
Inod saaneoydxa sajqeuea sop d Indjd9A uN jsd “X NO 


¢ By ahGN? cell ESS. 
G) f#¥a 0= Ca's)*g ‘0,0 = %y 


ince ae mg ent 

UBAINS UONdIpsid 
ap NO UOISSaIse1 Op ajepour a] Jed satewrxoidde jusW 
-d]QeUuUOsSTel UOSe] Op d}LIO9p Iso BQUUOT[HURYSE UONe[Ndod 
ey aonb suosasoddns snou ‘aponse | ap squiasud | sued 


ANOILAHLSA ADVIVO AT 
VY INVNAW SHHOOUddV XNAG SAT “7 


‘yda0u0d 9] suON|eAg 
SnoU ‘/ UOTIOAS RP] & ‘UIJUA ‘soINoIJJIp sourejsso asod tnb 
souual[ensne sapoouse sasudenuea soy ins saguuop ap 21q 
-asud un saide .p sasijvai onbiidura apnia oun ,p syeq[ nso 
Sa] suojuaseid snou ‘9 UOTIIeS BT WY ‘SeTqrej juaUIaTqeidas 
-OeUI ste ‘sjryIsod uarq no syneSeu UONeIapuod op squaroTy 
-J909 sop swig] qoid 9] Ja}UOWLINs ap a[lOvJ JUOUTBUUO}E 3S9 [I 
‘anbnayise osv[evo ne LNOodeI UO | Is ‘anb suoUOW snou ‘¢ 
uoldes BT VY ‘JooIpeid ojepou nv dai] soueLRA es ‘Pp UOIDIS 
BL & 10 ‘anbneyyso oS8ejeo e Ino}eWINSa,| ap oSepuos 


X 


I 


ap urvjd ne ddl] ourleA ev] SUOUTWUeXa snou ‘¢ UOT}DeS 
RP] V ‘setquedwos ywuos sajjoa,nb suomMuoU! snou ja ‘ase[eo 
red uoneumsa,] ap 12 onbnayise uoneWNsa,| op sayooidde 
Sd] SOUSI] SOPURIS Sd] SUP SUOALID9P SNOU ‘7 UOTIDES P| 
V ‘sayesoul soiyiqeqoid sone aseuUo][nuRYyod | & UONKSI[eI 
-2U98 B] SUOIEpISUOD snoU ‘aoTe JUasoid 9] sue “syMENs 
[duis aroyegye aseuUO][HULYE,| Bp Svd So] suep anbHaIs9 
asv[eo np Joynonied seo a sen ek (666[) Jomarg 
‘onbyayjso asv[eo & SINa}eUINSa,p WOU d] suUOUUOp 
snou sjanbxne sinayeunsa .p d1039}e9 31199 IDI SUOIIIDEP 
SNON ‘onbreyjse Inayeuysd uN JUSWaTes9 IUsAOp Inod 
UONPIIJIpoU d1asg] uN nb ayissao9u ou INb (9/ 6] UPUNIOIAA 
yO [epules ‘Jassed) OWAYO asiyeigues uolssaise1 op 
INayBUINSd | ap Jotpnonsed seo un jsa juasodoid sjt nb aseyes 
ap sInayeull}sa sop sduuts snd a] “LH sprod say 1a asey[eo ap 
Splod sa] a1]Ud S9OUDIOIJIP Sop so1gpuod SUIWIOS PR] JUST 
-IUIW [BPUIRS 19 SI[IAOq ‘e]90 INOg “'u ‘apo JotWeld ap 
UOISNJOUT.p saqTIqeqoud sap *,'w ‘sasJOAUT soy ‘Ip JUsANNE 
‘(ZS6[ uosdwoy] 19 ZHAIOH) (LH) uosdwoyy-zWAloy 
op sptod sap sayooidde.s jusAlop sseuuo][nueyos .p 
splod sa] ‘suo][HURYd9 SpuvIs ap Inod ‘anb yreJ ay UNUIWIOD 
Ud JUO SOJULLIVA Sd) “AaSRTLO Np DULY} J] INS sowULIvA 
OP SIQUIOU UIR}IIO UN LISP UO (ZHGT) [EPUILS 19 JIANG 
‘anbnauise Inayewinse 
un drinsuOd ANod (G66 |) Jamorg Jed sasodoid spoujsu P| 
OP IdIOI[SUIV UOISIOA OUN IOI SUOJUaSsaId SNON “ed aryNe.p 
‘jnoIpeid sjepow un Ins jo ‘4ed oun .p ‘asepuos ap uvyd 9] 
INS 9PUOJ JULID SWIUUOD JUDIE] INR] Ja}gIdiajut jned uo | anb 
INdJBWINSd UN 4sa onbIVYIso INdyeUINSS UA) “(PR6T) SUM 
}9 Jepuses sed sgsodoid 919 & anbysuisa uONeUIIsd /T 


NOILONGOUINI ‘T 


‘UOISSoIS9I Jed UONeUINSS ‘JHOIpsid sfapour 


uN Ins d9pUoJ UONeUIT}Sa ‘sJHeSou UOU sprod ‘asepuoOs ap ue{d Z| Ins sa9puoJ UONeUINSE ‘onagid soURURA :SATO SLOW 


“SQUUSTTRISNV 


Sa[OLIBe SUOT]L}IO[dXa Sa] Ins sagUUOP 9p USKOUL Ne sanjeag jso onbHaUISa BSETLO & SINa}eUT}sa sap onburtdula gyovdyJa J 
‘gjqiey do aatjisod inayea B xnao onb Isure ‘synesou asevuuo[[Hueyoe ,p spiod say sovayyo 39 ajdurls uodey op JoUTUITTS .p 
yousod [rnb yey nev juan onbysyjsa oseyeo np onagidut uoneordde sup ‘Jnoipeid sjapour ne soi] ouLLIRA P] (NO) Jo soURLIBA 
9}}99 Josep aiidoidde snjd 3sa [r,nb a}10s op ‘anagid soueLIeA LI INS ddUONIJUL oUNONe JUO,U UOISNOUT,p sait{Iqeqoid 
SQ] ‘advTeD Ina] Inod gsipHn Jnorpeid sJapoul NP SUOTIPUOD Sg] SULP ‘sIOJa]INOJ, ‘sayUoUTLIOd dIPIO OUIQIXNEp op UOTSNJOUT,p 
sayiqeqoid sa] ayeuUuod sues osepuUos op uUe{d Ne ddI| DOULA INI] JOWUNSd JnNad dU UO ‘sast]eI9USS UOISSOIS9I Op SINDeUINSS 
Sap d[QUIAasUd-sNos UN jUd}UaSaId91 sanbNSY}se sINoyeUINse soy anbsing ‘oseTed ap afduris spouiaut oun Jed UaWIO}DaIIPUT NO 
INIIJCUINS ,P SOWIO] XNIP $99 JURST[LS9 UD “JUSW9}OIIIP a[NULIOJ es I[qui9 nad UE ‘JHoIpeid sjapour un Ins gpuoy Inayeurnsa 
UN OUIWIOD }9 ASepuUos ap uL]d 9] INs 9PUOJ INa}LLUTSO UN DUILIOD SIO] PT Be aJQIdIOWUT,s anbyaYyIsa INJeUINSA | ‘UOTTULSP Jeg 


aWwnsay 


rod MaAae MU 


Sa[BSOUI SaTIGeqoid daAv 
ISVUUO[[MULYI,| IP S¥d a] SUBP ONDIVVYIS9 93RIB) OT 


Lé?e 


epeueg anbijsiels 
6€7c-Le7 ‘dd ‘2 ,u ‘SZ |OA 
666 eiquiadep ‘ajenbus,p senbiuyos | 


‘VIP Iy (99 ‘uounio0ssy 1091 
ISUDIG UDILIAaULY ay] fO JDUINOL *dYeUN{S9 poyedt{duio9 & JO JdULLIeA 
oy) Sunewutxoidde 10} poyjow adurts Y “([L61) ‘SU ‘AANUGOOM 
‘rosuuds :y10X 
MON “UONDUNST AIUDIUDA 0] UOYINPOAUT (S861) WS SYALIOM 
“‘BELIOA-IOSULIdS :YIOX MON ‘SUuajdiung Kaaing pajsissy Japow 
(7661) “f ‘NVALAYM 1 “Ad ‘NOSSNAMS “S-O “TVGNUYS 


Sexe|dwoo sinayewijse sep ja sanbiysiyejs Sap inod soueUeA ap UONVEWIISA :a||IAeq 


‘OLL-8PL 19 LOE-ELE ‘Ep ‘SousuDIg joUDUaYID| fo spouUy 
‘T] 19 | Sutjdwies aatssaoons 10} A1o9y} oNOWdWIAsY (ZL61) A ‘NASOU 


‘DIIMOUOIT *ISS2SNQO! 3d 
enbijguiesed-uou anbnsneig (L861) “Hd ‘ISSV.L19 “df ‘AALOOOTT 


‘96-68 ‘LL “UONDIIOSSY JDINSIDIS 
updldauy ay) fo Joudnor ‘japout uoneindodisdns uorssoiso1 
ay} Jopun usisap AsaIng (7861) WM “YATINAA 19 “LO ‘DIVSI 


O&e 


“KOTIM, SYIOX MAN ‘Uo 9UNY aouan| fu] 
ay] uo paspg yovoiddy ay ‘sousuvig Isngoy “(S861) “MW 
“THHVLS 19 ‘f'd “MNAASSNON “d “LLLAHONOY “U's “THA NVH 


PLE-19E ‘°C ‘saquaing fo Kwappoy unlupsuny ay fo ajnjijsuy 
jooyouiyioyy ayy fo suoivoyqng ‘uonetndod a1uy e woly 
surjdures wopurs [dus ur suonnqmysip suntury (0961) ‘f “MalyH 

‘69T-TIT “SI ‘gf Kla190¢ JooUsuDIS 
jokoy ayi fo Jousnor ‘santyiqeqoid jenboun yim pajoojes 
are sjrun uaym Aloay) Sulpdures ul siMsar awWOS “(€S61) ‘¢ ‘NIGUAd 

‘OCOI-ELOI “88 “WoUDIIOSSY [DISIIDIS UDIUaUYy 

ayl fo joudnor ‘Sutjdures AdAins ul soinpsooid Suryel pazipesouey 
‘(€661) ‘O ‘AYOLAVS 1 “dD “IVANUYS “O-f “ATIIATG 

‘T8E-OLE ‘LB ‘UOUDIIOSSY 

[PINSNDIG ubdIMauUy ayi fo JouAnor “Burjdues AdAIns Ul 
sioyeuN}sa UONBIQYRD (7661) “A-D “TVANUYS 19 “D-'f ‘ATTIAAG 

‘IL-0L-69 ‘SAGCOHLAW FASNI ‘sanbusunig aisojopoyi2aw 
ap Saauinor sap sajoy sueq ‘asepuos sed 9ginsoul IUID 
OP ISIDIJ909 Np sduBLURA PR] 9p UONeWINSY (L661) ‘O-'f ‘ATMAAC 

“SINN-AASNI ‘ousolUr JuoWINDOG ‘soURTIRA 
Op UOHPUINSS,P IJESIOAIUN sINWIOJ BU) “(€661) ‘O-'f “ATMA 
“KOPIN IOK 
MON ‘UOHIPe pig ‘sanbiuysay Surjdures (L261) “A ‘NVYHOOO 
‘T8S-LLS ‘6L ‘VylAJawolg ‘uoHoUNny 
uoNgisip uonetndod ay1uy oy} Jo sioyeuINsa Jo sonsodoig 
(7661) ‘d “TIVH  “H'V ‘NVWAeOd “TU ‘SYaaNVHO 
“EPOI-SEOI “68 “UOMDIIOSSY ]DINISIDIG UDIMAWUY 
ay) fo Jousnog ‘SKJAINS Xd{dWIOd WOIJ UOCWINSS [PAIOIUL 10] 
suonouny Sunewnsa Jo asf “(P661) “Z “MV.LVd 1° “Vd ‘UACNIG 
‘SS-IP 
‘ey ‘sousynis j019uf{E fo jouanor ‘yoeoidde suonenba suneuinss 
ou, :uoyezuejod pue Ajyenboul owWooUul JO sodinsvou 10} 
uoneuinse souBLe A (L661) ‘SW ‘OIAdQVAOM 19 “Vd ‘YaAGNId 
7Z67-6LT ‘TS ‘anbusiwis 
ap ajouoyvusajuy anaay “SKOAINS Xo[duI0d WOT s1O}eUIT}SS 
[ewuou ATfeonojdwiAse Jo soouvweA 94) UD (E861) Vd ‘MACGNIG 


‘KOTLAA SYIOX MON 
‘saunsvay Myiqogord fo aauassaauoy (6961) ‘d ‘AA TSONITIA 


HAd VaASOITsl a 


‘uorlsuayoiduios es nod jeuinof np uonoepal ev] 19 spore 
100 OP SIIIGISI] BP] & aNqiMUOS JUOWId}IOJ JUO sanbreural 
so] JuOp ,.ajanbuq,p anbiuysa],, Ip Seige xnap soy USUI 
-9[V39 IOIOUIDI Of “JOIUIAP 99 B ANP 1sd / UOTIDAS Np Ingap 
Np UONLINSUOUIAOP IT °9}X9} 90 ap SoleUTWITSId SUOTSIOA 
SOSIOAIP SP S]ULT[IOAUDIG 39 SOND SoiTeJUSUTUOD SINIy 
Inod 9I[LL SOA X 39 AIONVS IJBIAIO JIOIOWII & SudT} oF 


SINGHINGD Yona 


6c¢ 


‘uosdwioy ]-ZWAIOY op Inayeurjsd ,| Jed 9WINSea [e10) uN .p 
J] [2O & OUQUIPI 9S DOURLIVA Op UOTJRWINSA | Satfonbxne sovI3 
SOVSLIVAUT] SA[QRLIVA Sap JUSWIaTduIIs Zasse I1Ud}GO ,p JouLIod 
uoTONSUOD INI] JUaUIBANOS Inb sanbiiqasye sa[se1 sop 
}2 DOUINIJUI,P SUOTOUOJ Sap asesSn | ‘UOTNINsQns Jed sinoyeul 
-IIS9 Sap assed adIv] eT Inod “uepusdag ‘sdgsteaUT] ong 
Inod saxajdwios don surw0s sanbysiye}s souteyiao a1Qgpisuosd 
uo nb yeJ ne ynowns snp 3sd UOT[HURYdSE,p sUuONRdI|doI 
Sop Ins soaseq sapoyjowW sap on30A eT ‘INo}eWINSa,p 
adAj yonb ayodurt.u ev 3a asepuOs op uvyd janb ayoduwt ,u 
e ‘Joynonsed ua ‘anbijdde.s apoyysw onag ‘oouRLIeA 
ap uoneUIsa oun IIua}qo ud Inod ayqisusysidwios sny{d 
eI 10 a[dnos snyjd vj apoujaur ey ouTUOD ‘sdwia\3u0] sindap 
‘QQ19PISUOD ISd Saxa[dwiod sanbysneis sap UONeSsLIesUl] BT 


NOISNTONOO ‘Fl 


‘g]duits sd 9}S9I 9] 19 ny xX = n (XD) = "DJ 


uonejal ey =o juesyjn =—sua—(isés "~—soSTROUTE ~§=—s UO 


4 
v Sal ieee 


Uy Geaue pe 
heh 


JUOS Spot1ojoRJ suey sa] ins JyejUuasaidal 
juiod uos ap saguUOpI0OS sat ‘’AV JudasjJo,p uonejndod 
-snos dun sd Y Ig ‘Jalo}ORJ URTd uN Ins UOTDefoId oun .p 
DNIQvlea e] JURTNO[ed ud asAyeue | JonuNUOD yned UG 


d d d 
Aon ram x nx 


:A Soidoid sindjO9A Sane So] 

Ins NJ ap sajuRsOdWiod so] 1U9I}GO UO UOdSe} dUIQUI BT 9G 
id= YW euo | = Anod onb esaryLI9A UG ‘opueIs snd 
RI Issne ysa inb | oidoid ingyea ey e g1o0sse aidoid 1nd}990A 
So [ =n onb yes uQ “4 10 1 ap (aiuRsodulos sed ques 
-Odwi09 diIp-R-1S9 9) prewepe} .p ynpold a] susIsap 4gn No 


0) 


N 
ea nq, 


d d \\N 
NOte = Ne T = (XY 
d vé / 


:n xed yuerdnynueid ua 
ju9Ngo UO ‘Y= NG," 10 ‘x BeIp = G] ‘,xX = DI suWIOD 


‘0 = 1 (avd - dD) - Maya - dvd - OD 


SQOUSNIJUI OUD UONR[AI LI & UC ‘UoUWEpsogid aonb urways 
QUIQUI 9] JINS 7 Jd Y INod agsueRgUI] OUN,p BYoIOYoOI eT] 

Fe Pee a) 

Ag us oe ee) 
nog=nqyd—- np) ‘soidoid =sinayea xne owelqoid 


666]. eiquiadep ‘ajeanbuse,p sanbiuyos | 


J] AIpNosal & Npuod 19a_Q ‘asreuuoNes wos n "x ds] = "9 
op souenea ey onb sjay "x Seip 7% = "x 9% Beip=q sone 
‘T=nq,nNad/{ sed sguiiou n sinaj99A Say SIOTe aByoIaYO 
uO ‘¥ Ino} Inod d= [7x v uO ‘| qUaTeA sajURsodWIOD so] 
$91NO} JUOP 1N9}D9A J] OUBISAP T IS (OAV. Op Sed a] suep 
Z) soarjeyyenb safqeuea d ap saylfepow xne soueuapyedde .p 
SOOLIIVOIPUI So] «apIdwia» Inb *x Imaj}o9A 9] Jed gstgjOVIED 
}S9 NPIAIpur onbeyo ‘(je1guas snjd a] seo) FOV. 1n0d 
“ONSOTeUL JUSUIDIIEL) 
un .p safqudassns juos (YOY) satdnjnu ssourpuodsa109 
sop ascyeur | no (DV) ssourpuodsaoo sap asdjeur J 


Cues ae Kan 
Daath WM) 
:OUOp s) 
EAA hi 
Soe) 
:N0 .p 


0 = (mp,4)¥ - (mp,a)"Y + NOLA 

JUSTIA [J “4 Jed ayones & ([°¢][) UoNeNbs | suoldn[nyy 
‘2 ep aidoid juowela anne un (4‘“yY) WOS ‘anZoyeue 

uodse} Op JUIIGO,S 1 ap sajyuesOdUIOD Sap sdURLIvA eT 
‘0 =NY- NZD 2p uoNN[os Y op VdURLIeA BI Op [NITeO 
3] WNpep us UC ‘(7 “Y) audosd juowIg|9 | B 91I90sse oediouLd 
ajuesodwos ev] Isa 9 NO ~2Y & [esa Isa (XY - xX)" JO 

AX 2), = Vi= MOL 

‘JUSIA [L 1 
Jed ayones e ({°¢]) Jueldnynw ugq ‘onbuyawis souyew oun 
sa 9 anb sored Q = nyj,n aonb swgui ap ‘9 = 7 ,(n/) SIR 


(T’€T) O=X-"YI- D+] 
yso NY — ND op souenyjul.T CX - Y(X - ) = (OI 

so 9) 4«6Op § «(aouantjul,y ‘JUowslduis zasse usu 

-U911GO .S 1 Np sajURSOdUWOd Sap JI]99 19 Y OP DOURLIVA VT 


[=n,n 
ye) 

:UOP WATJLIDA ST], XX - Ix*x9{= 9 
SOOURLIVAOD Sap sdINIeU BT op n soidoid S1N9199A S29] JUOS 
Ty Q][PL01O9A JIQuleA ev] ap Soedtoutd sajyuesodwioo say 


‘aidoid inapea Y 99Ae 


SATTHITMOLIVA SHGOHLYIN “eT 


(ZZ s[NUWIOJ) LH op Anayeurnss | sed 
S9UITISS B[QUVIIVA 91}99 OP [VIO] NP DOULA L[ B[NO[VO UO jo 


rs in She A CARTE 
neal pny i ae ey TES Ie, 


il a 
(Gig pg 


ap uoneurtxoidde | ‘[noyeo a] suep ‘aslHNUGQ = — 


sexe|dwood sinayewljse sap je senbiysiejs sep inod soueUeA ap UONEWIISQ :9al|IAeG 


‘yuowloypiored “g 19 
paceibehcy| 


1 EC 2 y 


aed ouInse 1860 yo = 
‘quaweanoedsal « 39 x ap uoN 


-edol op SUOTIOUOJ SOP SINSJEUNSS Sa] JUOS Pe jo vi = 
(1 ‘ ty) ATS 


LOJURAINS UOSRJ Ll OP ONJOJJa,S DOURLIVA OP [NO[Vd aT 


Tz 4s9 gstRoUl| aiquuren ey = 
G Tipe ONE TaN ot IN , 
[(f++}P- see fay za Xx) AT 


‘UYU NO.P 


i) 


x5) 37 
x 
wk 
x 
gsod & uo no 


‘g F VY a See e 


(WQ)wp(Us OL iy + 


(UWP YQSHIf + Ya = COL 
:8 UO 


‘(u) WP , Wes 4y f = LL nog ‘aouanyjut,p suoMoUo} xne saAnejal 
SOSA So] quenbidde Ud dSLIROUT] 9S UOISsaIdxa aad 


G P bee 8 eN 
Gem aA a el alearg |G 
SUS IE suoneo 
-tjduuis sap seide ‘asp-e-1sa,9 *"y 10 7y enue uone[a09 
QP IUSLD1JJ209 a] 1sa Sues op Uoneysiloo ap UCC Se 
RCS "Sx 
aT CG onp [= cu lo (yp |= © OI1199 S$ 
yuaanod juawraanoedsar 1 yo "x ap sSuvl soy *y NPIAIPUL | 
@ soayorne quos “ yo x sanbugumnu safqeuea xnoq 
‘][epusy ep Suvi sp uoNe[ao0o ap ualoyya0g (9 
Here IS ONS do Gost gis 
CO 
Cid) 
1g 5 "x Is | nea nb oyparortze o[qeuea v op opre | & 
JUSWO[dUIIS DUOP BIO[NITVO 9S INDJLOIPUL | 9p SOULLIVA LT 
‘9 = "7 uatq aanon uo | = g nog 


Cd Al 
(19) A 


0 D D N 
(CAg)q-0)+C15x)] = CN ehh eg 


1). N N 
é poll "1D - hee aie 


je 
D2CI>X)P) 
et cig 19) .4 | 


(x) "7C1d) a+ 00 ar = 08 ¢7 


8ce 


‘uoledal op uoNDUO} 
| IP IdALJap PI ap N19 | Inod uoMUaAUOD PI 19 9 oydeIs 
-vied np So]sal So] JURST]N Ud IOS Op RA UONRSLIVOUT] PT 

ul = g = 0 & puodsaioo janiiqey 

inayeorpul,T “(7_)y = °"¢ AMayworpul,| suorpmg 39 | 

12 () asJUA SLIduIOD saquioU xnap g Jd 0 110s ‘sprod uog arte} 

INO ‘UONNGLSIP B] Ip DULIPSW Pv] Op SIO LI & SINOLIQJUI 
(snudadl sap) uonlodoid vy sWWIOD dIUTJap 389 sI[q 

‘goraned ap [Inas np snossap ua uonrindog (q 


(x) 4 = “INIDI 


ax 
7, INIO > of ie 
:OQUOP 1$9 [NJ Jnod sgsuesuly 
uy) (xX -X)', oUOp 3s9 sINaIeIgUINU sp sesSTILgUIT 
RI ‘ayURISUOD oUN Iso _Y SUIWIOD “x ke sInotIgJuI "x sap 
auuasoul eB] sa “x NO “x"T - X= Q)WP(X> 3)13) - xX 
= (2) NPQ5X)T2f 10 Q)WPQ > 13) + “Lx anareagunu 
np souenyjur inod asanon uo ‘¢ aseI ey yuenbijdde uq 


Fan Gene ENED) 
(ONP LXJ 
ved TLD 
ap solpul,| suLysp nad uo (3) WP(x>3)TJ = LE 92AV 
INID 9p sorpuy (e 
‘sajduioxa sanbyanb suoipuaid snoN 


SONVYA XNV 
SHUT SATTANNOILONOd SAALAV 
LH NOILVYLINAONOD Ad SHOIGNI “CL 


“9svUUO][HUeYSE ,.p suON 
-ENJON[J XNV I[QISUDSUI JUSLULSTJJNS JOS INa}oR} JorWWId 9] 
(dq - (Dd 
Bet eg eee 
COE 25)) 0) Dg = 2 
suep 
aonb inod o81e] jusuIUeSTyJNs ong eiAop [q ‘e] a][eAIOIUL,T 


(Y()4 - (QA 
(0 - (15 *9) I) —————-- = 2 
D=q 
[BIOS 9}991109 JUdWONbHvId astesUl] I[quluVA ouU_) “(ATIe} 
-Iqie SuIOU no snd x JULUD}UOD J][eAIOVUI UN Ysa [g ‘P] NO) 


Deng 
(q>15 Dy ag = ('X)¥ 
JOAR 
DM 
Nid 
(0 - (75 ra 20) 
agSlIVOUI] 
J[QVULA LI JOSI[NN & dJSISUOD 9)XTU SIOA UL) “OUIQUI-IN] 
”) ap uonesuesury ey nod saneutxosdde uosey ap sastjun ane 
eunod yo Jarpnonied awiefqoid unone ouop asod au °%7 ap 
uoneslvauly ey ‘tulyap juswoyeyied yso (°%7) 77 aonb said 
1090 & (Z “[[) B aNSoyeur juowWa}g[duI09 Isa a[NULIOJ BNBD 


Lee 


N22) ta 
py 


(p11) (DoF ))9) -= Qu 


"8 UO (WURI9,] D) IQeALIgp 1S9 * 7 WWOD 
‘(TL 1) & onsoyeue ye & 1n0} ysa Inb 39 


IN 
(C11) (@)"4-@ WE Q(x)" DI 


:OUOP B UE 
Wi haaG = N ‘ x” 
Ce ents APG XDD J = "A 


‘Issne e uO Nb e1d}0U UO 
anied sed uoneisajul oun saidy “asstuljap say Uo JUOp UddSeJ 
RB] wos onb ajanb ”y sap surstoa ya onboatun uodey ap sluLap 
quos "7 saynovsy soy sno} anb a110s op »f ap SUISIOA San 1a ‘| 
IU Q IU INVA JU JJ NO JUIOd jn Ud JJULSSTOID JUDWIJOLS SO 
* J ‘Y ep a[qeuuostes x1oyo un nog IPI 'X) YA J = 2)" 
asesst] uos red uonnsedai ap uonouoj ey suodseldwoay 

‘N O9A® BJoNUTUUIp (“*x)y op yoddns np «auuaKou» 
INISIL] Ll DIIP-R-1S9,9 ‘«apueg op INIsIe]» ve] ‘uoNeindod 
el Op N aylei ve] ep eipuodap y neAou 9] ‘anb0jdwiAse 
anbndo oun sueq ‘uonniedsi ap uonouoj oun 4s9 (ix) 9D 
‘(U'x) 9 - [| =(1'X) 9 10 np (n‘x) yf = G‘X)D B1O]0U UC “x JURU 
-9]U09 d][PAIJOIUI UN vias (° ‘x)y op woddns 9] JuoWTeI9Ugs 
SN[q ‘X JURINOJUD SI[VAIOIUL UN,P SaSI[LWIOU DOLNLOIPUT, | 
a[dwoxe sed ‘x ap inoyne «aydO[d» Ud UONDUOJ oUN 4sd (“*X)y 
‘x jno} Inog ‘(afdwxe sed s[qeAap JUSWIWIESIJJNS) I] 
-nsaijo ‘| = Ip(s ‘x)y f “x Ino. Inod ques ‘(7 x) y eantsod 
uOoTOUOJ OUN ‘UOTIUTJap Jed ‘sa JURSIe[NsaI NeAOU UA) 
:O]UBAINS 
uoTJONIySUOD eR] Jed ay[NOIJJIp 999 IUsAUODIID ned UG 
“SIoI[eOsa 
sop osneo e sed ajsixa,u ayjanbey x Jurod ne afqeiea eb] 
ap aiisuap oun asieapr (x),.7 aonb wey np quata owigyqoid aT 


(CID) 


(0-15 %1 


re 


‘eles 


seg mer) 
Fe COI 


"CD AI [> =e 
[- 


:QUOP 189 D0Y pe saslRoUT] 
J|QULIRA RT ‘[eINIG 1S9 UO IS °Yf IP SULIOJLIDI[VOSa 919}0RIRO 
np aiduioo quan uo Is (77). 5 0>(Q- 2) 27 red ‘TeinIq 
Js UO IS 0 = (2) 4 Jed 1uLyap Isa “7 sfNORIy 9] ‘JT ‘O[30 anog 


Chain) ()g- sD 


ouop nea *(x).47 Qouonyjul J 
(Q)WP (XS 3) TJ N/T e[[euuonouoy ap ofr oun 
Iso (x Ss *x‘y) preg N/T = (XY UONNIedgsl op uONoUO] eT 


SHTLOVYA *NOLLVOITddV ‘TT 


6661 eiqwadep ‘ajenbue,p sanbiuyoo | 


‘n3sodeut don sed assed ou [1,nb 90 e yuawianbiun saunsap 
anbsewida1 91199 NO.p ‘[reAel] 99 ap afan snyjd a] ang-ined 
}S9 JBI[NSOI 99 * [RIAL] O1Q}9vIvO UOS op }Idep u_ :anbaewaYy 


‘ajduuts snjd aurgui ap 1n0} 1sa Inb 90 ‘*2 sop snprsel 
SI JUOWIIJIOIIP Ja[NI[Vd & JUDIASI vjVIO nb IIe]O uatq 1s9 I] 


“2[QeLIBA 0120 Op douRLIeA P| Ja[No[eo — 
ea v'< anbnayuds afqeuea ev] JOW0 — 
Ty sa] ans as sop suoIssouzal sop 73 snpIsed so] Jopnoyeo — 


OJURAINS aunpeooid RB] AgssNs 199g 
I=! 5 

my! Yo 

as ViK WAS 2m KEK 
d 


: Aly, La! 
: s1oje BUO TV HR 
SegUI, BWIOJ ouN Jso “2 ‘xne}0} ap sytoI[dxa uoNoUOj 
tLe Seo 9] Suep o[duioxo Jed ‘JUdANOS Sal], :3.1TeJUIUIUO,) 


a‘u/ 1 °{ ep a[[20 B ayuayeatnbg jsa az op sQueLieA 
RI Sie “oUapgooid uonensuowgp P| sqide p 2m = "7 
ap B99 & aJUaTeAINbe sa (° “W) )L 9p VouRLIvA eT] ee 


a “W) I Inod sastuegury aqeuea oun isa "x ins *2 uoIssa139I 
eI Op oo "9 soe ‘"*x{ = x Inajo0A uN Ins a8eTRO 
un,p snsst “™ sprod sap juestn (Wy) ap Inayeuinsa | 189 
("W).L 2nb ye *"2 agsureguyy o[qeutea oun youlpe (A) 1S JRINSIY 

JUBAINS JURLOCUII eI[NSOI 9] 

e UO ‘asR[vO UN.p nsst “m sprod soy JURSITNN US UONNINSQns 
Jed uinsd (W) ae UN & JULUDJUICU SSSdI9IUI Ss UO IS 
"2X, tx) 4 ‘UOISSAIS9I Jed IndyeUINSd ,| 

ap sed a] Inod awwi0s ‘10s qd, ie Oz 7a MOS) (CZ) 
J[NULIO] P| SURP BIASITNN UO ‘soURTIvA Op UONPUINSA,| INOg 
‘b sptod say daar x ins € ap uorssai3al ve] op g?x - 4 = "a 
snpiso1 soy sed “€ soy ({°Z) o[nWUoOJ ev] suep jued 
-e[duial Ud OUOP JU9IIQO,S 9]2d INDJCWINSA | IP DOULLILA LT 
‘ b sptod say snod uone[ndod ey] 

SUEP S9LILD SAIPUIOUW Sap UOISSaIZaI PI op SaMoueied sap g 
IN9199A QI JUeSINpoNuT US g)x- "= (1) wp'x' bf px" 
O9SLILOUT] B[QULUIA PI ‘/ a[SaI eT Saide.p ‘aurpe nb ‘(y) WP 

(Y ay ope J= (‘WS aeuuonouoy e] op uoNNINsqns Jed 
InayeUNsd | SUID yWesedde gyeo InaJeuINsa | SINdT]Ie eg 


n 
ee OK CE) dea «eT 
DSAR 


Ai CRT ONG 
:@ JINpuod 
Q [301 ve] Op uoNeodde, ‘y=(Q‘W)L & Uo sWIUWIOD 


1 s 
KS (ot eK = OWL) TX) = 


‘Jed Y JUaSSIUTJap a8e[vO ap suOTyenbe saT 

‘UONRSLIOUI] Bp Saysai sop uoNeordde sed juswal[oinjyeu 
I1U9}q0 ,§ jnad sinayeuysd sao ap onbyoydwiAse soueLeA eT 
‘(n+ | = (n)4) Uolssaisal Jed InayeuNsa | 19 
(a]JanUsUOdx9 UONDUO}J J 19 SOSIVUL SOP INIJBOIPUI INd]D9A 
%) onei-Suryer sed inoyewmse,, ‘(ayes op Ineyeorput 


(WL 


sexe|dwoo sunayewljse sep ja senbijsiyejs Sap inod soueueA ap UO}eEWIISA ‘a|||IAog 


masa *x) aynensisod inoyeunsa,| ("x/ | = "Bb 19 oureniqye 
4) oel Jed Inayeuysa | a|[iluey a190 sup Isure dANONA UG 
"| @ xnesa sno} ae "b say issne juaanog “anbrun ee, 
A (nb) 4 = = (n)* d isa ayuanbaiy snyjd ey autos ey “(, 1) 
+n"b +] =(n)"y oWuo} Re] op oUt wuataddojangp a 
JUDNOWIPL Jo SISIOYD douvISIP eB] ap JUopuadap 7 suonoUCJ 
SY] ‘adele op suonenbe sap uoNnjos X anb uotsuswiIp sugU 
ap Inajoaa un say NO (¥"x)"y "us| = 1M SULIOJ RP] Op JUS 
-I1IBSS9O9U JOS s]I,Nb sano] uo ‘LH ap sptod sap ajqissod 
anb sayooid issne spiod sao ayorayo uo Ig *s UOT[HURYdE 
yno} inod yx ="x"m'{ aBevjeo ap suonenbs so] yueIyLOA 
“mM splod xneaanou ap ayosayo uo 19 NuUOD Isa "x souTerIXNe 
SO[QULIVA OP XNe}O} Op X IND}99A UA “(E66 ALOINeS ‘Tepes 
‘QTTTAO 12 7661 [epules ‘a]]IAQq) souso}xa saguuOp sap 
INS IBR[VO Np [e1IQUIS dIPeO 9] SUP JUdIBQUI,s SINof sou op 
SAST[IN JUSWIUUINOD saxa[duioo sinajewNsa .p dnooneag 


SAXATAWOD SUNALVINILSA SAT 
wNOd SNGISAY SAG ANOINHOAL VT ‘OT 


‘QSVUUOT[NULYII ,p PWUI9YIS 9] aIdWI09 ua 
juvUdid Ud SIIp B 3S9,9 ‘anbysiso] UOIssaId9I DUN _p UOIsIOgId 
PR] JUDWI9}DILIOO JapN[Vd ap JouLad a[qvueA 31190 ap asesn JT 


N 
(gin f-"4)"x (a Ol = Wg fix ) = (g)I 


:UOp B UD 


N 
“(ndxa + )jndxa=(n) f sane ((g 3x) f-")"x {= (MH 


“JUSATIOY S 9109S 
np suonenbg say 19 | no GQ inea *€ aJuepusdap aiqeuRA P| 
‘anbnsiz0] UOISsdI3a1 DUN ,p JUsW)sNIv | ap sed a] suUeq 

"XNOLI9}SAUL ZOSSe 
aISAI [eIgUaS Sed aT ‘a[dUIIS sIOJeQTe BBepPUOS UN,p Sed 9d] 
suep attyensjsod inayeuinsa ,| Inod yuowiwiejou ‘spiod — 3 sao 
op asesn | ‘siatpnomied seo sanbjanb suep ‘orynsnf ajjouuon 
-IPUOD UONLUINSS Pp UONOU BT “SdJQILIO Syne ,p INS Jaseq as 
OUOP WRIAVP xIOY JT ‘JeINses sugUI Ne JUsWIAaNbNHOodwAse 
JUDUIU SdQSLIRQUT] S9TQeLIeA XNap so] onb I1elO Ua sd [] 

“QOULLIRA OP UONRWINSA | 
ap sped a] suep gs[lasuod yUdANOS jsd oseSN,[ IUOP 
}9 UOISSaIZaI Jed INd}eUISd,| SUBP Soast[NN (splod — 3 no) 
Splod ap SUONDALIOD $2] JUSWII}OVX9 JUOS a5 X saynuenb soy 
anb ‘utyjua ‘eronbiewiol uG ‘ajuapgoeid uonewrxosdde ,| ins 
O9qUIO}AI UO 49 70 = = "x | onbie ,Y= 1-L,X anb wWossade .s uo 
oF souvigdsa uos Jed ° us g0e[durar uo 1g *7a7 xo/ 1, “L,X ang 
WeIAap © A inod a]jainyeu «agsuesurp> aiqeuea. 3un,nb 39 


X(Q)VAX = Cy) wA 


‘IIOAR YIRIAOP 

uo nb sasuad e autour snou apadeid nb 39 “juepuadag 
‘(sanoureied op tuly aiquiou 
un.p aonb yuspuedsp ou 19 xnao anb eiaasasqgo uo) "a sauinse 


9¢¢ 


sonbiiduia snpisoi say sed sowixoidde say inad uo,nb 
19 INDJLUINSS 199 ap sastRsUT] a]quiueA ve] JUOS ‘a snpIsal 
sa] onb ip snou (766 UPUNDIIAA ‘UOSSUIMS ‘[RPUIRS ‘1/6 
URIYIOD) UOISsaIsa1 Jed uONeUISd,| 9p dd09Y) eT 

"yx sap [R10] np 
NUUOD INAJDOA 2] S29 X NO YX = fe ajduuts suo} ey] puaid 
uorssaiau red inayeumnsa,y ‘x Ino} anod (79 no) [ = Y7x 
anb Ja} ¥ INd}O9A UN ajstxd [I,Nb dIIp-e-jsd,9 ‘sINassaIs9I 
sop anied yey (fo JIQVUA PT NO) aJUR}SUOD eT puRN?) 


“UOISSdIsaI Jed InoyeuIsy :ajduraxy 


"uo A 
ib ae 
eee 


19°], Op auleIpswL19qUT | 


ied s ap ouop puedap uorssaidxa snag “xg - = "a 10 
* ; *o 
Yg1 sted 
a CGN 11 x— “p= 


uoneurxoidde | elastin uo ‘aouel 
-CA Op INDJBUIT]SO | op onbi9wINu [NI[ed J] INOg “UOISSAI39I 
IP SJUSIOIJJOO Sap INDIOVA NP daslUedUl] I[qeLIvA PT JUSW 
-9[dUIIs ISUIe DANONAI UG “UOISSa1B9I PT Op npIsas ‘a OoAR 


ee ¢ | = "(MI 


:QUUOP PIAO UOISSdISAI Bl Op Sv a] SURG 


qo fi 
(Cq)"l Ce <¢ } SUCH 
t= 


"10S 


78 UO ‘g 
ep JUsWasgI[N3aI pusdap (q)H e[ouUoNoUO} op s|[TUIeJ L] IS 
“SOJUIPIAY SUONLIOU Sap IOAV 


79 


(qixr= My— = = (g)"7 


SOLID 
SoIpuloUl sop odiouud np oinpep Issne jned uo ,nb sayewu0u 
suonjenba xnev }INpUOd 1999 ‘sUdISSNeS SNPISII DIAP JIIOUI] 
J[QPOU UN Pp sed a] sue ‘9109S np UOeNb9Y,| sIOTe 1S9,.D 
“QOUR[QUIDSIRIA Op LUNWIxeU a] Jed uONeUISE,p adioutid 
np uoneorydde | op say[nsai ynad sajjamiqey souepuedeput,.p 
sosoyjodAy say snos ‘([°6) uonenbs,y ‘qQ uonendod 
ve] suep oplea osoddns uo.nb sjapour un,p anouresied 
3] Sa. g onbsio] jusurWenbaljy JUalAINS uOoNeNIIS aNaD 
‘pY SULP ,Y Ip Sosat[n3a1 suonouoy sap yuos 7) say no 
a 


(1'6) OR CMEC We 


STAG 


:QWI0J BP] Op UONeNbE oun ,p uONNIOS 
wos ‘sajuvsoduios b ev anowiesed ‘g aonb suosoddng 


ALIOIIdWI 
AUYLANVAVd ‘NOILVOITddVv °6 


‘HEAR 9] RILOA 1G 


A x 
75 75 C ESAS “dN 
SSS Se ees 
Mee") (OE eo) 
Wal a N my 
reper 
DOAB ‘JUSTA 
IE n0.p (4 - 4) = (“Ayr 2 CX - ale 1OAXA) aqns Jeg 
(A -"O)(X - *x) = (yyy "x 5% A)I :20.P 
AX - x + xy = Nae Ae x AXyy WAX) 1 
hs an Roane 
on ON ‘Jed uosej 
SUIQUI B] ap JUaNNGO,s Hine ee = 4*V 9p souantjul,] 
MA 4 i XX, z AX, , a 
TEED tls lyin cet V3 i oulecl Cov vv aga 
"JUaT1gO 


uo “(¢ a[8a1) sanbruuy{eso] SosAap so] jURSITQN uq 


Ad, XX, | 


ag, 
(aE qh leah eg 


EEN 
‘11109 8 € Jo X BUD UONLIPLION ap JUSIOIJJoo9 aT :ajduraxy 


‘soxo]dwioo juouruesedde seo sap 
SUeP ILO] Zasse [NOTed UN aJoULEd ap Isa doUSNTJUI,p suo) 
-dU0] so] Jed oyooidde ,| ap s}g1ajUI Sep uN] ‘sUIOWIUvAN 
"9UI9]X9 UONPULIOJUI oun 
ast]4n uo nb sep anbiun yuowiosressadgu sed 3sa,u sastesul| 
J[QULeA PR] Op xIOYyo 9] anb aNUOU! a[dwWIaxea Ja_ “ajUapeoeid 
ey onb piles snjd swu09 saurejooid sioy soqurew 
919 v Inb (7 XY - "€)X/X uoleutxoidde | & EpuOSe mnb 39 
Y ep eguinse QOURLIRA P| SIO} ,X Roles ang Op * fe op soul 
-I]s9 douerLeA eB] onb oxp = ssn ynod uo sivyq * "XY - "« red 
sourtxoidde ‘*xy - 4 isa x ap sastieaUury s[qeuea ey] “Uap 
-g091d a[dutoxa | e soda a8 uo IS “4 (X/X) = A 189.9 
‘ones red inoyeumnsy :ojduraxy 


‘UOTNIULJOP LI OP SUAS NY daSLIVOUT] B[QeLIVA 
gun sed ouop 1sa,u *2 ‘s ap ouop 19 X 19 J ep puddeap nb 


6661 aiquiadap ‘ajenbua,p senbiuyos | 


uoissoudxe ‘("xy - ")x/] = 72 uoneuntxoidde | esasipun 
UO Yy OP doURLIRA op UONeUNSS,| op anbusuinu [No[ed 92] 
inog ‘(xy - €)x/] = 72 sesuesury afqeuea inod yowpr (9 
9130p ap) onbnsneis oneD “X/A = Y Jed 9uINSs9 Isa soureyeos 
xnejo) xnop op X/X = (AX) f= onl oT :ajduaxy 


‘sopniiqey xnev auOJUOD Isa Inb 90 x(x), f red 
aeyooidde yuawenbissuinu ys aya 19 6*x(X) ,f ap 2][99 189 
saysoidde souvea eg ‘(X) f1s9 (x) f op uonninsqns sed 
InayeuINss,| “ney snjd Wp aie v Inb 90 eB JUSWISULIOJUOD 

‘(1 L61) JJNIPOO AA Op onbisseyO eI Nsas 9] “WUdWST[IINeU 
dANOMAI UC “xX JuUIOd ne sasiid y ap sa9UUOPIOOD Sa] UOTIS 
f{ IP sayjansed sagaliap sap SUSI] INd}99A ZI Isa (Y),f NO 


x(x) S= (Wpex))L° OO f= Cx 
189 J, Op souantut.p uonouoy ey ‘(wpxs)f= (OS = (WL 
Is ‘ej 390 oq ‘xy  yuasodwios iInb_ sajqeuea sap 
Ty INOIOSA J] “JUSWOTJoINIVU ‘IS9 _Y Op BdUSNTJUI,p UOTOUOJ 
RB] *XNe}0O] Op INd}O9A UN Sd XY IS :xNvj0O} Ip UOIUOT 


‘anbyoyduwiAse .p ual 
BU [Ja ,nb yuepuadao v19}0U UG “aIBo[OINe} ouN eB QUQUIRI 
9S OUINIJUI ,.P UOT]OUOJ 9p UOT}OU ek] Op UONeOT|dde J ‘oweW 
aja *€ isa souanyur,p uonouoy ef ‘wpa f = "4" = (W)L 
‘SoIeOUI] So]JoUUONOUOJ say Inod onb na elap & UE 


XNVLOL dd 
SNOILONOU *‘SNOILVOIIddV °8 


‘QOUINIJUI ,.P UOTJOUOJ k] Op UOTIIUIJOp 
R] op 3o xneayeH op suds ne UONALISP ke] Op dILIeOUTT 
eR] ed op uns yeI[Nsoi VT “ailguasOWOY | op uoNIUIJep ied 


y 
4+D) (W)L-WY+ DL 
AY uO JANI dg 


Y 
(Blitee 


‘Q][NU OUILUOS ap DdUONTJUI dUN v dUgsOWOY 
Q][oUUONDUOJ 93N0} onb aNUOW GQ = 0 Jal[NoNIed seo aT 


n 
‘CANDL® = CX SWIX = CWP (WLS 


‘8 UO D 9ISap op sUaSOWIOY 3Ssd J IS :7eINSaYy 


DALIAP B[9 JUOP a[[aUUONDUO] kJ 39 DOUNTJUI .p 

UOTIIUOJ LI IUS JULSSOIQJUI UST] UN ‘UTJUd ‘sUdION 
‘IOS Op BA ayINS 
PT (W ‘(W)S).LI = CL)] 01 yueAtiog ua “e UC ‘aanedg 


‘RUO ,Y2Y Jed yuoWIaI[NSeaI sagoIpul Sa[[aUUONIUOJ op 
gyrus oun “y ‘,y suep a[jauuonouo] oun ¢§ 10S 2 afsay 


sexe|dwoo sunayeuljse sep je Senbijsiyejs Sap unod aoueUeA Sp UONeWIISA :a\||IAeq 


:9[391 91199 ap Issne ULOSaq OAR nad UG 


eS Vnit Lace Se 
0=-GWNYIF, (2°V'W)LI 


0,P ‘0 = (WWD.L - (792 + WY 790 + W).L aAnaig 


ae 
GW) I CW) Fer = GAN 
189 ((W)Y ap soUNNTJUI Pp UONDUO}J VT :9 9Jsay 


(WN) 

Q]JouUoTOUOJ ouUN WUIJap Inb ‘py no} Inod onbrun uonnyos 

gun ouop e& °7 =(¥)p uonenbs,q ‘arjansed enbordiogs 

UOTIOUOJ OUN JOUIpR jo DATIOALUI Iso (Y)E-Y uoNvodde | 

‘OXI WB ‘12 PF No} Inod gyIQISIOAUI Isa YO / JE dONIeUL 

RI OUOp Jol[nonsed uq “Y Ud dIQI[NSoI ‘,y SUP SINaTeA 
@ gJeuUuoNOUO}J ouN JOS (YY) aonb yueUajuTeW suosoddng 

‘JUSUDJVIPSWIUU B[NODSp Ud 1k] NS2I 

XY] “(x ua dUIOJIUN }s9 BOUdSIOAUOD BT Onb asaujodAy,| 

ailej ynod uo) O19Z SIOA pus} Inb gyWueNb oun jsa y NO 


COW |) 2? %y + (3:@)O'W) I] 
:aILI99 S$ jnad Jorudid a] °019Z 
SI9A pud} J puenb ((9)d‘PW) J SI9A pus} IUD] puodas a] 
(0d ‘Cor + WILLS + COWP 
] J 
[9d ‘WL - (6 er+ w|i =[Cs- Cor ws] 


UO (OWP(X)d ‘WL J 

(ajdwioxe.p on e osgUUOp) ‘adANdIg 
‘COWP 

(2:0) b ‘WLS + ((Q)O)L = (2° WP(COYO)L Sr 28 Ba 


=(W)S OS 


“INS SUTUIOD apaooid UO 

JUasso1gIUI Snou Inb Py sainsaU Se] $9jNo} Inod s[qeinsow J 
Op oUIeUIOp 2] SUP , Y BP UONDUOJ oun jsa d ‘snjd ap ‘Ig 

“UONLIZIUL,P DUBIS d] SNOS dT] eB] e aBessed ap 

duyiqissod vy] WUsINSIY sgyLe[NSeal op SUOTIIPUOD Say SURG :G{N 

“aureuswg[9 189.9 “(W) VPCOLIS = (OV PCOLS)I Bee 

“RT B 

UQ ‘oUIeUIOp 99 INS oINsOW oUN \Y ‘, Y Op ouleWOp UN suep 


JUBLIVA Y anewesied uN.p JUWIOIQI[NSa1 JUepusdeap salou 
-UONOUO] op a][Muuej oun (Y ‘W)L = (Y).L weusjureuw 110g 


S 
Ea CSO ‘JANDA 
SI (§s0T)] d 


LP sas ee 
SOMIE[LOS Sa[JaUUONOUOJ sap (b‘" ‘[ = 1)'G JUAtos :¢ asay 


vce 


‘(L86I ISSBL 10 IINODIT) dssaysnqol 
ve] op ao9y) ev] suep sauuop ‘anbsaid no ‘aljaniiqey 
uonlulygp e[ sa Inb 90 (4 - €)N/[ :oUOp Isa aoUaN{JUI Pp 
uonouoy eT ‘Wwpl/wpcf= suuekow oun sinog 

Xe oe 
oes Tae bees 
}S9 DOUSNJUI Pp UOTOUOJ VT “XNe}0} 
xnop op onei Y/J = WPxS /WPS =¥ :¢ 3dwoexq 


IHS + LA ASD = (LHLS)E 3° IH = (LADI 


:SIULJap JUOS S}Inpold say puenb ‘ev uo ‘soLeU 
aun 3sd Y onb 4d Sa][alJojO9A SINITeA B IUOS § 19 J IS 


SLL ALS = ES)Eele bie Sl Gi aes yy 
:B UO SI[OUUOT}OUOJ XNap 1UOS J 19S IS 37 BsOy 


‘1 /X- 388 souanyful .p uooUOJ 
ey] “oulepeos [e10) ‘Wwpxf = 2 10 L/1 = (LS ‘7 ajdwexy 


“OJRIPSUIWUT Sd DANII eT 
‘(fap sayjanied sogatlap sap saommeu sa] iso fq no) 


SRC AP Cae WAL BY | 


'@ UO ‘3[[ALIOJOVA B][OUUONDUOJ J ap SINa]ea sap 
doedsa | INS SIUIJap a[QeALIap UONOUOJ 9UN ISO/TS 2] BjsIY 


{[ONHUdIAJJIP [NOVO Np sayqao Ins yuanbyeo 

9S DOUSNIJUI .P SUOTJOUOJ Sap UOTISOdWIOD ap Sa[sQI SIT 
“T nea 
}9 9]UL}SUOD SIOTe IS9 DOUANTJUI,p UONOUOJ BT ‘UONR[ndod 
RB] ap Jnoejjo N = J “] = X Is Jornonied ug “x = (x ‘W)LI 
SQUIQUI-d][9 I[QUIIVA 93}99 1S J OP VIUSNIJUI Pp UONOUOJ P| 
‘g[qeuea oun.p (x) Wpx = L [e101 9] 189 7 IS :] ajdwexy 


AHONAN TANI. SNOILINOd SAT WNOd 
TONOTV) Ad SATO LA SATdHINAXY  *L 


“NUd}qO 1S9 Jejj[NsaI 
3] 19 (Z)IVA,N/U OP a[a0 ‘oyuNTT aUN sIBA ¢ e[Msod 
3] Sqide.p ouOp pUd} sIQUIDU PUOdS Np soURLIeA eT 


n 
Corea Ki = ((CW).L - W).L)>-NUf 


:anb ajnsa ua I] 


NW ZN 
(SF pple. (1 -"m)"2 Spe i (W)D) oN 


7 uO nb sulenus 
RII ‘senboag snssop-19 onbineu ey] op runuw «sayin» 
SOINSOW Sap ddedsa | INS ‘JUSLUISSTOINR | 9p UOTJOOIIP 9]N0} 
Inod d1Ip-e-1$9 9 YayoaiJ op suas ne aqeauep jf, suosoddns 
ueuguIEYy “jepMjsod owetsion a saide.p (uA/] “O 
N0S (N/W‘N/W)p onb aos ua ole} UOUWIO]ISIA 
ned uO ‘019Z SIOA puar (N/W ‘N/IN)P enb jueuyenua 


cd 


sonbynoydurkse syejmsod saq “4 1Q9I9}UI,p 9[GeLIeA 91N0] Inod 
o- (CWP) - ‘wpe )),_ N 1s uowINes 19 Is Q-(“W “'W)P 
:2OUdSIOAUOD kT ap ajyduiod JURpusI p onbinaw suN.p 
,¥ Ans sainsow sap aoedsa .| suosstuN] :3e}[NSII Np sanaig 


‘onbiun juswiostessaogu sed 3sd,U XIOYO 9D “SOURLIRA 
R] op uoNeUIsSd,| Jopnoyeo Inod swgQUI-a]Ja soUONTJUI,p 
UOTJOUOJ LI IP UOTUINSS OUN IISIOYD B QUOWIe DUOP 1S9 UD 
‘(QuUdAOW OUN NO ORI UN :a[duiaxq) UONIUTJap Bs SURpP PY Op 
SO][OUUONOUOJ SOUILIIIO IUDAIOJUI WJ DOUINIJUI Pp UOTOUOJ 
RI ‘JUDANOS Sai} YIP 199D “(W)L ep VoueLeA ev] JoWINS Inod 
sestjan ang ouop yned Qouan|jur .p UOTDUOJ eT :onbsewsy 


‘W ue J 2p 
JOUINIJUT Pp UOTIOUO] RI 189,77 NO ("x Sp).[] = "2 Sa sastR9UT| 
J[Qeuea uy] ‘a[quslegUI] Iso (JY), a{[eUUONIUOJ ouN _p uoNN) 
-1Wsqns sed uoneunsa | ‘sosauiodAy sasie] ap snos :3eI[NsIy 


‘[IeARI] 29 
op Jauassa jutod 9] JuRUDIUTeW Ja[NWIOJ suOANOd sno 

‘x jutod un ua agsod ovliq op assewi oun 
Inod xnevajyey ap suas ne a][anussayjip ey onb ane js9,U aI1q 
‘anuuodu! JUdANOs ‘anbrysi7eIs sWIgTqo1d uN suep ‘Ja aTqeLIeA 
189 PW ep g[eI0} asseu ev] onb je} np ailessaogu onpudl 
1S BIA “(S6L [2yeIS 10 ‘Mndassnoy ‘MIeyouoy ‘[aduey) 
a}snqgol anbysieis e] op suleWOp J] SUP sest[IIN 3S INb aT]I9 
OP UONLOTJIPOU aIQS9] OUN sa UOTIUIJap oN0D :enbsewsy 


‘x jutod ne sasod gy1un asseul eB] aUSISap “Q NO 


450s) 
((W).L - (Qr+ W)L)— OM = (0 W)L 


189, aouuoyouoj 
oun .p (a}sIx9 aT] puenb) sduon Jul .p UONdUOJ eT :uonTUyIG 


NOILOLILSHNS avd 
YWNAALVIWILSA.T AG ANOLLOLAWASV 
AONVIAVA LA ATTANNOILONOA 
ANN.d FONTAN TANI.G NOILINOW = °9 


“OULIOJ 
91109 ap sanbnsnejs sap ajeiguas uOSse] ap 9718.1) UO JUDWILUOD 
‘(Z] UONdas) UO] sNTd BIIDA UG jJTUdAINS Jnad yno} sIoye Nb 
39 ‘aquuOT[HURYoS oyun Jed guINsd aeWIeIed UN asiqyn ¢ aonb 
WJ I] SueP SpIsal JUapsoaid afdwWidxa ,[ SDA DOUDIOIJIP PT 
(L661 PTAC) 
xnej JUSUIDIOUS 4Ss9,d ‘§ Inod sgsuesuT] onbnsneis oun 
so ty « ay] = "2 aonb sourseut yWesnod uo ‘uonrindod ey 
suep "€ op Sues 9] ousIsap "y Ig ‘€ s[quueA v] op UONNIedaI 
ap UOTOUOJ LI op UONeUUNs uN Iso Y NO (K)Y A 'L= 5 
QUO} Re] op sonbnsneis sop Josijyn e uowe jso 


x 


UO 9TESOU!,p SIOIPUL,p UONeUINSI,| INOg :3[dwiax9-3.14yUO0Dd 


“SOPI[BA JUI]SOI 
danoid vs ja yUapsoeld jeYNSEI JJ ‘E/[ >D DdAe ,U= WU 
pusid uo Ig *2,;_U,,,W OP SIPIO,| AP 189 ||_[- [|] BNNs Ieg 


6661 aiquwaoap ‘ajenbuae,p senbiuyoe | 


(,-(H14)) 0 = A - oi anb [a1 1s9 eK ‘QUITS aQWIeIed 
anbeyo ‘uw oaav aquawisne wig ‘we | = 4‘ sayensisod op 
SOUUDAOU W SAP INJ9O 191 1S9__[ INDIA J] ‘so9puos saqtuN 
w/U UOIAUS sUNSeYD JURdNoOIS sansyUOod sayens}sod w anb 
-Liqej uo nb ja ‘onbrguinu ayqeiea oun .p snied e soruljap 
sayensisod say asoddns ug ‘uonvoynensisog :ajduiaxy] 


‘SJUBAINS SOIIOJOIPeIJUOD soyduraxa 

XNOP SI] JUSIUOW 9] SUIWOD Issne IWIWOD sa][NdIJIp sap 

Issne v A [I ‘anbioey) ueyd ny {IuljUur,| SIaA JURpUd) saUITIsS 

sonowesed op siquiou Jed uo-}-vipuajua nb :yuowwaptags 

‘anbneid uejd ny ‘orre[s juouinjosqe sed jsa,u UOTeNIIS P| 
IUIJUI ,| SIOA PUD} SQWINSS saQWeIed op aIquIOU JT pueNnd 

"JeINS9I 9] WINGO UO “(,,,_ U)“O = III - J] e090 


1.797267 + (DG = CDG 


:SIO[e & UC ‘C2QO-N/u anb ja ‘anbneip 
-enb ounzoy ef aurordxo uo ts '9%27y!"% = ("8"2)6.N/u 
anb ouigu op aruly giuenb aun sian a810Au09 ("2)G,N/u 
aonb juasip snou sanbnoidwAse siejmsod say ‘ajqeriea 
-d aun *9 39 sinayewinsa,p INS}OOA, uos J ‘sanowueied sap 


inaqoaa d 9 189 1 NO “(eI - SI)“O + (1- D194 2 = "2 
anb suopuajus snou «aigi[n3e1 uodsey op» Ieg :aAnaig 


(ald - Ju)“O + (4- 


‘arqe 
-981[39u JusuonbHo}duiAse synuenb oun sa ,Ay/u INd}ORJ 
3[ Jed sgsi[euOU soUdIOJJIP Ina] onb sp & 4S9,9 ‘s]Ud] 
-eatnba quos (s 3 {*2) 6) 16 oy" 2) 6) QOUBLIRA Op SINDJCUL 
-I]$9 Sd] SIOTV ‘saUITISe SaNQUIeIed Op OXI] TUT] sIquIOU UN,p 
aIgI[n39gi uoSey ap uspuadap *z soinuenb say 1g :3VI[Nsay 


‘anbroydurAse apes 
un suep onb airej as yned ou tnb 90 ‘uonewrxoidde anao 
OP SUWINISY] eV] op UoNsonb xT Jasod as WlOp UGE ‘sauleUSU|S 
snjd sa] seo sa] suep JUSIAINS vIaD ‘UOTTNULYDE,| Op INIed 
B SsaguITsa sanbnisneis soureyso yuestqan *2Z uoneutxoidde 
aun sed 72 s90vydurai e gue sIOTR 1s9 UD “UOTTNULYDI || 
op saguUOp sz] asI[Nn uO puenb sfqe[noyeo JusWIOyI9I[dxa 
sed qso,u "2 agsueouly a[qeuea Pe] ‘Uepusdso ‘[eIguUaS Uq 

‘(3)9 Juelofew 
NP In[ao ‘ayTesa assay & ‘39 ‘(U) [ DOUdBIOAUOD OP ISSOIIA 
RP] Op IN[aIo :xNvaaluU xNep kB P90 39 OUT SUIOW No snd a119 
jnod uontuljep ve] suep onuajuod uoleutxoldde ,| Jorpnoried 
uq ‘onbnsijejs oun juesuesuly aqelea ve] ap ayorun | sed 
onbrjdunt,u uonrurap ey aonb sinayjre red ‘eranbirewial uO 
(LH 
op INd}eUINSS UN,p UOU NO assIse;s [I.nb ) 7 ap souelIeA 
Bl op insed e ¢ anod ‘aouelyuod op o[eAsaqur un ouop 
}9 ‘QOURLIVA PT PIDUINSS UO Nb aIJIUsIS VIO peers uq 
U=(u)f 
sino{no} enbsad [elgues uo vine tO LCS A 
ddAR ((u)f)4 O= (Z1- N -Sp- Nz u anb suas 30 ua ¢ 
ap a]]J90 & aJUaTeAINbe j10s Z OP SOURLIvA P| anb ay[a1 (§ ap 
agsURaUT] s[quiea op) 72 snbuoyuAs a[qeieA uN a}sIxo 
[I,S I[Qeslievsul] isa 0 gIZap op ¢ onbnsnr}s suc :uonUyIG 
OJURAINS UOTIULJap ev] Jasod yueuajuIeU SUOANOd sNON 


sexe|dwoo sunayeuljse Sap ja senbiysijels sap unod soueUeA ap UO}EWIISA ‘aj||IAeq 


"1 9139p op onbnsyeis oun 
1So 0 Q1ISOpP op sugsOWOY s]JaUUONOUOJ dUN,p UONMINSQNs 
Jed inayewinsa J *Z 918ap ap so -(X - X) qu anb yp enby 
-ojduicse 1epmsod swaision aq (euasowoy no) o19z g13ep 
ap 189 LH ap sinajyeuiysa.p ones un.nb ‘| aisep ap iso LH 
op InayewNsa un nb afdwioxe sed se]d Isa |] ‘aIUIT] aUN SIOA 
puai §, N IS 0 g1d0p op 3so § anbysie}s ey anb ep uC 

“OUT 
OURLIVA OWIQUI BI UO J 10 § Jolnonied Ug TO] OUIQUI BI SIOA 
aBIQAUON J sJoye ‘9 - (u) f 0k ((u)f)°O = (LE - §) enbie 
IO] SUILIIIO OUN SIOA BBIOAUOD § ONbISHeIS oUN IS :JeI[NSIY 


(696[ Ag[ssultg adwioxe sed 

JIOA) JUBAINS NUUOD UIT IVI[NSaI 9] JUSWOyTOT[duwUT suLOW NO 

snd jo oyINns BL ano} Suep eIOSI[NN UO (1) O = X1_N Puoses 

er Gqe)0= (XK oe N 11109, dUOp jned (jaywty 
-jenuso sworxy) onbnoidui<se owiorxe suIgIsION 97] 

‘(3‘(3)9) oydeis op otains 

ap uooUoj ev] Jed sogiofew jusWISWOJIUN JUOS (u) S/||S]I 

SoIQeUeA Sop dIAINS ap suUOTOUOJ so] Wp JUWONNYy 


ft (uf 
aS ie os 
anb ie! 


J aueIsUOD BUN 9)}SIX9 [I <3 1NO} JNOd Is ((u) f)4 OSs 
11199 UO Ja (u ap anbuosjanb aanisod uonouoj oun so f 
no) (u) fap a1p1O | ap syiqeqoid ua jsa ¢ onb yp uE ‘(anbn 
-o}duiAse oped np asepuos ap sowia[qoid sap unoeyd suep 
sarulyap sanbnsneis op uns oun ve yey ua) (s3y¥‘"x) suon 
-PAJOSqO Sop juRpuadap ¢ sanbysieis sap & dsSaIQIUI Ss UO 


ATAVSIUVANIT ANOILSILVLS = “S 


OCU WL 
(ajueuNse) UoNeNbs,| op UOTINIOS RI Is9 Y ap UONNINSns 
Jed inayewimnse J “axlJ WF Inod onbrun uonnyjos oun ILOAe 
sesoddns vias uonenbs aa0 “UsWae39 d UOISUSWIP op Y 
1n9199A 9] Jed saneuresed d uOIsusWIp ap d][oUUOT}DUOJ oUN 
isd J NO O=(Y‘W),L SU} PT snos eilIO9.s uoNe[ndod ey] 
op NBdAIU Ne «aJUeUIT}Sa UONeNbE» oun ‘ajeigues UOSe] oq 
‘(uoNsoanb 33199 ANS / G6] JIAWQVAOY 
19 Jopulg & NO “PEGI Yewed 19 Jopulg “Ego Jopulg 
® Jowodal as elinod uQ) II[Nsel 3] Ins sseUUOT[NUeYDE | 
ap suOTeMONT sap JUSWI9}901I09 a}dWIO0d I1u9} op JouLIod 
9 aisnqos snjd dnoonvag jso (UOT[NURYDI | B JOUUONIPUOS 
Q[Qpoul snos InayeuNsa un.nb einjd) g ep uoNesinn, T 
Ag ix 
- 14) "ba" (uy Be = g 182 g ap a8epuos — uoNeUINsa,] 


a 
‘(gq ix - 4)" “Cul Bue = g 


‘JLI09 S$ BILQUI] B[QPOU! 9] SURP SaLIVD SoIpPUIOWW 
sop uoleUINsa | o[duioxe eg “W Anod o][auUONoUO} OWIQU 
RB] 1S9 (ABepuUOS suas Nv) INd}eWINSd UOS “Ph ap e[9UUONSUOJ 


CoG 


aun oWWIOD s[epoul np ([aUUOISUSWIpH[Nu jUSW 
-g]JanJUsdAg) aNeWIeIed a] oeIedde yey oINj1I99 9109 
‘(«sgsi[eigues 
SJUDUIOLL» Sap NO «SJUDUIOU» Sap SOPpOU SWI NO Z-Iyd op uo 
-PSIUNUTLL ‘QOURTQUIASIVIA Op UOTJESTUITXeW) JUdUAISNIe .p 
adiourd puvis un,p ojinpep «ajuewinss uonenba» oun e 
yinpuos inb uonejndod ey] ap neaatu ne onbiyewesed sjapour 
un.p juowaysnle | op ‘ajduroxa sed ‘seo 9] 1S9.d ‘JUOSsTU 
-IJap say inb sayrorduit suonenbg sap sed quanqo,s stuly uon 
-ejndod pr] & sal] sanoueied ap ayeiguas Zasse osse[o ou~) 
‘(7661 [[eH 10 UUeWI0G ‘sIaquivyD s[duiexe sed 
JIOA) SaTHoely sap UoeUINsd | onb uoNedal ap UONDUO] P| 
ap uoTyeUINSd | snd UBYONO} sazT[NQnNs Soy ‘OUIQUI Op BA Ud 
[I Suvi ap sonbnsneis sap inog ‘saygnbua sap uonewo[dxa | 
ap sayjemiqey sonbryeid xne puodsauos vja0 ‘(a[duexe sed 
SOODIPUL NO saUUdAOUL ‘SONRI) «SdITBUIPIO» Saxa[duos sonb 
-stqeys sap nog “*"x"'{ = (wpx f = GN) 39 esudins 
sunone syodde ,u UONIUTJSp 21199 [e101 UN ,p sed 9] SUR 


‘CANDLE 82 CA) at[eu 
-UO}OUOJ dUN.p UONNINsQns Jed InayeuNss JT :uonUyIG 


‘(aseyeo no uosdwoyy 
-ZMIAIO}) sptod sap auls1i0 | 10s aonb ayjanb ‘yurod anne 
1NO} B O19Z 19 Ss suep y nod *x qurod jno e “mM sprod 9] JUeNG 
-II® OINSOU LP] (WW ep INayeuNss) Py JURUDIUTeU IOS 
‘onbneid ey inod ajueugs sen sed 
}S9_,U SUISOWOY Sa[[PUUONDUO] Sap B UOTOLNSAI BT “7 QIsEp 
Op SdIpul s[qnop zk sus OUN ‘(Q gIsap op oUUdAOUI OUN ‘| 
9139p Op DUISOWOY s][IUUONDUOJ OUN Js9 [e}10} UG) “7 JHISOd 
[991 1no} Inod (W)L,4= (WL onb [21,7 op yuepuedgap 0 
Jnisod [ae1 s1quiou UN 9}sIxXa [I Nb dIIp-e-}s9 9 ‘sougsouwoY 
JUOS dSSdI9JUI,S UO soTJonbxne sayjauUOTJOUOJ sa] sajno} 
anb ‘snid op ‘erasoddns ud “1nd}09A UN NO 991 DIqUIOU 
un ‘sayjanjouod sainsaul soy SUIOW ne jURUd}UOD osseID 
QUN Pp SINSOU 9jNO} B a1D0Sse (FW) a[euuoNouoj sup) 
“ad 
Ins OXIf S[Iqeqold op IO] ouN sup ‘pT sasei sop B oleye 
WAP UO IS DUILIOD a}JOdWIOD as d}INs 999 anb yp onby 
-o}dwiAse yepnjsod sotwioid a] “7 Yy INS sainsoul ap ajIns oun 
so suonendod ap ajins ey ‘anbnoydurAse anbndo | sueq 
MA = WPS 
ouop vine uo ‘(*x)€ =" a[qeiea 9jn0} nog ‘(asTeNIGIe 
uONeIOJoUINU dUN sUep ¥ Op «ZUeI» 2] ISo IND UOISUaUIIpP 
dun Jajnole sinofno} ynad uo) syye19Uas RP] & UST DAQTUD,.U 
inb 90 sjounsip 7x say sno) elasoddns uO ‘AV 3NeA 9ZIRI0} 
QSSPU BS JO SIULJ ‘dJQIOSIP ‘AaTyISOd ysd oINsoW 39D 
“Ty syuiod sap unovyo us 911un asset oun 
juede PY dInsoul ve] Jed agjuasgidei suOp iso Q uONeNdod eT 
‘JUaSSoI9\UI Snou Inb sua{qosd np safquuea d sop yy ap *x 
jurod 3] g1d0sse ysd Q uONe[Ndod vy] ap y aytun onbeyo v 
‘uolniysqns Jed sinayeuinsea sing] & 
}0 ‘OINSOW SUN Pp I[[OUUONDUO] Op UOTIOU FJ Ins saseq ‘arUly 
uorje[ndod ev] op sameguly uou sanbysiyeis ap ajeigugs zasse 
OSSV[D DUN & JULUDJUILU JOSSOI9JUI SNOU SUOT[e SNON 


NOILNLILSH AS XVd 
SYNALVINILISH LH SHTTANNOILONOW “Ph 


Lod 


“72 sgistoyo UdIg SaTqelseA sap Inod 
*y/"2°{ auuloj e[ Op LH op sanbnsneas sap sed sajqeuurxoidde quos 
sollegul] UOU sanbysyejs soureweo Jo sInd}eUINsd sure. 
JUSTO SUOJONUOW snou sje[misod sao op ined y 
“(jogst[sou 
ouop 19) «a]qvasi[sau» aIWUeNb oun vas «saynad» saqnuenb 
xnop ap unpoid a] aonb 3a «saynad» auWIWIOD sagIgpIsuod 
wos ((,,.u4) QO sep yosss Inb sajjao juawenbruyoes) 
SInapuels soureyisd aonb yej a] JUdWTdUIIS 3s9,9 ‘sonby 
-ojdwidse syeymsod sa] yuastnpes) anb a¢ jIuIJUl | SIDA JURPUD) 
ayens op siquiou un dyodwoo gsinn ued og ‘afduioxa 
Jed ‘is o1tp steuref eines ou uo “juepuddaos ‘anbneid uq 
‘(ZIaqepur] op SUONIPUOD sap 
ayerpsumut uoryeorfdde) ruljur,] SI9A pud} sayeys ap s1quioU 
3] Op alynens ueyd ‘(7Z 6] Uasoy) sstuopues onbyewsyshs 
aseuUo][HUeYS,| 39 UdTUUOSsIOd sseUUOT[HULYSE ‘(P96 
yoleH) aduis o1toyeaye asepuos :sanbruysa) saseujodAy 
SOUTL}IDO SNOS SBO XNIIQUIOU Op SUeP S}IeJsHes JOS s}eynj}sod 
sao ‘ajaiouos snjd uodejy oq ‘oyWI]-[eUd0 sWIgIO9Y) UN 
B nal] auuop [I ,nb yWej a] 19 LH Inajeurnsa | op udsJaAuod 
RB] JUSUIIDUOD sye[MIsod sane XNap say] ‘alUIJUI UONe] 
-ndodiadns sureyiss oun ,p ‘pr uoT[HURYDSE UN 3sd UONe|Ndod 
e] onb juesip uo ejao JajoIdsajur issne yned uG~ ‘ajuoied 
ONUNUOS IO] DUN,P SdHeI]XI SdJUSSIOIO SaT[IV}] Op sUOTR] 
-ndod ap ajins oun,.p sapl | astTeuoj ye[mysod Jord aq] 


(€"€) ‘Q[[UUOISUSUIpHy Nur 
ssneQ op lo, oun oyun inod & (X-X),Nyy-4 


(Z'€) 
(1'¢) 


‘O19Z SIOA QylfIqeqoid ua aBJeauo0d (K¥- X),N — 
“OUT OUNR XN — 


:soqueAins suontsodold ston say ajmsod uO 
‘x Jed 9uINs9 y op 
Ty So[qULIRA Op 9[qeLIBAUT BOX] oI[Ie1 op AN|IOVA UN ‘gIDOSSe TH 
INdJeulI}sa | ‘Aasepuos op uvyd un Issne ouOp & UO ‘ a onbeys 
Inog ‘UOT[HURYDE ,[ op (aT]]1e1 Be] op souvsadsa no) a][Ie} wu anb 
OUIQUI OP IUIJUT | SIDA pus} UONR[Ndod eI ap Ay aTITe} BT “(suON 
-P]0U So] Jasieyoins sed ou inod suossutiddns snou anb) a 
Jonud un Jed sgo1pul a8epuos ap saurg[qoid ap ajyins oun suep 
‘JUBAINS BUQYOS J] B[NIsOd UO ‘(Z7GG[) [PPUIRS 9 dI[IAOG No 
(7261) Ja][N-{ 19 Lyesy suep owuw0D ‘«sanbyoiduiAse» suon 
-eutxoidde sap juos Jouuop suoyye snou onb syeynsai say 
‘(ajduiexe sed sayedroutid sajuesoduio0o 
ud osdjeue oun,p Inajorj ‘anbiyeuiou0sg sfapowl 
UN ,P JUSIOIJJ909 ‘[NJH sues np soexejdwioo seorput ‘sopmuenb 
sonel ‘souudsXoul) soxotduios sanbysneis sap & asso19j}UI ,S 
uo puenb ‘nouns Jd ‘IsUIe ‘(SOUIO}XO SOIIETIXN SUOTBULIOJUI 
Sop Jueisgjul) TH enb guryyjes snjd inayeumsa un aidope 
uo puenb juswayes9 Jost | ned uo nb MOA suOT[e SNON 


SANOILOLdINASV SLVTALSOd 
LA SAXATdMINOD SHNOILSILVIS *€ 


‘onbueipenb our0j a1Q1uJap 93399 op «anbryeuoyne» [noyeo 
op usAow un sqtuodsip suosasoddns snou ‘ayIns ey sued 
‘(nud}q0 939 B [I [Janba] saide saseyd ap no seisep op a1quiou 


6661 aiquieoap ‘ajanbue,.p sanbiuyoe | 


3] wos onb Janb ‘Foruap uoy[HuLYoe | JUeUDIUTeUL SUSISap 
sno) (s3¥‘"4)@ anbnespenb sus0j oun, p Jisimogi [noyeo 
gj Jed (a[qvoSI[3au sieiq uN ddAv JUDWA|JONIUDAP NO) sIeIq 
sues s9guise ang ined 19-a1]99 (9 3x:")G anbneipenb 
WO} SUN sOURLIvA InOod vB (uOIsUedxd Jed InayeUINSa | ‘UOTS 
-U9}X9 UOS NO) UOsdWOY]-ZUAIOH op ANayeunsa | ‘surly 
‘dd 1NOd 
SUP SddST]IN JUOS dIUNB 99 ap Soinpgdold saq ‘suaIONsNe)s 
Sa] Jed agfouos aseyd apuodas oun vk aynoles asuodas uou 
op oseyd oun puenb jusuuatains inb saseyd stony ua suevyd 
S29] Inod suIQUI dp BA Ud [J “SOANIqIYyold sayqnop sawUOS 
$3] JUR}IAD Ud oNbruRdaW UOSeJ Op a] qQe[No][Vo 3Sd sOURLI 
-BA OP INDJBUINSS 399 ‘say[NoIJIp sonbjanb op xud ny 


a Fier yotar ae = arrooNne 


eet key : 
(9°7Z) We 1K eb aL I KCKC: 
ly ty My Ay 


: dxa 
—— — | —— - = re 
KC. |e. | i 4) ¥h 


[UOISSOIdX9 | 
Jed ISUINSd Sd 19 JUUIITIOVJ ZISSE B[NITVS 9S IOULLIVA BS 
aap = °° 7 389 uotsuedxe red anoyeunse,J 
‘(7‘¥) g[dnoo np no y sun, op 4 Suep UOTSNOUT,| 
qusauogp |g 19 "g aseyd oulerxnep op uorsnyoUur,p s9rt] 
-Iqeqold sap JUDUUSIAIOIUI Sed Sa] Sno} sue ‘osuOdaI-UOU 
Inod uoneigpuodal ap ainpegoojd oun Jast{euLoj ap youd 
mnb asuodgi ap ajapour un sed y1I99p 3sa ued 9] ‘uOoUTS 
‘ayes onbeyo suep ajduns aiojyegye adepUosS SdAv JIJNeIIS 
ue]d un Juowajesgugs jso urd 90 ‘uatonsiyeis a] Jed ajomuos 
1S9 [I,.§ “(S/4)b a8epuos op urd un uojeas “4 UOT[MURYOS 
puodes uN .p a8eI1) a] Inod aduaIgjoi op uOTe[ndod ap yas 
39 91 1S9 Ss UOT[HURYDE UN Nb dIJIUBIS 199d ‘slo no xnop 
onbiyeid ua ‘saseyd sinatsnyd ua 911) 10s UOT[HURYdE UN,Nb 
quowwonbely sate [I ‘eureroued 99 Joj9{dui0d Inog 
“Q[NULIOJ BP] SUBP JULINSTJ d]Qnop sUIWOS 
RI SUeP JUUUATIAIa}UI INb soutia) say JUoWIO}OI[dxa stewel 
gynoyed uo nb stojajynoy sues ‘anbruesawi uosey ap si qri 
-ngeo 3so (ZZ) anbyeipenb ouroj ey aonb aljiusis 19990 
‘o8eI op Soisap bud e sion op 
ayodwio0s asepuos ap ueyd un,nb juanbayy sa [I ‘souuosiod 
sop sgidne sajygnbusa sop onbiyeid ey sueq ‘saueod op 
SOUIWOS Sap Ins saseq sa[duis sjusWgIE ,.p InJed eB soURLIvA 
op INd}eWNsd,[ ap [Noe un youLlad snssap-1o saguuOp 
S$9[3II SOP DAISINIAI 19 VAIHEdaI UONeSI[NN,| ‘Sed Saq sno} 
suep ‘Juepusdeg ‘sisapnynw ssepuos un aj9 No ses 
ang ougui-inj ned 's/'d no “d a8epuos 9] ‘7 srrewd 9y1un 
enbeyo suep no y ayes onbeyo suep ‘juows[[oinjyeN 
‘(€S6[ UlgINd) A dp dOURLIVA LI Op INayeUIN}Sa UN so 


hy ‘sat 


(S°Z) Fe (sar'Aya = (4) eA 


Sexa|dwod suna}ewjse Sep je Senbijsiye}s Sap nod asoueUeA Bp UONeWISy ‘aj||Aeq 


sioye ‘'s e 
JUSWIS|[aUUONIPUOD ' { ap sOURLIvA PI SP INo}eUITISO UN 489 7A 
anb yo ‘u/'4 “{ op aduelsea op inayeuinsa,, yso ('s3576'A) A 
is ‘uyugq °“"d urd o, suep 'x op anowunsay |Z 
‘UOISN[OUI ,p sitfiqeqoid es ‘u *’q Ins € ap [e101 BJ Isa ‘4 NO 
ef ts i Is 
(p'Z) ul meR S q+ eae IA = (AR 
CARA A : 
OJURAINS QOULLIVA OP I[NULIOJ eB] 19 UOISNpOUI .p 
souiqeqoid sa] yinpep us uQ ‘sjuepusdepul juos suryd sao 
‘Ts g@ yuowiayjouuonpuog ‘'s/'d ueyd un uojas uojpnueyos 
un suuonseyas uo ('s32)'7q onbeyo suep ‘ounsug ‘someund 
sgulun sap uonendod ey ins 'd a3epuos op urd un uoyas 
10-sa][a0 op 's uolMueyos un suUONDEI—s UG “«sorreWLId 
spilun» ssgumou ‘7 suoneindod snos ua se8eued 
yso uoneindod e| puenb juangos gisapHnynu osepuos up, 
‘ayes OP xnvj0} sap sind} 
-CUUNSO SOP SIOURLIVA Sd] JURUUONIPpe Ud JUdIIGO;s [RIDUIS 
[210] np soured ve] ap uONeUINSS | ‘oIgMUeId eT INog 
‘(asepuos 
-Snos nO) gisapHyjNul asepuos a] Jo UOOTJNeNs ev] JUOS 
Inb suoneiado xnop ap sed e sanbijduioo yuowaleniqse 
sued sop Jouuop nod juautquiod as sayduis sewiayos sad) 


4, s 1, 
es CR 


(€°7) 


(€661 PASC) Ad1NOd suep sgstyHn 
‘QIULAINS o[NULIOJ ve] Jed aferguas Jo OUT} JUDWIOUIQIXO USL] 


op seurxoidde ang ined ‘a3ein ap sapoyjaw sasnoiquiou 
op inod ‘axtjy allel op sayesaur sayyiqeqoid e oasepuos 
UN Pp SOURLIVA BI ULJU “ASP NP IPO | ANS IOIJLIA B SapIOeJ 
saseyjodAy sanbyenb 13 uo ts onbryeurayshs a8epuos 9] Inod 
OUIQUI OP BA Ud [J “SLO op SOWIWOS Op INed eB sOURLIeA Op 
UONCUIT}SS | JUBUUOP SdSO[D SA[NULIOJ Sap 9}STXO [I sJoTUoId 
SI] INOg ‘OXIJ aI[Ile} op sayesout saypiqeqoid ev asepuos jo 
onbneuraisks asepuos ‘afduuls oroyegye asepuos ‘UdTUUOSSIOg 
no Udl[[noweg ssepuos :sajdwiis seurgyos sanbyenb 
B JUDUILULI 9S SNUUOD asepuUoOs ap suR]d soy sno} ‘Wey UY 
‘sg]duuis seo sales op suep aonb yuowiayiory 
sajqeinoyeo juos ou /*x uorsnpout.p saiiqeqoid say ‘snjd aq 
‘JHIqryoid soussa} op s1quiou un opessod yesedde tnb sjqnop 
OUIUOS PI IVD DAISINOGI UOSe] Bp OULLIVA Op INo}eUINNSS 
190 BIaNojed UO ‘sUOT[MURYSE SOI soy Inod ‘anbneid ug 


14 x 


hy “yy uw 5 u 
(CErOWTEETA Wh Pe | kA re 


(4 


iS 
Cu-1) <=(DRA 


‘red 
QUUOP 189 X IP DOULLIVA PI IP SPOWWOD INd}eUITSO UA) 


Ode 


(g0uv1J) ZNIG-OL ICE ‘UUeT-I9y ap sndueD ‘\seID/Iesugysesuy ‘ajlgnbug,p enbysneig ap aMoyesogry] ‘a[[tAeq epnrjO-uray 


‘2 uonrndod x] ap 
(7 ‘¥) sajdnoo sa] sno} & aNnpudays Jsd DUILIOS BpUOdeS kB] NO 


ly "yy a My a 
(IdgIy ‘wu- Mu) ¢ ¢7+ i ("u- ])"u "<= (AeA 
z 

-JO[NITLS & 
Q[LOV] SOULLIVA OUN JIOAR,p 9 SIIq sULS aNg,p ‘atqruodsIp 
sinofno} (anbsaid) ong,p aseyuear, e& [[ “€ IQ19IUI.p 
giqeuea oun.p x yeio) np “uy = x ‘uosdwoyy 
-2NAIOH{.P INIeUINsE,| JasHN sioje yndd uQ ‘s ap 
sjuswigta sap |" ‘7 arpso | & SUOISNOUT ,p saIt{Iqeqold say 19 
((s)d*°'¢ = "y) “y uorsnqour,p seriqeqoud say yutyap uo ‘19 
-9]]90 op snied y -aauuonssyes ane,p (s)d auftqeqoid oun — 
uoT[HURYDI | — Q ap S ated 9]n0} B JURTOOSSe d dITTIQeqoid 
ap [0] UN sIIp-k-1s9 9 aBepuos ap uryd un IuLap isa ayfanbry 
ins “7 ‘y soun,p 7 uonetndod aun sraprsuod UG 


HIdWIS NOILVLIV TIC avd 
YWNALVINILSA.T *TVYAENAD TAGVO “7 


‘axo[dwios onbysiye}s oun aumsa uo nb nojea axed 
-W09 INd}JeUIT}S9 UN ast{NN UO puenb ‘urassap kB saqINs 
-U0D SOTQVIUIA Sop URSIN Ud ‘seo 90 RB IOUDUIeI Ag = — 
‘gduuts uotsuedxo sed inayeunsa | sed suse [e}0) uN _p 
OULLIVA Op UONPUINSS | Inod [noJeo op [No uN NOAY — 


“AASNILI 8 oston 

Ad1NOd [ed18O] Np Ind\deIIp [IJ VJ ISO BYDIeWIAp 90D 
‘9]URINOD sn{d eB] DdLIeAN[NU asATeUe | B SIdI] SOT[IO 
onb tsure sayyuenb sap juesijyn sanbusneys soy osatpnored 


uoNUse UN ddAv BIZIPNIa UG ‘soxe[dulod zesse sonbny 
-SIJLIS OP SIPSLIVIUL] SITGVLILA Sd] JUSWITIOK} Zasse Jo[No[eVo 
ap ‘sed e sed sainpgooid sap sed “uonoutied 3a sogstiesUuly 
SOTQVIIRA XNB JUNPUd}9 Ss [ONUSIETJIP [No[ed np sayjeniiqey 
SI[SII SO] JUSUIWUOD PIDIUOU UG ‘saTeIQUss Zasse sosaui 
-oddy sap snos safqesiiedul] Juos sjI,nb eiomUOW UO JOP 
Q][PUUOTDUOJ 9UN,p UONINSQNs Jed sIndJeUN|sd Sap VSSvIO P| 
viinpout uo ‘anbiysuesed uou onbysnejs ua astjyn uo nb 
J][99 B ONSoyeue ouaNIJUr,p UONDUOJ op UONOu PJ sInd «ajqe 
-suevgul] onbysnejs» op UOIUTJap UN YNpoHUI JOA saidy 
‘7e}0) un Inod uosdwioy,]-ZUAIOH op INaeuINsd | op souPLIeA 
R] Op UOTeUINSd | BUIZDUOD INb 90 Ud Ye] Op IeI9,] ‘oITeU 
-Tutyaid us ‘eronbipul uG~ “uoTesue9suT] ey :anbrun onbruysey 
oun juesiygn ua saxajduioo sed sap suep soueLieA ev] ap 
UONLUINSS DUN JUSWIIAIIDIJJO JASI[VaI Op USNoULIEd sayduuts 
S[HNO SOP JUSUTLUOS JOIJUOU! Op }S9 BpOIIe 399 Op Ing IT 
(S861) JOM 
OP IAT] J] aNINsUOD anb soudlsjal op VdeVIANO | Side 39 URAL 
‘gInjeloy] ajUBpuoge ouN,p jolqo,] a9 eB dWIg[qoId ag 
‘g]Janjouod uoneuUsd | op Inojne onbiyawiAs souRIJUOD ap 
J][VAIOIUI UN SdgsIpIVpUr}s 19 Sa[dwIIs soInpgdo1d sap UOTAaS 
yINpep uo ‘ssney op Io] un yIns onbysyeIs ey onb ‘sors zasse 
1UOS SUOT[HURYDE sa] puenb sjrej so] Jed oUSWp JUSUIAIeI 
‘gsoyjodAy J snos ‘ayinsuq “(sofapour op wou 9s ywepyoOd 
sa]einig Zasse sasouiodAy sap snos ‘JatjI]duuts inod ‘stojied 
19) aseuUOT[MUeYsE .p eUIgYyos af Jed aynpur siypiqeqoid 
ap lo] eT Inod osneo usd sas sanbysneis sap sourLieA 
PR] JDUINSE,p 4Sd a]TanIIGey snjd ev] aInpgooid vy ‘asepuos sed 
sajanbus sa] $9jno} ap “(jUIN}}v JUSWaIeI) INQ VJ Sa soURTJUOD 
OP SI|[VAIOIUL ,P DULIOJ BP] SNOS S}e][NSOI 9p UONR[NULIOJ VT 


NOILONGOUINI ‘T 


‘Q[[eH0}0RJ asA[eue ‘Buel ap sonbnysneis ‘sapnoesy ‘sayorduit sanguivsed ‘aouanyul,p uorouo] ‘snptsos 
sap onbruyoa) ‘uonnyysqns Jed sinayewnsea ‘uonesiuesuly] ‘saxojduioo sanbysyeis ‘sourueA op uoNeWINS| “SATO SLOW 


"Sd][a1J0}JORJ SOpoyjau ap JuBvUdAOId sanbysyeis ‘Sues ap sonbrys17e1s 19 
Soe ‘sgTed SINIJBUIT)SA *xNe}0} Op SaoIPduT SUONIUOJ ‘(UONL9OD 9p JUDIOYJOO9) xnev}0] ap sayto1[dxo sreur saanbrjdwioo 
suONoUO} :anbruyse} 99199 op UONRSINN,p so[duioxa ojdy[nw op ouuop uE ‘sanbyo}duiAse syejmjsod sanbyenb 39 souanyjut ,p 
SUON]OUOJ Sap onbruyoa} L] JULSI[IN Ud d}INIJSUOD }S9 Jd STRIG SUBS JUDWIDATVEUTTXOIdde SoULTILA BP UONLUIT}SS dUN IUINO] 
DPOLOY B[QVIILA 93199 ‘Sed SI] SNO} SULT “SISTOYS JUIWII[QVUIAUOD JIT WIe I[QuUeA UN JASI[NN,p UONIpUod ke [NI]eO 
2p [NNO suIQUI 9] JOsT[N sInofno} ynod uo Nb sUOU! UO ‘(UONNINSQns Jed sinayeUIsa) soiteguT] UOU sanbysnels sap mnjao 
Inod onb tsure ‘(aseyeo Jed yey ud) saxa[dwioo sinoyeunsa sap sed 9] INO ‘[NI]eo a] JUsWIONbHeUIO}Ne JasT[eoI op apqedvo 
[919ISO| UN Pp 9dUdISTX9 | Op EJ Np s[duroxe Jed njosa1 swa[qoid 39 asoddns uo gore 399 suL “DAISINODI USE] ap JUST 
-o[eigugs ‘agnbiyduioo zasse onbyeipenb swioj aun jue[Nd][ed Ud JOUIT}SO SUIQUI J][9 Sd DOURLIRA BS ‘UOSdUIOY]-Z}IAIOY op 
INIIVUINSS | OP Sple | & 9[GVULA OUN.P [e10} J] SUIN}SS UO ‘9UI9]X9 UONLULIOJUI ,p 9ouasqe | Ud ‘adepuoOs Jed aJgnbus oun sueq 


aWnsay 


rATWAAC AGAVTIO-NVaL 


snpisa. sap sonbruyse} Jo UOIeSLIvIUT] :Saxo[duI0d s.ine}yBUIS9 
sap 32 sanbryysye}s sap nod sdueliea op UoneUIS| 


6L¢e 


epeuey enbiysiye}Ss 
€2-612 ‘dd ‘Zz ,u ‘SZ |OA 
6661 Biquiaoep ‘ajeanbua,p sanbiuyos | 


‘ssolg Auiopeoy yeuoneN 
‘Og ‘uo\sulysepy “Cinjuag IsTzZ ay of wajsks vIDG Y :kaaing 
adDD YyIjDAYY JOUOIDN' D PAwbmol, (7661) (PA) 'S’D ‘HOITYAGNNM 


“‘Ouy ‘SUOS 
pue AaTIA\ UYOL YOK MON “surydwngy (7661) “Ss ‘NOSHNOHL 


‘Q9T-LSTZ ‘SQ “UOIIDIDOSSY JDINSUDIS uDIlUaWUY ays fo 
jousnor “Ayoydnynur yt skaains pjoyesnoy (0L61) ‘WW ‘NAMUIS 


‘ELV-OLV 

‘| ‘UOIIDIIOSSY [DINSIDIG uUDIIUAaWUY ‘Spoyla= YyIIvasay Kaaing 

uo uoloas ay] fo Ssuipaadorg ‘“SKOAINS JUDUYSI[QeIsa poseq 
uoneindod oy, ($661) ‘dl ‘SNIMGNL 39 “I ‘AZINIHS “W ‘NAYS 

‘TI-L ‘UONDIIOSSY [DISIDIG UDILIAUY ‘spoylaw YyIIvasay 

Kaaing uo uoijsag ay) fo ssulpaad04g “SKOAINS JUDUYSt[qe}so 
paseq uonrindod uo a0 “(8661 ) IW ‘NANUIS 19 “Tl ‘AZINIHS 

“OONJO sunuug 

JUDUUIIAODH §:Oq ‘UOSUIYSeAA “EOI “OU ‘Z SolIgs ‘sousIDICS 

YI[DAH Pur VIIA “SOUSHRIS YESH JO} 19]UID [euONeN “sjeLy play 

Jo stskyeue :AQAING MOIAIOU] YI[CIH [BUONLN 9Y) YIM YIMOID 
Aytureey JO Adaing [eUONeN ot) SULYUTT (L861) ‘N “ZLAMOIHLVN 


UO||IJUBYOS UN INS SeapuUO) S}UsWASsI|qe}e Sap Sseidne sajenbuy :nziwiys je UayIS Qlz 


‘JO SUNUL JUWUIIAODH 
‘Od ‘uO ISUTYSe AA ‘OI ‘Ou ‘Z Sdligs ‘sousipig YyIlvay 
PUD [PIA ‘SONSNEIS YI[LOH JO] JaJUID [RUONEN “p6-S86] ‘AeAINS 
MOIAIOIU] YICIH [PUONLN dy) JO] UONPUINSS puke USISOq (1661) 
‘M ‘OUdVL ® “A ‘SNOSUVd “AL ‘AYOOW “Lf “AASSVW 


“Ouy ‘suog pure AdTI AA, 
UYOL :YOX MON “(SPA NOY “S'd 12 “O8paT[OD ‘fW ‘UosueNsUYyD 
‘y ‘eddeuuryd “N'q ‘JIopurg “Wd ‘x0 ‘O'd) ‘spoylay 
Aaaing ssauisng sued ‘Xapul aoLid JouInsuOd *$"f) OY) SUTeUINSS 
ul suraqoid [eonsneig (S661) “UY “LNVITIVA 1° “S ‘YAAVAT 


‘DOJO SUNULIg JUDUIUIZAOD 
‘Od ‘uowsulyseM “O8-9L ‘9ZI “OU ‘Z SalIgs ‘sousuDIg YyI]DaH 
PUD OIA “SONSHLIS YIYCIH JO] JoJUDD [PUOTEN “USISAPII FOOT 
-S661 BU} JOJ YOIasal :ADAING MOTAIOUT YIYCIH [LUONCN (6661) 
f ‘AASSVW 1° “S ‘NVWLOd “f ‘OUFESNVM “Cd ‘SNINGNS 


“SONSNRIS YIEIH JO} 
Jauuag [euoneN ‘atjqnd uou yoddey ‘surjdwes YIOMIAN Sasso A, 
ISIT :Aoaing ae- Yeo} [PUONRN (S661) ‘f ‘OWAAISAVM 2 
“LUVMALS “d “YHOW “S ‘SCUVMGA “W edd “d “SNIanr 


‘OONJO SUNULIY JUSUIUIOAODH :Oq ‘UOISUTYSeAA “[O] ‘OU 
‘Z SOLOS ‘SINSIDIC YIJDAH] PUY JVI1A “SONSNRIS UCdH JO} 1O}UID 
JeuoneN ‘“AdAINg MOIAIOUT YEOH [euUONeN oy) YM AdAINS 
sInjipusdxg [ops] [PUONLN dy} SUuNLISIIUT IOJ SOAeUIOI[e 
usisoq (L861) ‘D'L ‘AOVUIA 1° “AU ‘WOSTOA “dD *XOO 


“29YIO 
SUNUL JUDUIWIOAOD :Oq ‘UO BUIYSeAA “| | ‘OU ‘Z SaLIas ‘souS11D15 
YIjoaL] Puv [OIA “SONSNRIS Yeap JOJ JoWUdD [euoNeN ‘soyeurnsa 
paseiqun gdJy} :saseasiIp ose1 Jo souaTeAoid ay} aIewNsa 0} 
sKaains afdures Jo usisoq ($961) ‘WW ‘NANUIS 1° “Z ‘WAVENUI 


aIHd VaSDOITaI as 


“SONSNVIS YIP} JOJ Jo}UAD 
jeuoneN np sayjatoryo suontsod say tu suoturdo say yuo 
-allessaogu sed juajuasaidal ou Sa[[a 19 SINajNe sap saT[ao 
JUOS IOI sagjuasaid suotutdo saq “sayNN sat soile]USUIUOD 
sos Inod inayeurwexo un.nb sure ‘ajonse juasaid 9] 
SUEP IPN} DUIQ[qOId J] PAI[NOS IIOAR .p SONSHeIS [eUONEN 
UO dd}TWIWOD np AdAINS aed YIedH [euoNeN eI Ins 
sodxo .p sdnois np SoIqUIdUL Sd] JUDIOIOUIII SINIINV SIT 


SINAN THIN 


"INOIII | INS 39 $]NOD Say ANs ‘ed 
anne .p ‘uonendod x] ap soiquiow sap ja s}udWassi[qria 
sop sgidne sanbissejo saygnbua sap sinayeuinsa sap je 
‘ued oun .p ‘Sqdd PI ap SINdJBUII}Sa Sop sjajJo Soy Joredu09 
RIPNK] [I ‘Sa[qesa1NUOd JUOS ‘sane .p ag-jned 39 ‘Syd PI 
Op SOSeIULAR SO ap sjanbsa| JOUIULIDJap INog “JUSWIAIDIIIP 
JOAIOSQO .P ILdJJIp sa [I.nb sastogiduut jo sores suony 
-e[ndod sap e 11k) 1UO sagIpnye sayqeiueA soy puenb uonry] 
-ndod eI] ap soiquiow ap uoj[HueYysoe,p saidne sanbisseyo 
soygnbuse sap s1ped 9] Juessedap saouR}SUOdIID Sap suRp 19 


Lhe 


‘saenbgpeul yuos sajja,nb no syuswiassi[qria Sa] Ins sojuep 
-uadapul asepuos op saseq op sed ajstxa.u [I puenb s}uow 
-assi[quia,p SUOT[NURYSE ,p Saidne sanbissejod saygnbus sap 
aIpevo og] JUeSsedap sooUR]SUODIIO Sap SURP S]USUSSI[qQuI9 
Sa] Jed sagsi[val suonoesuey op squiou oJ JOWNSe.p 
youllod SAgqd BV] ‘SJUSWASSI[GeI9 Sap sagUUOP ap SIOIYOY 
xne $Qd0R.| JUSWOIIeUIPIO JUS} Inb snuajqo sj]uoW 
-dUBIaSUdI Sap d]eNUApPIJUoD ve] JURUIBDUOD sUOTZedNd90 
-g1d xnev aguuopsogns sed jsa,u Sq qd BI ‘Jouuosisad inayed 
-IJQUOPI UNONe,p UOVS[NAIP ke] dIIssadgU OU SUISTUBIOUI 
J] SUIWIOD ‘“s]UDWssI]quIa Sap saguUOP ap SIOIYOIY xne 
uoneindod ey ap soiquiaw sap saidne asepuos sed saygnbus 
sg] Jafdnoo ap youed a]Jq ‘sasnomquiou yuos suoneordde 
S23] JUOp asepuos op uvid op uonNdo oun jsa Sqdd VT 
‘sansIpoid UOs SadIAJas $990 sjanbxne 
SASVUDU OP SIQUIOU 9] JUaSsIBUUOD sjI,Nb ayqeqoid nad ysa 
[I,S QUIQUI ‘SIUINOJ SIDIAIOS OP [10] SIQUIOU 9] JONSISOIUS B 
gourpud) ju Inb sjuswassi[qeia .p dnooneag sed juowayloe} 
SOTUINOJ aNQ JUassind “Py sap sinafea soy onb apqe[quiostesA 
1S9 [I ‘aNUOD Jeg “UOTORSURI} OP Sa]IUN Sa] JUOS saseUdU 
sa] sjanbsay inod ‘syuednooo sarejgiidoid souvinsse ,p 
saoljod sap jueljjo sorusedwos say no oiyqnd dorasos 
ap sosudeanue say ‘ajues e] op UdUTeW Ne JURI[IDA sUOTeS 
-IUB3IO Sd] SUTLUOD ‘sJUSWOssI[GQuIE ,p Soidne Jnvs ‘UdWI[IOv] 
sonudjqo ang juassind ‘yy sap sinayea say aonb afqeqoid 
nad 3sd [J “WJ JUSWIASSITQuId | DAR SdaNIDaJJO SUOTIORSURT] 
OP [&}0} DIQWIOU J] ISA “PY 19 “YF WOUWAssI[geid | doAv SUOTIOR 
-SUBI] SOP JURSITRAI SOBVUDUL Op dIQUIOU 9] ISO “AY NO ‘SYdd 
RT] & sarqvordde ayrorjdnynw ap sinajyeurjsa soy 19 SA dd PI 
e afqeordde uosdwioy]-ZiAJOH ap Anajewisd | JUdIISSa9U 
anb sayrorpdnynu say ‘uawaansedsas uos (4 ST = Dp 
Sa] 19 “N SOY ‘aQuuop uoneorydde oun e atidoidde snjd 
3] ‘we ua A [t.nb 3sa yuri ts ‘Sqgqd BP] & a[qeoudde snayew 
-1]S9,| Op XIOYD Np gIO JUSWIgTa UN ajUasaida dIIe} d] JUDANEd 
STL afjonbey] ooae ayyploey ve] 39 SWOIdy[Nu ev] Ins syuawoUs 
-I9SUdI SO] IUINOJ JUVssInd syusUAssI[qeia sa] onb ye} aT 
“sosvusul sap soidne ajgnbua | 
oP SIO] sgiejoep 39 UO Inb sjudWassI{quia sop said 
-nv IAINS ap aygnbua | dp SO] SJUDWOUSIASUAI $9d II[[IONdO1 B 
Jissngd ap suyiqeqoad x] & 19 souody[nu sop uoNTUjep e| & 
yen ev Inb 90 ud JUdIAIJIP UosdwOY]-ZUWAIOH Op Indyeullsa | 
9 guordn[nu ap sinoyeuinss soy “juepusdsag ‘saseugul 
op uoT[HUeYSE,| op seidne ajgnbua,| ap s1o] Sepoep susU 
-OSSI[qujd Sop UOTJOAIAasS Op sau[iqeqoid sap uOTeLIvA PL] Op 
aiduioo 119) nod gy1o1jdyynu ap sonoueised ap yuopusdap 
SAdd BI & soyqeordde sasieiq uou sinayewinsa sa] ‘(866 1) 
Ud¥IIS 39 NZTUTYS Jed Ja (CEG) SULYPNG 19 NZIUTYS “UoyITS 
Jed sgsodoid gyorjdnjnu ap sinayeusa sap no tor gsod 
-o1d uosdwioy L-ZWAIOY ap INdBUNSd | IP ISSIBL,S [INO 


NOISNTONOD °9 


“OIVI ZISSV JUSLIDUDAY UN JUdS 
-g1da1 sgIpnia sfqeueA ey] puenb Juowasarpnonied ‘saydnyynu 
synoelqo 8 SAdd oun.nb ioinjd enbrun ynoofqo ve sqdd 
oun asiyeal uO ,| Is aqeqod snjd 9] xtoyo 9] Isa gIdap [Nes uN 


6661 Biquieoap ‘ajanbus,p sanbiuyoe | 


R OSVUUOT[MURYIE,J “SUOTORSURT] So] SaINO} INod saTquieA 
$9] JUSIe[IOp SQUUOT[NURYSE s}USWASsI[qQeI9 So] puenb gisap 
UN B BSeVUUO][NULYIE | Op sed og] SULp IeIedsIp ‘suoNovsuRN 
SOP ISVUUO][HULYSE-snNos Ne oNp soURLIvA PI Op «s}USUT 
-OSSI[GuI9 SOP INILI9IUI | B» aJUesOduiod ve] aUaseides Inb 
‘(pZ) OP SIQUIOU SWIIIXNIP NP SUWIId} QUIDISION I] “JUSUIAS 
-SI[qe}9 UN.p snyd dav SUOTIDRSUL] Op oNjJOAJJo,U SaBeUgUI 
N Sop unone Is yesedsip aiquiow swigixnep np doula) 
QUIIXNSpP Y] ‘S9SVUsU Sop BdeUUO][NULYDY,| B ONp soURLIA 
Rl OP «s}UDWASSI[GeIa 91]Ud» aJURSOdWIOD v] JUaJUasSaIdaI 
(PZ) Op SQuUISUL BWIAIXNSp Np sould} siomueid xnap sa] 


(pz) ay 7 i ae 
bases i 
ie): tw" xe 
eed dp polenta Pre 
Ix,! fi 
; = A424 
XX gigaig SS* XT = CX) A 


HOS “SA dd PI B 91qR9 
-1[dde y op uosdwioy]-ZAIOPY ap INdjeUIlsd | op soURLIeA 
e] suous}go snou ‘(QZ) 19 (P]) SUOUTqUIOD snouU IS 


(€Z) ae a ‘d4 


isa 4 J WoUlassi[qrig | 
suep saguuONosjas suonoesurl sap uoj[nueyos,| 
op a[lei ey Yf op Inayea oureyIO ouN INOg ‘aQUUOTDITIS 
Sd UOT}ORSUeI] oUN ajenbey, saAe ayeqols aseuUuo][ 
-ueYyo9 .p uote ep isa fno ‘f= ¢ W yf ul)'d4 Slo[y “aigpuod 
oyne uoT[HUeYda UN OS Sqqd Pe onb suosoddns 


if 


I-W 
(ZZ) ry * (X09 
zl x") K 
'W 
iso uoNe[ndod ap souvLeA PI NO 
WW 
(12) (X) 29 T= VX) RA 
vil Aaah 
‘ W = 
(07) C'x)reA G 4 
f i a a 
CX RAW «t= GLX RAT 
Y 


(€L) 
OP DIQUIOU SWUIIIXNEp Np sULID] OWIAIXNap I] SUOIOPISUOD 


UO||IJUeYOS UN INS SeepUO} SjUBWAaSSI|qe]e Sap Seidne sajyenbuy :nZiwiys je UEeyJIS 


(61) 


Une 
N+N-~N-N 
‘QSIWUDI SUBS d[dUIS dITO}egTe 
aseuuo][Nueyos Jed sguUONdaI[9S JUOS SdBPUSU U IS jo 
N 
(81) a = "D 
uN + N-'N- N) 
‘QSTUUDI SOAR O[CUIS dITOJeOTL 
aseuuo][Hueyos Jed sguuondajas jUOS saseusU U IS 
‘ly ne lu 'Y neasel nv IU Sal] JUSTOS OU S9UUOT 
-[Queyse sasevusgul u soy aonb ayiqeqoid ey isa (7 #4) "D of) 
‘ly 49 ‘pw xneasol xne suuaryedde sguuoy[nueyog soseusul 
u sop jenbay oyodut,u enb ajutofuos ayyiqeqoid ey] 3s9 


(LI) (fe) | Gb eh pad 
no 
(QT) 'd'd —"d = ('»"n) aod 
yo 
(SI) fd - ‘d= (‘») 10, 


f 
‘Q[PMWIOUIG SILO]egTe BTQuLeA ouN jso “D onbsing 
ld d [1 t=! 


‘Jn'n) 109. —— + 
(v1) ly ly S4 


WA =(|,X)TILA 


fq if 
6) 


OP SIQUISU SUIQIXNep Np sU1J9} JorWIaId 9] suOJEpIsuOD 
“SOSVUDUI U Op OXIJ UOT[HURYE UN j10S 
@ aonb uontpuos e ,X ap INa[ea Be] aUasaidar (75|,X) NO 


(€1) (O|LX AT + (|,XYAIA = (,X) eA 


d1L199 $s nad 
X ap uosdwioY [-ZNAIOP Op INdeUIN}Sd | OP DOULLIVA BT 


Sddd V1 V ATA VOITddV 
NOSdWOHL-ZLIAYOH Ad 
WAALVAWLLSA.T Ad AONVIAVA VT 'S 


‘axa[duioo asepuos ap uryd un ins sagpuoj qUOS ‘STHN PI 
aumu09 ‘Inb uonryndod ey] ap saiquiaw sap saidne saygnbua 
sop uednid ey inod ‘b say sa[nojeo ap a[IOJIp esas 
[I JUOWIOWIaIxnsq ‘“s}UdWassI[qeia sap soidne sajygnbus .p 


Ole 


Seo oJ] SURP JOUTUIAIAp eB Sa[IOIJJIP JUOANOS jJUOS Inb 
sginuenb ‘(4° ‘, =f) Sap juapuadap sj! ‘uaWIdIQWUaIg 
‘soulgtqoid xnap sasod nad (4 “" ‘, = £)'b sap ainsow ey] 


uN 
'b 


(71) == 
uCN- N) 
‘QSTUIDI SOAR J[CUIIS DILOJegTL 


aseuuol[nueyse sed sguuonosjas jUOS saseuguI U IS 


(11) 
f 
‘N-N 


‘QSIUIDI SUBS J[CUUTS dI10]egTe 
aseuuo][nueyse sed sguuonoajeas jUOS saseugu U IS 


(or) “py neasar ne ouuansedde,u sguuojjnueyse 
saseusul U sap unone,nb syiqeqold ey] 


aide D 


WHOS 
‘osevusW 
UN SUIOU NB DdAB SUOTIOVSURI] SAP aNjDdJJo sjUdWassI]qeia 
Y Sop unovyo Is Y op gsIeIq uOoU INa}eWINSS UN 4sa _,X 


(6) zey) Gees ‘4 | = D‘y neasal 
ne suuorjiedde sguuojjnueyos soseusu 
u sap jenbsy awoduit,u anb gyyIqeqoid PY] 


= (0) q = ‘d 


jo 


(9) Chat ele t'x op gsiviq UOU INS}eWINSa] So 


C f 
}9 ‘JUOTUOIINe ‘(— B [B59 ISO “DM J9 “P Nvasal ne 
juonedde sguuoyjnueyse saseuoul u sap jenbay oyoduit ,u 
IS | & o[es9 yso Inb aMOyegTe a[quieVA ouN jso "0 ‘IO] 


(L) WX KeUxX 
Y 


Iso SA dd BI & a]quordde 
X op uosdwoy]-zAloyY op Inayeunsa | ‘afduuts airojegye 
eseuuol[nueyoe Jed Jo Juowepusdgapul ssuUONDaTas 1U0S 
(ao ‘T =f) Ww suotoesuen ap suOo[[QURYOE-snos sayz NO 


t=! 
(9) ‘suonoersuen = ‘wu KG 


4 


Sl¢e 


ap [10] UOT[HULYSE UN ja ‘a]duuIs sTOJegTe BSeUUO][NURYDE 
Jed souuondsejas saseugui wu op uoT[MURYSS UN INog 


Sddd VI V ATaAVOITddV 
NOSdWOHL-ZLIAYOH Ad MNAALVINILSH.T “P 


‘sIoj ajnas oun nb neasai onbeyd siquiousp ou Sqqd PI 
e ajqvordde uosdwi0y L-ZAIOY op Inayeullysd, J “saseugul 
op UOT[HULYSS | SUBP SPUUONDIITIS JUOS XNvASdI SOWIQUI xNe 
juvusyiedde saseugul say aonb sto} ap aiquiou np sed puadep 
ou UOSdWIOY [-ZAIOY op ANaeuINsa ‘J ‘saseusw sap saidne 
ajgnbus,| ap uol]NURYoS,| SUBP SaUUOTOeTaS JUOS NeaSdI 
20 & juvusedde sasevugui soy aonb stoy anbeyo (y ‘** ‘T = S) 
Vy neasal ne sadly] suOTJORSURI] “PY Sd] JUSIQUIOUSP 9319 
-1[diy[nu ap sinayeunss sa] ‘uosdwoy]-ZAIOY op Inayeu 
-89,] NO Sqqd PI op aordnynw op sinayeunsa say onb 
-1jdde uo J anb uojas ae xnevasal Sop JUDWIAIQUIOUSP YT 
“neasal [nas un B onbrun uosey 
ap dal] ISO SUOTOVSULN PY SOp sUNdeYD ‘xneasal sinaisnyd eB 
Jiuayvedde ossind aseusw suigut un nb uarg f q ap suonoe 
-suen ‘yy xne g[dnoo sa 10 saSeuau “Ay sop afquiasua,| 
juonuos ‘y neasar 9 no ‘(y “7 ‘| = £) py ‘quaurasstiqeia,p 
xnevasal Y ua soseusul Ay Soy wieder inb saseusul 
S3J 19 SJUDWASSI[Ge}9 SO] 9IJUD SUOTIOVSURT] SOP UONRINSIJUOS 
aun ynpoid Sqqd PI 8p JUSWsIqUIOUSpP 9p s[sa1 BT 
“S9QUUOTJOVI[9S SUOTIORSURT] So] Inod sayqeiueA 
Sd] JUDIL[OAP Jd SPUUOT[NULYSE soseUd xne satqeinduut UOS 
Inb SuUONOeSUI} SIND] OP SUOT[HURYDE-sNOs Sa] JUDUUOTIOITIS 
SJUDIUSSTTGUID $99 Ja SUOTIORSULI] SAP JUdNIDIFJa st stanb 
-Sd] IOAP SJUDUIISST[QLI9 S3] JUSIJHUAP! sosvusU SA] “SAdd 
RB] Op JUDUIDIQUIOUAP Op I[3aI BP] DUIBOUOD INb 99 Ud salIeyeU 
-I]Sap sing] B soqeyndut suonoesuey say tu SuOORSUey Sod 
-old sinay sed yuaiepsep ou Sqqd B] B Jodtonsed Inb saseu 
-9UI SY] “SasvUsU xnv sa[qeinduut juos Inb suoNoesuey soy 
Inod uoneinood sed sjuepuodai sap 1UOs sOsVUSUI Sa] SOA 
SUOTJORSURT] Sap JUdNIDaIJa IND syusWAssI[quiea sa] ‘asodiodns 
ISCUUO][NULYDI,| 9p onA op Julod nq ““y J8Ae SUOTIORSURI} 
Sop anjqooajjo JuO Inb saseugUI ‘AY op neasal ne jueUdyIedde 
guuo][MUuRYsS oseusu anbeyod op saidne aseugwi-ajygnbus | 
op oped a suep sajqeiquiousp juos (y‘ ‘| = ()"9 
ap suonoesuen ‘tw ourgut sof aonb puajue-snos sagqd &I ap 
JUSUDIQUIOUSP Op I[SI1 BT 7 WOUWAssI[qeid,| op suoT}OR 
-suen ‘Wy sap ‘wu OXI} OTT!) op amoregye UO][NUBYOS aUIQUI 
ne ot] so (y “ST =f) dace SuOTORSURN Sap 98e3Ud JUO 
inb saseusul ‘Ay ep neasal np ated juesiey asevuaui anbeyo 
anb asiosid Sqqd PB] Op JoWaIquIOUap ap s[3aI eT 
“Q1Sap OUIIXNap op SayUN say IOS ‘Sad P] op JususIquIOU 
-9P IP SI[SaI XNe JUDUISULIOJUOD ‘sQUUOT[NURYSE SaseUdU 
Sop NIATU Ne sa[qeIquioUsp sUOT}ORSURI} Sd] 19 IBOP 
Jatwoid ap sseUUO][NULYE Pp SAIUN Sd] JUOS SaBPUdU Sd] 
‘gsodiodns asevuuol]nuryog,| op aayjoodsied ey sueq ‘uon 
-e[ndod ey] ap soiquioul sop soisap xnop ev gsodiadns aseu 
-uo[[QueYyoe sed aygnbus oun sO SA qd P] WSIJapoul uO || 
Is Ja[ndiueuw v saylovy snd ‘aouvieAa Ina] onb isure ‘sqqd 


666| aiqueoap ‘ajeanbue,p sanbiuyoe | 


RP] OP SINIJeUINSA So] 19 SaQHUaIedsueN snjd yUoUUaIANP SAd 
B[ op asepuos op urd np sanbnstiajoeseo say “uepuadag 
‘QISop SWUIXNep op eseuUO][HULYSE ,p Sa]IUN say ‘s]USUIAS 
-SI]qui9 4 sop unoeypo sed saguuonoesyas (4 ‘, = f) suonoe 
-SURI] “1U S23] 39 GISOp JoTWsId Ne saguUOTDITaS so]IUN So] 
JUOS SosvUSWI sap saidne ajygnbua,| ap aiped a] suep sauUO] 
-[UBY9 SOBVUDU U D9AP SUOTIOBSURI) Sap 9N}daFJa UO INb 
SJUSWOSSI[Ge}9 4 So] sJonbe] ap sipeo a] suep s}udWssI[q 
-b19 Sop sgidne soisap xnop e& aseuUOT|NULYoe Jed ajeanbus 
dUN SUIWIOD SA PI JUSIAPISUOd (666) ‘JOO 19 suLypNe 


. “suotoRrsuely 
‘WG SoS ap a7 STOEL UOT[HULYO9 UN ,p SO[GeLIRA So] JUSLUWUEp 
-uadgpul aiepoep suuonsayas (4 ST = f)'q lUaWassI[qeia 


anbeyo jo saseusul ap Jnejuasaidal uoj[NUeYoE,| op seidne 
ajenbua | Inod sguuonseyas saseusul u Jed saiepoap s}ouNsIp 
S]JUdUUASsI[qeye 4 sop soidne tAIns ap ajgnbus oun asiyeal 
UO ‘JUdIUASST[QuI9 Pp Sa}du109 sa;qnop sap uorssaiddns saidy 
“Q[IAIO OQuUP | ap Sastogid apotad oun jURINp suONOesUeI} 
Sap JUINIDIFJO sjI sjanbsay oak s]UsUIASsI[geI9 Sap UNDBYO 
JUSTJNUSPI sQuUOT[HURYSS SaseUUI Sa] atjanbe] ap sipeo 
gl suep (vu *, =2)'y sadeusu uv ap JnejUasaidol oMOJeITL 
uo][NULYSE UN _p saidne asepuos Jed ajgnbusa sun 93nd9Ex9 UO 
‘IOQUDWIWIOD INOg ‘X JowNsea Inod sqgd oun asl[Va1 UO 


ASOdaddNS ADVNNOTILLINVHOU.d 
WOAANAA.d ATHGOW AT °€ 


(¢) “‘SJUSUOSST[GQuIa Y Np suoNoesurl Py 
S93] INS J[QeIIVA RL] OP SINI[VA Sap SsUTWOS 


10 
(b) "7 yuoulassttqeia,| ap suonovsuen 
W Se Ins s[qeueA ev] ap sInafea sap suUIWIOS 
1=¥ 
i i 
_y aux 
'W 


‘sory (yr 'T=!)'F 
JUSUASSI[GeI9,[ Op UOTORsUeN (‘| = ¥) QWIII-Y¥ 
RB] Inod s[quieA PI Op INIIeA PI ty Jed suojussgiday 


(€) ‘sadvugui ap [e101 ciquiou = °V +, N=N 
12 


(Z) ‘sjuaulassttqeia Y Sa] aAv SUOTIORSUR] Sop 
JURNIOSJJa SOSvUgUI Op ][e}0] oIquIOU 


‘sIo[W ‘JUSWassI[qria 
unone dae UOTORSURI] OUNONe jURSI[vaI DU SOseUSW Op 
aiquiou 2] = x 19 ‘(7 4f)!9 19 “q squaulasstquie say 90Ae 
Sloy BJ B SuoHoRsUR) Sap JUeMIda}Jo soseugU op diquiou 
ap="N ‘(yo ‘T= f)'q quaurassttqeia,| s0av suonoesuen 
sap JuenioajJo sasvusU ap siquiou 9] = ‘Vy anb suosoddng 


({)  ‘“Sjusuasst]qeig Y Sap suotoRsuel ap 
t=! 


[e101 arquiou = ‘Ww “<< =W 
Y 


‘sroty “(yo ‘T= f)'q qwouesst{qeia | 
ap suonovsuen ap ciquiou 2] ‘Ww sed suojuassiday 


NOILVLON ‘7 


(7661) 
uosdwoyy, Jed yap 19 ‘(S96]) UPYIIS 10 WINequilg Jed 


yedgp ne gsodoid gisap un ev gsodiadns aseuuo][nueyoe ,| 
INS SApuo} SINd}eUISA sap ‘solgT[NoHIed suoNIpuod sap 
suep ‘soisop sinaisnid ev aseuUO][NUeYd9 | & UOISUd}x9 oUN 
JUSS] [aIJUAssa IUOS SAd P| B sarqvordde sinayeurtysa say] 
“QOURLIVA BS 19 SAd B] & a[qvordde gsteiq uou uosdwoy Ly 
-ZUAIOH Op INdewiNsa | 191 suojuasgid snoN ‘“aouRLIvA 
Ing] gnoyeo quo 19 SAd BI B safqvordde gsreiq uou 9319 
-I[dy[ NU ap INIJCUINSd | IP SUOISIOA XNOP NUd}qQO jUO (866) 
UdYIS Jo NZMWUIYS 19 “(CHGH1) SULYPNE Jo ‘nzrUIYS “USyIIS 
‘gsodiodns aseuuoy[nueyod,| op aoay) ey yuenbijdde uq 
‘(QOL6[ UdyxIS) sasodiadns sjnejusssidal suoy[NueYyse Ins 
ajgnbus oun isa sqqd ke] enb nuuosal 939 & [I,nb stoj oun 
sag]uOWns 3139 nd yuo yedgp ne sagsod juos as Inb sayjony 
-da0uo0d saynoijjip Say ‘soURLIvA PI Op [Nd]ed 9] Inod sanb 
-yAyeue sapnutioj sap Joddojaagp & 19 sajualgjjIp soguuop 
SOP ULJISSID9U S9SIVIQ UOU SINIJeUII}SO saNe Pp dsepuos 
ap urjd 99 nod ainysuod & SIA JUO 39 aNbIIOSU} UONR}USLIO 
aun sud yuo SA qd PI JUCUIIOUOD XNVAPIJ} Sd] “JULIO 
“SIHN ®] & alenbus | ap asejdnoo 93] JasestAUd WeIADp 
uo ‘UOUTS ‘a]UBpUadepuT ajgnbud oun JasI[eal ap a[quiajoid 
OINOP sues 189 [I ‘AT[Ie} ANd] Op s[qeuuUOsTes oINSOUI UN ITUS} 
-qO 12 sJUdUassI]quia Sap a[quidaooe syst] ouN II[qej9 nod 
uO | Is onb yUSWdIIOSIAOId JUdN[DUOD SI] “STHN B®] & ea[dnoo 
SOIIVJUIP SUIOS Saq Ins aJgnbusa oun .p 19 JUepusdgpul osep 
-UOS op ued & sollejUap SUIOS Sa] Ins aJgnbus uN .p Ina 
-1N09 sMUOIdWIOD Np d1gISSOIS UOSTeIedWiod oun ke spgd0id 
UO (6661) AasseJ JO URWO ‘BloqsyeAA “Joye ‘SULypNe 
‘ued anne .p ‘ajuepusdgpul uodsej op I[qeia Iso asepuos 
ap ueyd 2] 1UOp sao ap 39 ‘ued oun.p ‘STHN PI B Sagtoosse 
QURS IP SIOIAIOS Sa] Ins sajgnbus sap ssepuos op urd 9] 
Jo SoTfauuonesado sanbuystigjovIevd say sredui0d UO (666) 
BIOGSYVAMA 39 URMIIS ‘IYOPY ‘splempy ‘Yog ‘surypne 
‘91109 np uoTIsodold ey] eB s1puodai inod 
SAdd PJ Ins ayosoyoos op owtuvss0id uN g:our] & SHON FT 


UO}|IJUBYOS UN INS SespuUoj S}JUsWAaSsI|qe}e Sep Saidne sajenbugy :nZIwiys je UeHIS plz 


AOS3'OPd @ TSsul 


canbruossaja JOLIN “WS ‘Z8LOT GW “ATIHAsUCAH “QOL WooY “peoy Isa1dJag $7CO “SONSHUIS YI[LaH JOJ JUDD [CUONLN “NZIWITYS SUT 39 UdYIIG SOIUOY 


‘[(686I SOIPRL, 19 SUOSIeg ‘IDO ‘AasSSeyAy) JUDWSSI[geIa 
ud sgorid uOU oUTROLIDUUe OTIAIO UONL[Ndod ev] op soquIoW 
Sap alues v] Ins sayeuoNeu sonbnsneis sop l[[renda1 1nod 
SdSPUSU (OQ Tp UOIIAUD,p saidne SHON 2] Jed Juowayjonu 
-UP d9SI|[PaI aJUDUBULIEd osvUdUI-dJgnbud oUN 3S9 STHN PT) 
‘SJUdassI]qeie ,p SUOT|HURYOE ,p sgidne sanbissefo saygnbus 
SdP SUWUOS ajJURpUddapuUT UOSe} ap sanduod ‘ang,p JUuoNUN 
-U09 19 ‘Juare}a saygnbus sd9dg “SHON NP XxneoIpeul sooIA 
-I3S ap SINasstuINo] sap saidne sajeuoneu sajgnbus say] nod 
ISEPUOS OP aSeq SUILUOD (STHN) AdAINS MOIAIOUT YITLOH 
[euOneN Pe] ap sped aj suep saseusul soy Jed soie[sap 
XNVIIPSU! SIOIAIOS IP SINISSTUINOJ Op SdjSI] Soy JOSI[NN,p 
guyiqissod ey] apma (SHON) sonsneig yea] 10} Joep 
jeuonenN a enb gsodoid e ‘(7661 Yorsepun,A) [lounod 
yoreasay [euoneN ‘sonsneig [euoNeN uo soayTWIWOD 
np syodxe,p odnois un ‘soguue sinatsnjd e A [I 
“UOTJRUULUOSUOD ap 
sudiq op Jarued un.p xtd say ins saguuop sap I[Iondes 1nod 
[!eJap Ne aJUdA PL] suLp sastTeIoads sjudUaSsITQeIa Pp UOT[] 
-uvyoe un,p saidne dd]J,| II[]qeia,p ana ua sguew ajgnbua 
‘AOAING SUIOIIg eB] Nod asepuos ap aseq ap MIs SdOdD ®I 
OP BIpLd d] SULP SdIL[DOP SJUDUASSI[QuID SAP dIST] PT “(SOSIP 
-UBYOILU OP JeYOR) SUOTIOKSURI] SOP SASITB9I UO s]I sjanbsoy 
DOAB SJUDWISSI[GeIa S3T JUDIR[IAP ‘Od],] Iqeie snod uo 
-ejndod ve] ap jnejuasoidai uoj[Hueyos un.p sgidne squowl 
ajygnbua ‘(SqQdD) AeAIng aseyoing Jo jUIog 3uInuNUOD 
PR] op sped a suep saiquiousp soseusUI soy] ‘a[qe 
-J0U UONdI9xa UN Sd (CGH ILIV A 19 JOARIT) SJUSASSITG 
-b19 Sop sgidne ja saseuau sap soidne sal[[lonool saguuOp 
ap puoadgp tnb ‘(Dqg]J) UoNeUTUOSUOD P| & XLId Sop sdIpUl "J 
“s}UdUassI[qeja Sop sgidne asepuos sed saygnbua say inod 
QSePUOS dp dsSeq op JUSWdIeI JUDSAIOS UOTJe[Ndod ke] ap Je} 
-uasaidai uoy[HUeYse UN ,p saidne ajgnbua | inod ssuuonse] 
-9S SOSCUDUI SI] SOAR SUOTIORSURI} Sap JUdNIDaIJo INb syuoW 
-ISST[GRI9 .P SAIST] S2] “(L8G ASPILA 19 WIOS|O,] ‘XOD 6/86] 


ZIBMOIYILIJA) dA) ouUIgUI Np saygnbus sane ,_p nod os8epuos 
ap aseq ep JUAdANOS JUaAIas UONRINdod Fv] ap soIquIOW op 
Juejussaidas uoj[Hueyos un ,p saidne saygnbus sap s1o] s9e1q 
-WoUsp SouUOSIad ap ja sasvUSU Op sajsI] say aonb SIOTY 
SW 
Sd] SIIP-B-1S9,9 ‘SJUDIUIASST[GuI9 Sop d]]Ie} B] Op sINsovU 9UUOG 
dUN 19 S]UDWASSI[GuIE Y SOP SINOANOS dUUOG UN jUINS 
-SB sojuRpuadapul asepuos ap saseq Sop ]UdSIX9 UOSvJ 99}99 
ap sond5uod sjuduassi[qeie sop saidne sajgnbua say] “aisap 
QUIITXNIP NV S9QUUONDITIS SaIUN Sd] JUOS SUOTIOeSURT] SOT 
NO 9 aTIIe} B] B aJfouuotsodold ayyiqeqoid oaav sQUUOTDTIS 
JUOS SJUSUISSI[QRId SI] NO S9ISOp XNop vB sseUUOT[NULYIE | 
Ins asodai x JOUINSd B WURSIA s]UdWAssI[qruja sap said 
-ne sajgnbus sap asepuos ap uryd 9 ‘WuawiayjoniiqeH “soyuoI 
-QJJIP So[qeliva op sIquiou pueis un inod y soy JowMNse 
Inod sjuswassi[qrid .p UOT[HURYSE UN ,p saidne ajuaTeAA[od 
ajgnbus oun WOAIDUOD B d}SISUOD DYdR) BY “agT[NoIed 
Q[IAIO aguue oun juINp (y‘"‘, =f) FJ WoWassi[qrid,| op 
SUOTIOVSULI] OP [2}0] DIQUIOU Z| ‘Pysed suojuasaiday *s}UdU 
-9sst[quid Y ep suONoRsUR PY So] INS s[QuIIeA OUN,P sind] 
-BA Sap sUIWIOS BR] ‘x Inod Sqqd PI & a]quordde uosdwoy yj, 
-ZUAIOH. OP ANaeuNsd,, Woep sponse juesaid a] 
‘uone[ndod ve] ap saiquiow op UoT]MURYdE UN ,p said 
-ne anbisse]o ajanbua .| 1a0e, dural Inod juessoigjut asepuos 
op ueyd un ajo Sq qd P| ‘JUWI9}OIIIP JOAIASQO B O[IOIJIp 
‘gstogiduut no azei uone[ndod oun sura9du0d agIpnid s]qQeLIeA 
RL IS ‘JUDUI][IoIeg “SJUSUIASST]QeIE,p UO|[WURYdE UN,p said 
-ne onbisseo ajgnbua .| ap Injao 190e]dwias snod juessaigqul 
asepuos op uvyd un aljjo (Sqqd) Adding JUOWYsITqeisq 
poseg uoneindog ev] ‘s}UaWlassI[qeia sao ap aijie) ev] op 
INSU SUUOG UN sed JUdSSTUINOJ dU NO S}UDUWASSI]qQLId SOT 
UdI Sed JUDIANOD OU Sa}UR}SIXD BSEPUOS Op saseq sa] onb no 
auepuddepul asepuos op aseq ounone o}STx9,U [I puend 


NOILONGOUINI ‘T 


‘9139]UI BBepUOs op ur|d ‘s}UDUOSSI[QuI9 Sop SUOTJOBSURI) ‘gsodiodns aseuUOTIHUeYDY :SATO SLOW 


“SAdd BI @ a[qvordde ‘syuawiassi[qeja sap ajquiasud | op suonoesuey 
So] Inod s]qeLIeA DUN Pp SINI[eA Sap SUWIWIOS eT IOS ‘x Inod uosdWIOY]-ZAIOH Ip ANayeuINsa | WOsp spore juasgid aT 
“sjUsWassI{qeje sop saidne sajygnbus sa] Inod asepuos op aseq ap JUdAJOs UONe[Ndod ev] ap soiquiau sap saidne ajgnbus oun ,p 
UO[[HULYII | JUBLUIOJ SOSCUDW Sd] S9AB SUOTIORSULI) Sap JUINIDaIJO INb sjuSWASsI[quia ,P SaISI] Say a]Jonbe] ap s1peo | suep 
S]USWASSI[GLId ,P 12 SOSVUDU AP SdT] SUO][HULYDE Ins aJanbusd oun sd (Sqgd) Aoaing JusUTYST]quisq poseg uone[ndog eT 


aWnsad 


(AZUATHS STU}? NAMAIS POUNOW 


uosdwioy ]-ZWAIOPR op Ansjeulnysa | 
:SasBVUIU Ip JueUISIIdI1 
UOT[MULYI UN ANS SIIpUOJ SJUIUISSI[Ge}9 Sop soidne saygnbuy 


El¢ 


epeuey anbijsiyes 
8Lz-E1z ‘dd ‘Zz .U ‘GZ |OA 
666| eiquedeap ‘ajanbua,p sanbiuyoe | 


‘assaid snos 

‘ppouvy np anbysiypis ajai20g ‘ajanbua,p sapoyjau sap uomzas 

D1 AP 666[ Jlanoay “s\ysiom Surjdwies suisn uoNnewNss voie 
[Tews sokeg [eoryosesory Opneasd (46661) MN ‘OV “A ‘NOA 

“CQI-ILI RIA] ‘esry ‘uounwnsy Day 

[JDUG UO adUuasafuoD aI1]]aIDS SSY] ayi fo S8uipaado/g ‘SO\AUL 

UONVITUNWWOD “SJOPOUL [OAd]-H[NUI Sulsn sueou vase [ews 
Jo uoneUINsa sakeg [eotyseIoIH (€6661) MN'f‘OVY 2 “A ‘NOA 

“AYISIOAIUL) UOJOPIVD ‘sonsHRIS pue sonewmoayIeyy Jo 

[OOYDS ‘1e10IDOp 9p dsgU, “‘UONeUINSY vol [TRUS paseg-[opoy| 
Jo} spoyrej\ paejoy pue sokeg feoryssessiy (6661) “A ‘NOA 

‘LYI-IEl ‘QL ‘aouasafuy puo suiuun)g JOINSYVIS 

{oO ]DUANOf “S[aPOU UOISsaIS9I IO1I9 pojsoU PfoJ-om} Jopun 
UOHLUINSS BoIe-[]PWUS UD (6661) “Nf ‘OVA 19 “Wd “TAXNNLS 

“CI-€ ‘07 ‘alanbua_p sanbiuysa, ‘suonnjos jo saula[qold :suoisel 
soied say (4661) fH “TALNVW 29 “'f ‘ONISINVD “d'W ‘HONIS 

OvsuLe 

‘09 ‘q Solas ‘a120¢$ JoousyDIS JoKOY ay) fo JOUANOL “UOTYeUISS 

vole [[BWIS Ul OID JO soinseow ysMUONbo snsIoA uvlsokeg 
(8661) ‘d ‘NNVWYasss ddd 19 “Wd “TAXNNLS “OV “HONIS 

‘OP-SE ‘OZ ‘alanbua, p sanbiuysay ‘aygnbua ,p ssguuop 

ap opie | & San[eaAd suUOIs9I sajtjad Inod sanbisoyouo1yo soguuop ke 
ASTdW (7661) “MA'd “SVWOHL 19 “fH “TELLNVW “O'V ‘HONIS 

‘ILb-SSb ‘09 ‘ sags “191006 

jpousyoig jokoy ayi fo Jousnor ‘sjapoul [eoryoseJory o3e)s 
-OM) UT SIOJBUINSO [BOS-3]dUT, (3661) “WL “SINOT 3° “A ‘NHS 

‘BO[JOA-JosUuLIdS syIOX 

MON ‘“SOl ‘ON SOUSIDIS Ul SAION ainjoaT ‘“SwpssO0Lg [DAapay 
SN Ul S4oouns| 1aIpuy (9661) OUPA) “TM “ATEIVHOS 

[PART ausioatuy) ‘onbruyoa} yoddey 

“‘Surjduies Adaing Ur s1OJeUINS| voly [[eUIS JO sIolIq porenbs 
urs [BUONIPUOD 2YUL (6661) ‘A “ALNOWTAd 19 “dT “LSAATY 


"8Z-L IS ‘7 ‘anbusiwys 

ap auUuaIpDUdDD aNnAad DT “eyep [PUOIJD9S-SSOIO puke SdlIas SWI 
SUIUTQUIOD Aq UONeUIT}Sa Rare [[PUS “(P661) W ‘NAP “MNT ‘OVE 

6 

‘UONDIIOSSY [VINSNDIS UDIIAAUY ‘Spoyla- YOMDasay Kaaing uo 

UONIAS AY] fO SSUIPAIIOA ‘CCP [EUOTIOIS-SSOIJO PUL SITIOS DUNT} 
SUIUTQUIOD Aq UONPUUNsa Bore [[RWS (7661) W ‘NA PX N TL ‘OVE 


‘CUS 

“LTS “KOLA UYOL 2YIOX MON “(SPY ‘NOY “S'd 12 ‘O8p2T10D [WW 

‘uosuensuy) “y ‘eddeuuryd ‘N’g ‘Jepurg “wd ‘xOD ‘D'd) 

spoylap Kaaing ssauisng :sueq ‘Apmis [eoriduie pue MdIAIOAO 
‘UOnRUINSE Bare [TRUS (C661) HD ‘AYHCNOHO 9 “WN'f ‘OVa 

“AVISIOAIUL) UOJAPIVD ‘AjTIQeqolg 

pue sonsieis ul yoreasay Joy Aroielogey ‘anbruyoa) woddey 
‘uoneUINsY Bory [[eWg Ul dNTad pure dd (8661) “Nf ‘OVE 

“Sbrl-pyrl *88 ‘VouDIoOssY 

JDINSYDIS UBIUaWUY ay] fo JDUANOL “UOTWINSS vore [Jews 10} 
poyjoul sakeg [eoiiduie-tsenb VY “(€661) “AL ‘NVHLVNOQHOVY 

'6L-EL ‘ST ‘alanbua_p sanbiuyoay 

somojegye sjoyjo e o[dwiis sjapow un.p usfow ne s}snqgol 
gyeuolsar uoNeWINSY (6661) “MN’f ‘OVE 19 “N'O'N ‘AVSVUd 

“TLI-E9L “68 “UOlDIDOSSY [DINSTIDIS 

UuDILIaWUY ay] fO JDUANOL “SIOJUITISS BdIL-[[eUIS JO S10 porenbs 
ual JO UONPUINSS OY, (0661) MN’ ‘OVA 19 “N’O'N ‘CVSVUd 


‘[lounoD Yosessoy [euOneN vO'qd 

‘uoIsUTYyseM “7 doy wuojuy “Cuaaog ui uaipjiy) asy-jooyos fo 
UONDUYSY DALY 1]DUS (8661) TIONNOD HOUWASAY TVWNOLLWN 

‘OININSUT IUYII}ATO_ 19389910 MA ‘onbruysa} woddey 

“SBOIW SOIAIOS YO “S'Q JOJ saqey Aqyewoyy Jo siskyeuy 
UOISSAISAY (3661) “T ‘ATAOMY  “f “MSNVUCAS “dd ‘AVYANVN 

"68-18 “SZ 

‘ajanbua, p sanbiuyoa] ‘NesATUN [NU safapoul op syed e sayeuoIs9s 
suoneuinse,p uononpolg (6661) ‘d “LIOH ¥ “dA ‘VAYNOW 

‘p71 “ST ‘sousunig 

pp1ff[OQ fo JDUANOL “YIOMOWELIJ UOISSdIZI1 JedUl] pozi{eouss 
SUISN SIOJUINSD VaIe [[BUIS JO UONLZIULSIQ (6661) Vd ‘YANUVINN 

‘978-S18 °76 ‘UONDIIOSSY 

[DINSIDIS ubIIUaUYy ays fo Jounor “KOAINS MOdIAIOU] YI[COH 

[BEUOHeN oy) UI satqelIeA AIeUTg JOJ DOUDIOJUT BOI [TRUS “(1661) 
‘A “AMATONT 9 “TD SALISVIMOW “f “ASNVUGOS “d ‘OFTVIN 


‘OOTE-68ILE ‘81 ‘auioipay ui sousuDig ‘yuouNsn{pe 
uoloejas o[dures Buisn souspeadid JYBIOMJIOAO JO SoyeUII]sS vore 
[Tews paseq-[9PpoW (6661) “X ‘OVO 19 “M'M ‘SIAVC “dd ‘OU TVIN 

“TEE-9TE “UONDIDOSSY 

[DINSIDIG UDIIUAWUY ‘Spoylay YIADasay Kaaing uo uoNIag ayy fo 

ssuipaa01d “(II] SANVHN) AeAing uoneuruexg uonmny pue 

YoY [EUONEN psy) oy) SuIsN sOUaTeADIC JYSIOMIIAO SayBUIT}SS 
vole [[RWS (9661) “*X ‘OVD ? “M'M ‘SIAVd “d ‘OF TVIN 

"SPE-6EE “69 ‘2ouasafuy 

pup suluunjg jooysynis fo ouanog ‘suiddeuwt aseasip Io} 
saves AUTEIOW JO UONeUITSS sakeg [CIIYIIVIOI (8661) L ‘LLIVI 

“SVT-LTT ‘78I “VW Seligs ‘Kia120¢5 

jooysynig jokoy ays fo Jousnog ‘suoniodoid pue sues vole 
[[ews suoMeUINso oseyULYs BVLRANITNIN (6661) L'N ‘GYOIDNOT 

‘OSL-6EL ‘78 “UOMIDIIOSSY JDINSUDIC 

upoauy ay) fo Jousnor “satdures deis}ooq uo pase sTeAo]Ul 
souapyuos sokeg jeoutdug (L861) VL ‘SINOT!? “WN ‘CGUIvT 

‘QOL-8SL ‘78 UOUDIIOSSY [DINSIDIS 

UDIUIUY AY] fO JDUANOL “SIOJUITSS BoIe [[BUUS JO 1O1Ja posenbs 
uBo JO UONPUINSS IsNQOY (C661) “M'N'f ‘OVA 19 “Wd ‘THIHVT 

“U[ODUIT-BYSeIQON 

Jo Ajisioatuy, ‘sonsneig pue sonewouleyy jo juouedsg 

‘gnbiuyoa) woddey ‘vary [[eulsg JOJ sasvasiq Wo1 Ai[euOW 
jo uoneunsy sokeg jeoutdwg (9661) LL “LLIVI 9 “Wd ‘TaIHVT 

THI-ETL EL ‘Sousunig jo1yyfo 

fo }ousnor “sKaains a[dwes xo[dwios wo suonouny uonnqmsip 
jo sunseL (L661) ‘d ‘NNVWYdssdadd 2° “WV ‘AaOgrey 

CI-1 ‘Ep ‘Siskjouy aipiupayjny fo Jousnor ‘[EpOUul eoUT] DOURLIVA 

JO1I9 WOpPUPI JapuN siojoIpoid paserqun Jesu] soq [eoIdura Jo 
Joua arenbs ues Jo uoneUNsy (7661) M'N'f ‘OVE? “f ‘ASSATA 

“AVISIOATU) DAIOSAY 

UWIaISaM aseD ‘sonsieis jo juouIedeq ‘onbruyoo) yoddey 

“SONSOUSLIG [PPOJ] POXIJY pue sorouonbasj s[qearlosqouy) UWA 
Bunsol x -uosiesg UD (8661) 0 ‘NM 19 “d ‘THIHVT “ft “ONVIL 

“AVISIOATUL) DAIOSAY WII}SOAA BSBD ‘sonsneig Jo juouedag 

‘gnbruyoo} woddey ‘1010Ipelg isog jeouidwg jo 101g porenbs 
ues oy) SuylUyyIVL “(6661) ‘S ‘NVM 19 ““d ‘TMIHV ““d ‘ONVIE 

“ul[OoUTT -eyseIgoN 

Jo AjISIOAIUA, ‘sosHeIg pue soneUoyeY jo juowWUedsg 

‘gnbruyoa) woddey ‘eieq Aleulg YA IOUdIOJUT Boy [[eWIS 
Joy uonoIpad isog [eoutdug (8661) ‘d ‘TYIHVT 3° “f ‘ONVIL 


gjepowW UN ins sapuo} ajeuoiHBai UONeUI}S,| JUBUIBDUOD SjUdde1 SeiBOId SeNbjenH :oey Zig 


‘O8Z-SSTZ ‘PZ ‘sousuMIg fo sjouuy ‘soido) pareol 
pur inoraryaq snojdwAse suoneunse TWA (9661) f ‘ONVIL 


“6LVI-LOPI ‘16 ‘UONDIIOSSY [DI1S1IDIG UDIUAaWUY ayl fo jDUANOL 
‘SJOPOU! PoXTW Jesu] yeoTyoIeJorYy ul Surjdwies sqqirg uo ssoud 


Jodoiduit Jo yo9}Jo YL (9661) ‘OD ‘WTTASVO 1° “df ‘LUAHOH 


‘6LE-PIE “UoNDIOOSSY 
JOIUSIDIG ubIluaUYy ‘spoylay YIIDasay Kading uo uUo11Ia¢g 
ay] fo ssuipaadoig ‘SJOINSIG. [CUOTSSdISUOD JOJ UOTRUINS| 


Roly [[ewg Adaing uoneindog wen (9661) “A “SHLAA 
“C6-SG ‘6 ‘a0UaIIG JoIUSYDIS “Testeidde 
ue :uoHeUNse kare [[PWS “(h661) “M'N'f ‘OVE 1° “W ‘HSOHD 


‘T8T-ELT ‘£6 ‘UONDIIOSSY [VIUSYDIS uDIUaUY ays fo ;DUANOL 
“UONUIN}SA BAIL [PWS JO} S[EPOUI IedUT] POZI[eIOUIDH (8661) ‘d'd 
‘NITHVO 29 “AML ‘GNOULS “A ‘NVIVAVLVWN “W ‘HSOHD 


‘OTJIASUILH-LPLIOTY JO AUISIOAIUL) 
‘anbiuyse} woddey ‘Burddeyy asvasiq 0} uoyeoyddy uy :eieq 
jenedg jo stskjeuy oy) Joy s TD sokeg [eoryoesstHH (L661) 
‘WT CMAN TIVM 39 “d SWI OX CNVIVUVLVN “W ‘HSOHD 


“LEPI-ETPl ‘16 UONDII0SSY JvIISIDIS UDIIMaWUYy ayi fo }OUANOL 
‘yoroidde uvisokeg e :sar[muey uosiad-inoj JO swWOoUT ULIPoUl 
jo uoneunsg (9661) “(H'd ‘WI 19 “N ‘VIONVN ‘W “HSOHD 


"ETI-EOT “ASTIAA UYOL 2YIOX MON “(SPY ‘YSUIS 
‘dW 19 [epules A’ ‘ObY WNL ANd “Y) Sousuwig vary jjowus 
sued “UONPUITISS Bore [[RWS IOJ [APOW JOUPTIVA JO sjuoguoduwio09 
awuRannwW oy, (L861) ‘WY ‘YSLYVH “VM ‘YATINS 


“AVSIOATU() 
2181S Ipjoquiny ‘sfepoypy JOM juoWoInseayy JO siskTeuy 
[eoNsNeIS UO sdDUSIOJUOZD Ke] ek QUasoId spony “[Opoy| Jog JUSW 
~oINSe| OY} JOJ sonfeA end] Jo UONSIPAd (6861) WM “YATINA 


‘QINJSUT B[SueLIT, YOIVISaYy 

‘anbisojopoyjgw ~woddey ‘asnqy sniq uo skaaing pjoyssnoy 

[EUONEN 9661-766] OY} WO saeUINSY paseg JOepoyy :s91e1S 
ul asnqy soueIsqng (6661) ‘V “HSIVA 19 “dd ‘HVHS “ad WOSTOd 

“UONDIIOSSY [DINSIIVIG UDIIMAWUY “UONIAS SINSIVIS 

p190¢ ayl fo ssuipaado1g “uoneUINss awodUuI pue Ajoaod 
Bare [[PUIS OJ pasn spoysW (L661) ‘d “THOAIS 19 “UY “MAHSIA 

‘LLT-69T ‘PL ‘UOUDIIOSSY ]DINISNDIS ubIIMaUY ay] fo ]DUANOL 

‘eyep snsusd 0} soinpadold ula}g-sawer Jo UONeoI{dde ue :saoejd 
[Tews 1OJ sULOSUT Jo soweWINSY “(6L61) ‘VA LOTWYAH 19 “aa “AVA 


“SOI-1OI “ST ‘SousiDig Ju)0Uu0s7 
puv ssauisng fo Jousnor ‘sousneis Areuuins pue sjapow 
UOISSISOI INSISO] SUISN UONLUINSS kore [[eUIS sokeg JeolIdwg 


(QL661) ‘f.L ‘NITYAAWNOL 1° “d ‘NOPEIDVW “fd “TIAYAVA 
"ESOI-S9OI “L ‘PoIMIgS DIUSUDIS “SUBISEP 

ade}siyjnuw ul suotodold vale [[eus Jo sayeurnsa sokeg jeourdurq 

(82661) ‘f.L ‘NITUAAWNOL 1° “dd ‘NOPAIDOSRW “fd “TIANAVA 


“SE9-LIQ ‘snsuay ayi fo nvaing 
‘SQ ‘aduadafuoy Yyouvasay JonUuUY C66 aYyl fo Ssulpaad0.g 
“KOAING 910-4 INOGLT UeI[LI] SY} Ul [OAD] [eIOUTAOId ye UONeUINSE 


ease [[RWS (C661) V ‘OSSNA 9 'S ‘ISYOTVd “d'd ‘ISYOTVA 


‘V8I-6L1 07 
‘ajanbua,p sanbiuysay ‘auuatyeyt aatjoe uoyeindod ej ins ajgnbua, 
Inod suo1s91 soyyjed inod uoneuinss,p sapoyjaw op onbiiidura 


uosteredwod (F661) V ‘OSSNA 12'S ‘ISUYOTVA “d'd ISYOTVA 


LL¢é 


‘C9 
-1¢ ‘|Z ‘aianbua,p sanbiuysa [66] ep epeued Np juatuasuadal 
3] SULP JOU JUSUaIGUIOUSP-sNoOs Np uOeSITaPOW (S661) ‘d “MOI 


‘C801 
-pLOl ‘76 ‘UOUDIIOSSY JDINSIDIG UDIUaUY ay) fo }OUNOL ‘So\e)S 


“S'f) BU} JOJ soyes JudWIAOTdUIOUN Jo UONeUINSS sakeg [eoIyoIeJOTY 
K6661)) TY ST Pr LVN TV eS Se VLG 

“SUdYIV-PISIOID Jo AISIDATUA) ‘soNsNeIS JO jUsWITeEdaq 

‘anbruyoa} woddey ‘vie [euotoaS-ssOl_ pur Sola SUIT], SUIS) 

saqeis Aq Sat[Muv,j UOSIOg INO,j JO DWIODU] URIPs|y JO UONeWINS| 
sokeg jeouldwg (6661) L‘LLIVW 1° “d ‘IMIHVT “SD ‘VLLVG 

“U[OOUIT]-BYSeIGAN JO AVISIOAIUA) ‘SONSNRIS 

pure sonewoyyeyy jo juow edad ‘anbruysa} uoddey ‘suoneoryddy 

UWA UOHneWINS| eoly ][euUlg Ul SUI[apoyY sowag WIT], 
sokeg [eoryoseJoIH (661) “TA ‘729 “'d ‘TMIHVT “SD ‘V.LLVG 

“SUdYIV-PIBIOAD Jo AjISIOATUG) ‘SONSIeS JO 

juoujiedag ‘anbruyse) woddey ‘swayqoig uoneUINs| voly-[[euls 

UI 1OJIPIIg paseiqu~ JesUTT ISoOg poleWNsY jo Ajureyoouy) 
Jo ainsea poyluy VY (L661) ‘d ‘THIHVT  “S’D ‘VLLVd 

“8ZE-O1E ‘PG ‘sisKjouy arpiivanjny fo Joudnor *sioino pure sayeu 

-PAOD JO dOUdSOId DY) UI SONSO}OVIeYS BdIe [[eWIS JO UOTeUII}SO 
sakeg [eoryoresary isngoy (C661) ‘d ‘THIHV7 ?° “S'D ‘VLLVG 

‘OPI-6Z1 “APTI FOX MON “(SPF 

‘QyamaQH “Wf 39 ‘JouoTeyD “WY ‘Auog ‘y'd) ‘saujawuouoosq 

pun sousyoig ui siskjouy uvisakog sueq ‘yovoidde uvisakeg 

& :solpmuey UosIod-Inoj JO BWODUT URIPIW JO UOTRWINSY (9661) 
I ‘NVIVUV.LVN 29 “N ‘VIDNVN “W “HSOHD “SD ‘V.LLVG 

‘6LT-69T “SL ‘aouasaful 

puo sumuunjg joousunig fo joudnor ‘uoneuss vore [[euls 

QCULAN[NU UT UONOIpaid sakeg [eouldura pue paseiqun Ivoul] 
isaq Jeouldwgy (6661) I ‘VMWSV4 19 “d ‘AVC “SD ‘V.LLVG 

‘uonesedgid snos 

JPY “S[OEPOP PEeXxIA JeouryT WQolg Sulsy~ sopqeue A Areulg Jo} 
uOHeUINS| Roly [TRUS (6661) A ‘NOA ? “WN ‘OVA “SM ‘SVG 

‘uoneiedgid snos ajonty ‘sjapow VWAONV 

POXIU [LIOUDS UI SIOJVUINSS GVT_ [BoUIdWd Jo sJo1Ia prepurys 
Jo} suonewrxoidde Japio puosss (6661) “MN ‘OV 19 “SM ‘SVG 

'P06-E88 16 ‘UONDIIOSSY JDINSIDIG UDIAAUY AY) 

{0 ]DUANOL “MIIADI DAYLILAWIOD & :SONSOUSPIP DUISIOAUOD OLD 
suo UleYyS AOL (9661) ‘d'd ‘NITAVO 19 “MW ‘SATMOO 

‘T89-1L9 ‘Ep ‘SIMjaworg 

“‘Sulddewl asvasip Ul ISN JO} SYST DANII PoziIpIepuejs-dse JO 
soqeulysa sakeg jeoutdwy (L861) ‘f ‘YOATVM 2° “d ‘NOLAVTO 

“6SI-ELI ‘LI ‘sousuais fo jousnor uvisryog 

‘ApNs UONENLAD Uv — S]e}O} ULLUOP [[BUIS JO SIOJLUINSd UOISSOIBOI 
pozieouas UO “($661) “M'V ‘AUVMIHGV 19 “Vv ‘IMNHGNVHO 

“PSS-6PS ‘UONDIIOSSY JDINSIDIC UDI1AAUY ‘SpoYylaW 

yoivasay Kaaing uo uoljoag ayl fo ssulpaazo4g “JUSWIDINSROUL 

snonunuod YAM seo [ews JO} suonsodoid pue soajel 
Jo UoHRUISS }9IIPUT (S661) “H'D ‘UAGNVX4TV }9 “N ‘GNVHO 

“U[ODUIT-BYSeIGaN JO 

AUISIOATUL) ‘SONSHeIS pue soneuIoyeJY JO UoUIVIedaq ‘anbruyse} 

woddey ‘sioyewnsg vory [[euls sokeg yeouidwg jo Qureysoug, 
Jo sainsesfQ 241 UDO (L661) ‘d ‘THIHVT “dd “YVAN 

‘001-69 ‘Lp ‘uplousuDig ayy “uoneordde 
SUE puke POYISU O[IRD aU] UleYD AOWLW (8661) ‘d’S ‘SHOOUT 


666| aiquwadep ‘ajanbua,p sanbiuyoo | 


TLE-TIE “€G ‘UOIDIIOSSY ]DI1SIIVIG UDIUaWUY 

ay) fo ]DUANOL “SJOPOW PdXIW IvdUTT pozi[eJouss ul sIO\oIpoid 
JO siolia piepueig (8661) ‘df “LYAHOH 1 “OL ‘HLOOU 

‘QE-87 ‘ER ‘UONDIIOSSY 

[PIUSUDIG uvIAaUYy ays fo JOUANOF “eYeP ajI[[O1eS pue AdAIns 

Suisn seaie dois AyuNod Jo UO SIpeid 10} [apour yUsUOdUIOD JOS 
UV (8861) ‘VM ‘MATIN 9 “We “AALYVH “A'D “ASALLV 

“E9OI-ESOI “L ‘IIUIg VIUSUDIg “suIa|qQo1d 

uoneuINsd vole [[eus Ul GAT 2) JOAO poyjoU uvIsakeg 
ayy Jo Aousdns oy) UQ (L661) “d ‘THIHVT 19 “A ‘VYOUV 


aIHdVaOOr Tala 


"SJONIISUOD SOITLJUIWIUUOD SINI] ap INa}oepel 
J 19 UOIEY WeyRIDH ‘JAI sO of “EpeULD Np s1Uas Ud jo 
SO[[AINIVU SIOUDIOS US SOYDIOYIEI ap [IasUOD Np syosdyII 
op asinoq oun sed agouruly a19 & apnia ojUasald eT 


SINGING dona 


‘g[eUuOISaI UONRWINSS | Inod satudoidde saxaydwios 
snd sajapoul sop & epoyJeW Indy sIpUd}d,p s[NN jeIVs 
[J ‘UoIsa1 Jed sinajyeulljsd sUOg ap Jo UONNGMsSIp suUog ouN 
‘JuOWasse[D UOG UN yUasInpodd INb «adi Jyoalqo» ev sinaq 
-PUINsa sap juasodoid (8661) Sno] 19 UaYS ‘sed sIoTUIJOp 
$90 Joe op juRNsutIed sapoyjsw sourTeyIId guIUIeXd 
UO (P661) OFY 19 YsoyH “word e gstd9g1d nedAtU UN.p 
SNnOssap-Ud NO snssap-ne jUsNIIS as Inb saurewop se] Jaradai 
Inod no saurewiop sa] Jasse[o Inod ‘saurgnxe uoneindod ap 
SINI[VA Sop JuRUASId sauTeWIOp Soy Jo9dal ap isa JNdelqo ,| 
1s sogtidoidde ang sed ou juaresinod sagsodoid sapoyyeu 
SQ] seul ‘uOIsaI ayN0d Jed souuaXou sap no xne}0} sap 
JQpow uN Ins saseq UONeWINSd,| SUTLUILXD SUOAR SNON 

‘g[Qpoul Np saeuiesed sap sajoa09UI WoUd e suonng 
-ISIP SAP WSIOYd UO ,Nbs1O] JUSpNd JaQUOU dS Bp JUSTAUOD 
[I ‘€°€ UONIS BI B PUSI[NOS SUOAL | SNOU SWIWOD ‘sTOJaINo TL, 
"«S9JOVXI» JUOS SIOUDIYJUT S29] 19 SOxa[dwiod sawg[qoid sap 
Joye) ap Joulsod aja sed ‘ajuessind syeuorsa1 UONeWINSe,p 
dpoujstu oun jso (GH) sadvg ap onbiyosesst1y spouou! PT 

“SUOISAI Sajjod sap somouresed 
Sop ODOIIPUI UONPUINSA | & OpNid 91399 dIpUdad .p a[IIN aN 
weunod |] ‘uoT[MURYDY,.| Bp UONDITIS Op s}o}jo sop a3dul09 
jusuuen Inb suoIse1 sapueis sap saneureied sap a}90IIp 
UONPUINSa Pp Sopoyjoul sop juasodoid (166 |) UURULIAIJoJg 
yo JosoaIry ‘suoneordde soureyiso inod sgIjf9A ong 
sed ou y1eunod a8epuos op ueyd np aj}dui09 s11u9} sed ou jned 
uO aT[anbr] UoTas aseyiOdAy | steu ‘sInayoUOId JUOS 9IIUN | 
op NVIAIU Ne I[epoOul UN INS sgseq UONRWINSE,| B OsepuOS 
op splod sap uonrisaiul,| Ins syUd091 XNeARI] Soy] 

‘ASCUUO][NULYDE Pp S9OULIIVAOD 
Sop d}dWOd I1Ud} SIOTL IN} [I Jed ‘sanbisofOUoIYS NO soUVA 
-I][NU UOIZal BP] 9p NVIAIU Ne Sa[epoul Sap asi[4yn UO puenb 
anbijduios as ayoe) sN0D ‘aseUuUOT[HURYSE,p sooURLIeA 
sop suonewulxoidde sino[[loul ap 11U9}q0 ,.p oNA Ud XNRARI} 


Sa] AINsInod WOp UE *(8"¢) 19 (L'E) WO. | ep sanayewmnsa 
SOP SIpPIeA ve] Ins onb sure ‘Inayeurnsa,, op uorstogid P| 
INS DOUIPIOUI JUN B dIId ‘sIOJaynoy ([°Z) eseuUOT[HULYDE ,p 
g[apoul a] suep ‘gsap auudkour vy] JUDUID}D91I09 JastOgId 
dp UONIPUOD & (Gq) AN IdWA SiNayeuiljsa sap seo a] suep 
J[QPOW Np sieiq ap dduasqe | INS sdUaNTJUI 9UNONe JUO ,U 
‘hh op UONUINSA | JUDYORIUA INb sinad say anb JaUsIpNos 
Op WOIAUOD [J] ‘sasnayowoId jus;quies (p'¢ UONdeS) 
suonrvoydde say suep saasi[yn sapoyjaul say Is oWgw 
‘QATIOLNSOI Zasse 1sa sanuUOd yUOS ‘’ ‘aSvUUOT[MURYDE,p 
SOOURLIVA Sd] a][anbry uoas asaujodAy | ‘stojainoy, ‘uoTe] 
-ndod ap syun.| ap neaatu ne.nb uolsal ev] op nesatu ne 
SOITVI[IXN SAQUUOP Sap I1U9}GO ,p apIORVJ snqd ysa [I,nb dosed 
‘uonerndod ap gi1un | ap nedartu ne sajapoul say onb apuei3 
snjd o9j10d oun yUO UOISaI BP] Ap NIATU NP Sa[apoul sa] 
“OIAINSINOd 3S JUAIOP SIIOWTL $dJJo 
@ SI[Q9POW sap asAjeur..| Ins ‘quuatsaXeq onb sure onbisseyo 
INJeU op ‘XNVART] SIT ‘SAXIJ sjyojyo e yUoWONbriun sodA} 
SOITVQUIT UOU Jd SoITeaUT] Sofapow xne saenbiydde sayjao anb 
atipuojoidde issne uodsej ap sagipnie aja sed uo ,U samojegye 
SJOJJO B SofQpow soy Joye Inod sajuvjystxa sapoyioul 
So] ‘slojaynoy, ‘suonvordde sina] asuysny{ji 1UO 3a sayapoul 
So] Joplyea Inod sapoyisw SasIoAIp gst[N jUO sane .p 
12 (8661) [ouNoD Yoseasoy [PUONeN 2 “(%6661) OPA 
19 NOX (6661) NT 19 “WR “WryRT “ened “(L661) ‘1109 39 
dATP (S661) AIC “(H661) OPW 39 YSOYD “(6L61) IOWIEH 
10 AB ‘aTQ9POW UN INS s9puoj UOTJeUINSd | SUBP JURIOdUII 
JJO1 un juowaes9 onof sjapour np uonepyea ey 
“*XNVIIPIJ SOUISTULSIO Sd] IUD UOT}eIOgeT[OD 
PR] 19 UONPUIPIOOS PR] ULIOI[SUIe Ud solIel]Ixne saguUOp 
XNV $Q9d9B J JOUIOVJ NVI [I ‘(Q66T) BTQIeYyoS JoNbrew yey 
B | SUIWOD “d[QpOu UN INS V9pUOJ DOUDIDJUI | SUBP JOTJUASSO 
J]O1 UN yUSNOl sagIpNId SaTqelIeA SI] JURUIIOUOD SoIeIIXNe 
soguuop sap suyenb ey ‘aouopnid sae sJapouw uN INs sgseq 
sopoyleul soy Jonbijdde e yuasi~qo sajuaoel-snos sasaujodAy 
So] steur ‘sjuBvUUOIssaidut juos suoneordde say 19 sanb 
-ISO[OPOYIJEU SQIZOId Sa] “a[QpoOu! UN INs sgpuoj a[eUOIsaI 
UONPUINSS, | Ins saguuR saigtuIap burs anbyanb sap sinoo 
ne satjqnd sajonse sap ndsode jorq un suouuop snoN 
‘unoNe dIIOA ‘UOTTHURYSE Wed UN ,Nb sagtaid 
au uo sjanbsgj nod (suoisal) soureWop sone .p JUSWINSp 
ne SgIPNi9 SOUTRUOP SUTeLIIO JOUUOT[MURYSEINS B UOSe] ap 
ajenbua | JUsUIaIEqI[ap 2AtoSuod UO ,J anb dALUR [I ‘| UOTDaS 
RP] & SUOUUONUSW 9] SNOU SUTWOD ‘soinsowW op alUas 99 
sud oak side swigur ‘sastogid JUSLUURSIJJNS SUOT}RUIT}SO 
sap alinpoid inod aynod don ang Weunod saipnia sourewop 
SuIv}I99 INod UOT[MURYDY,| OP JI][Ie} eT ‘sSuONvor[dde sasnaiq 
-WOU op Inod ‘sIoJayno], “sJOSIIPUI sINdyeUINsd,p ULOSaq 
J] JUSWII|QeJapIsuodD s1INpei juarelnod ‘(pE6I) [AUR 
J9 OUIQUIRY ‘YysuIS Jed sagsodoid sajjao anb saj[ay ‘asepuos 
ap urd np uoneiogeys,| op apeis ne saatUdAgid sainsouw 
ap asud ey ‘sayeuorsai sonbnsyejs ap uononpoid ey ins 
aoueproul oun yuo Inb ajygnbua,p uondasuos ap sowayqoid 
SOP JUSWAAIIG gINSIP SUOAR snoU *[ UONDES RT W 


NOISSNOSIG ‘Ss 


8|apow uN uns eepuo} ejeuo!Hei UOIFeWUI}sa,| JUeUIBDUOD S}U9DEI SeiHoud senbjenH :oey OLZ 


“TR61 19 TL6I BUA LINOSSIPA NP Sa}WIOD ¢ | | Saf Inod aoued 
Jed 91[eJ0U ap xne} ne puodsai0d saguuop ep s[quiesue 
sUgIxnap a] ‘(axas x a8") sonbrydessowep sodnois oenb 
yo sonbiydeiz098 suoisel g] uolas sadnosas sadnois ~9 
sop unoevyds inod asuodal ap saliosajeo p» sap aunoeys 
SUP SINIT]IeAe ap UOMIOdOId P| IBUITSA,p 18d LOI JNDalGo /T 
«{ [GARI] Op Nal] ne gjues VP] Inod sanbs sap ve UOTTsOdxa ,| 
ap aysvjou jayja ino} ganoidg snoa-zaay» uoysonb ey ke 
‘saliosayeo aiyenb ua sagsseyo ‘sasuodal sa] pudtdui0d ‘1 66 | 
ud sagUuUOTOsIas epeuRD np sonbrydeiz093 suOoIsal C| 
ap uoneindod x] ap sfquiasud | ap UOT[MURYSE UN INS 9puoj 
‘lotwald a] ‘saj[aei SaguUOPp ap SaTquidsud xnap k s}ey[NseI 
sa] quonbiyjdde sind ‘sasijeiguas so}XxIU SoiIeaUl] Sa[Qpouwl 
xne gH epoyjgu ey juonbrjdde (g661) “1109 19 ysoyD 
‘WOOW sepoyieul sap red axouu09 
WIOWa\sod B doURLIvA PR] JUaTNITeO 39 aJgnbue.p spriod 
sap a}dur09 jueus) qH-opnesd sinayewiysa sap JUdIOQRIA S|] 
‘0661 & P66I OP VaUSUW asnqy Sniq UO sKdaAIng proysasnoyy 
jeuoneN ke] op soauuop soa] saide.p sureogue sjieiq 
SO] SUBP STULLIODIXO} B] OP UONRUINSA,| Op a1X9]U09 9] SULP 
SOST[RIDUYS SO]XIW SoIIvaUT] SoNnbYSIsO] So[apowW say JUaIpNIE 
(6661) YsteA 30 YeYS ‘WOS[O. “souRTquasTeIA-opnasd 
oP UOOUOJ OUN Pp JURAIOS 9s UD BSeUUOT[NULYIE,p Splod so] 
JUDISQUI SIV ‘GH SOpoyjoU sap Ins ‘Issne xno ‘juatndde ;s 
sindine Sed “(ITT SHNWHN) AeAins uoneunuexg uonwnN 
pue yyeoy [euoneN ve] op soguuop say saide.p (suoisa1 
sajyjed) sadnois-snos sureyisd suep 9s}Isaqo.| op doUd] 
-eAgid eB] JOWNSsea Inod saixtw saitesuty sanbnsiso] sayapoul 
say quanbijdde (6661 ‘9661) 8D 12 SIAR ‘sale 
(6661 “T199 
JO Seq) AUD] sjqeuea e spousal oun sed suorissaidxa ,.p 
a1ues 399 jUuaNgGo uO sjanbsay inod sjiqoid sap sayxiw 
SOITVIUT] SO[QPOWW Sp Svd Ne JUDUWIIILIIUOD ‘SqqIyD ap sseu 
-UOT[HULYSE | Inod salessad9gU SaT[2UUOTIPUOD SUOTINGLISIpP 
Sd] $9INO} INOd dgWII} SWIOJ US UOISsaidx9,p sed a}S1x9,U 
[I ‘soIXTW sorteguly sanbrystso] sayapour sap seo a] sued 
“SQ[[IOI SINI[BA Sap Sastogid sad JUSWIaSUadeI Sp SUONRUINSS 
XN& S3[QPOU 39 SA9poyJeU SosJOAIp Jed sayinpoid suonewinsa 
S93] JUDIVAWIOD S[I ‘Q6G] SP JUSWIASUDDEY Np s][Ielep o1leu 
-uonsonb a] 1duwia1 yuo inb sauuosied say inod sagarasqo 
SOIVUIG SI[QRIIVA SOP oUN | INOg ‘a[@poul np jusuraysnlP ,| 
Janjeag Inod UuONedIJLI9A-31]U0D ap Sapoyjew sap juanbrydde 
S[] ‘AOAING MOIAIOUT YIVOH [eUONeN ek] Bp SoauUOp sap 
JURAIOS 9S Ud ‘sonbrydeisowep sadnois sIdAIp op suonsiod 
-o1d sa] Jowise Inod gH epoyreul ouN ja SayXTU SOIIVOUT] 
sonbysiso] Sa[@poul sap JUasI{N (£661) “[]O9 19 Dele 
{UOISAI BpULIS BI OP INdJeUINS9 | Op d[[OUUONIPUOD 
WOd,| UO-iellUljap JUSUTWIOD “UOISaI1 spueIS oun Inod 
Ino eUINsd ,[ 11u9}q0 Inod uorsal ayned sed sinayewNsd xnap 
SUIOU Nev Jas9I9e ynvj [I puenb suonipuod so] Jastogid snod 
SIAINS B OYOILW P| Op UIeYO sed js9,U UO ‘aINNO U_ “TROUT 
3[QPOW Np svd I] SUP SUIOW Np ‘a]JaUUOIPUOS UOU WO, | 
op UOISaI Jed sinayeUINsd sap I1ua}qgo ,p a]qtssod jsa [I,nb 
aNUOU (8°¢) INO, | OP Inoyewiysa | ‘ste “SO}XTUU SaITesUI] 


60¢ 


S3]QPOW Sop 3}X9]UO0D J] SUBP IIGQeIQUIES 919}19 UN JUOW 
-ainatigjue gsodoid Wear (686) JoT[N4 “UoIsal ve] e aidoid 
}$9 [9 Ivd ‘aT[OUUOTIPUOS UOU FAA, ] enb syypiqeuea ev] op 
ausunied snd ainsoul oun 3$d ‘UOIS9I SUIQI-7 RP] INS soguUOp 
So] QuUOp jUeId “Ad Np afouUoNIpucs FO A,] onb 
JUDUUITINOS (8661) UEQoH 12 YIOOY ‘sagipnje a19 a109ua sed 
quo ,U UONROTT]duuIs 33399 ap saiatudoid sa] ‘yedgp op Anaya 
UILUOD JoTCUIOD UOTTHULYDY | Op JURUIAOId SUOTIRWIN)SO So] 
juvuoid usa uosydey-uo MaN op SWIUIIOS]|e | ap adej9 apnas 
dUN ,P Was IS UO] IS S[NO[Vd Sa] JUSWIA[QvIapIsUOD IINpol 
jnad uO ‘ane,| sgide oun] uotsei onbeys jueutiddns ua 
d[Qpoul np sanowiesed sap YA SUONLUITSA Sa] JO[NO[VIoI 
dP alessaogu Jsd [I ‘SIOJaNOL, “asnayyawoid apquuas ‘WO. 
OP $}9dI09 DIPIO SUIIIXNAP ap sINayeUINsd sap Be UWI 
Inb ‘apoyiaul sNd_ ‘ast[e1gUuas d}XIUW SIIVOUT] 39 VsTTeIgUES 
[BUIpNTsUO] dIvaUT] SaTapoul xnv s[qvordde ysa nb WO. | 
op uoNeUINsd p ajiuyyoel apoujsur oun juasodoid (666 1) 
UBAA 19 Lye] ‘“SueIp * | WW aIPIO .p oa} Ne Nbsnf 9}9a1109 
qq Inajeuinss | op INOT.| ep uoneurxoidde oun yuswsese 
jusuUaNgo SII Ro 12 g 2[Qpowl np songuresed sap jusWOU! 
OP SINDJCUIT}SS SOP OPOYIOUW B] & IdBID ‘BJQ9powW np saew 
-eied sap wold & UONNQU)sIp sunone ,p a}dwWod nud) 1s9,U [I 
Jeo ‘guidoidde snjd ane wesnod tnb (qqy) enbridura 1naq 
-oIpaid Ind][IowW ap WOU I] {A ANayewINsa 399 B JUOUUOP SI] 
‘Q]JoUUOISUdWIpIUN onbrisunuU UOTeIZIUI Jed JUDUID}NeX9 
dq Inayeunjsa | JUDUUNNGO 39 QUUONUSUUSNs sfapour 3] Inod 
dq voneuinsa | JusWeTes9 JUsIpNIe (R661) UlyeT Jo SueIe 
‘ISSNY OIIVQUI] UOU $kd 9] SUBP $]DdIIOOU! sIPIO DWIgIXNEp 
ap syei[Nsai sap sitnpold yesnod deys}oog spoyyewi ev] onb 
Jasuad e JUaUUOp dleaUl] Sed 3] INod (£66 |) UlYyR’T 30 Jeng 
Jed snuajgo syei[nsei Soy sie “Ga Ino}ewNsa | B salo0sse 
DIGVUeA Rk] OP daSWIOD UONeUISA UN ITUa}qO Inod 
(L861) Stno’T 39 pile’ op dens}o0q aspoyjowl ey yuonbrydde 
S]] ‘d[BO0] UOIsaI ev] Inod se uonsodoid ve] ap qq Inayew 
-s9 un J1ud}go Inod if) SOP I[UUONIPUOD UONNQIIsIp 
eR] op uonewurxoidde sum0s SENS ejeutrou uon 
“NQINsIp oun quast[sn sf] 16 O‘O)N . la no ‘A +g? X= 
cc! Q- 1)/9} 30} UIOJ BI ap 3s Tiosrer ap onbnsiso] 
g[apoul aj enb 19 ("g)qInoursg _~ “9 |" oul} e| ap ise 
ISeUUO][HULYIE Pp I[Q@pou 9] anb atesoddus ud ‘A Solleulqg 
So]quuea Sop & Gy UuONeUINSa | ap UONeoTdde | iuaIpnie 
(QL661 “VL661) UleqUIOL, 19 UOQqInoR ‘Teue{ 
SI}XIUW SITVIUT] SONDYSISO] SIP2PO|, —-9°7Z"fp 


“QOLIVAIUN IPOYIOU! LI OP SSUOVOTJJOUT Nv JUSUIDTQeISpIsuoDd 
Joipswia1 op jouuod osateanynur ospoyjeu ey, aonb 
JUIIUOW ‘S9[NWIIS sUOT[HURYSE Sep JINpold MOAR saide ‘49 
Sd]JOO SINTRA SI] SUILUOD SOUITISS SaMQUULIEd Soy JUSIPISUOD 
SI] ‘BMO],] OP aud Np 32 PION Np sawos ZI = wu 
Inod vfos np 32 SIV Np dINj[Nd LI] & S9QIOBSUOD SUOISAI Soy INS 
‘[]09 19 Saye g Op saguUOp Sa] sgide ,p SaUVAT[NUW Satapoul 
Sind] op sonowesed soy USUITISS s]I ‘ANNO U_ (8g61) 
Jg][NJ 19 JoWeH ‘osoneg sed saguuop soselixne soyqeiiea 
SOP SINI[VA SI] INS 39 UOT[MURYSE,p SoT]Ie} So] INs JUepPUO] 
aS Ud UONR[NUIIS Ua opNja oUN yUAST]RAI ST] “SoeAN|NWU 


6661 eiqwacep ‘ajenbuse,p senbiuyooe 1 


IONOQUId INILIA & UOISSaIZaI1 ap sayapoul sap inod FOA,| ep 
$]09LIO9 IIPIO PUODAS ap SINayeUIsa Say] 19 (Gq) AN TdWA 
SINDILUIT]SA SAP JUSUUITIQO (666) EMESE J9 Ae ‘eNeG 


SILVA [NUL 
IIPOGUII INILII  UOISSIASII IP SIJIPOJA] -S*Z"p 


‘saxojduuos snjd yuos sanbnoidurAse 
suonipuod say jenbay snod (¢]°Z) gsiyeiauas soueLIeA 
PR] Op asA[eur.p d)XIUI a[apoul ne s}eI[Nsa1 sao JUSpUdIE 
(6661) NOX 19 oVY ‘seq *(, W)O Ip10.p airejuowiayddns 
SUID] UN IITBIYSNOS SP JUSTAUOD [I ‘AJA SINIJeUINSA Sap svo 
a] SUR “AJ NO YAW SINICUINSS,p JURAIAS 9S Ud ‘IO. 1 
OP S$}IBIOD dIPIO BWUAIxNEp ap saxouUOd sInd}eUIIsd 
S21 19 GN Id Sinayeuiysa sap jutod ne stu 4uo s]f (Z1°Z) 
SQOURLIVAOD Sap SdO]q Jed a[eUOSeIP dOLIIU JOA VsI[eI9UaS 
9IXIW d1IBQUT] B[QpOW 9] WSIPNId (2661) UIYeT J9 ENR 

SIST[V.IQUIG S9}XIW SIAVIUT] SBJIPOJ. fT" 
“SIUP)-SIeI Sop (SUOIS9I 
sained) uonroyqnd op suoiser ¢p=w Inod sadtaies 
}9 SUIIG SIOAIP InOod UOTFRWUOSUOD ap soUUdAOW SoIIep 
-PuULOpgoy posmedop $9] JOWINSS Inod sjzeI[Nsai sa] juanbiydde 
9 ‘“(Q‘D)O . ai 70 juesod ud jInpel sapow np gqH asd] 
-eue | & juapeoord S]] ‘asepuos ap sprod say jueisajur A 
Ud DLOJEY|e INILII,P IOULLIKA B 9IUN | Op NVIAIU Ne o[apoUL 
Np WNpes sjapowl un yuasinpoid (766 |) Wlye’T] 30 PIOIY 
‘[Qpow Np 
sonoueied sap uolewinsa,| & anp ay[iqeiueA el asp ajdu09 
UBUD} Ud ‘PIO UOs JoWNsea Inod sinoJ-pile’] op densjooq 
Inayeunsa | yuanbrydde yo ' A uolsgi aed e] inod suusXou 
el op qa qos? | quouuengo si] “(gq ‘v)9 ae es 
anb juasoddns ja 'o aiojegye Inala,p souRLeA B 9}IUN,| 
OP NKIAIU Ne Japow 9] WSIPNIE (1661) UIYR’T 19 VIOIYV 


IMLOJEI[S INILII,P IUBLIBA B SIPPOP.  €C°7'P 


‘(€) 19 ({) seyapour say aonb saguuop 
xne gisnfe xnaru 3sa (Z) ajapour a] onb ayUOW SsuatIsgheq 
$1S9] sap uoneordde J ‘ar0yegye INdL9 Pp IOULLIVA B BJOPOW 
UN (¢€ 9 D[BSOUI JSO INDIIO,P JOULIILA LI NO s[apoul UN (Z 
*‘SUOISOI SOT S9INO} INOd SUIQUI BI ISA INDIIO,P DOULLIVA P| 
NO J[QpOul UN (] JLOARS & ‘S}OUNSIP XNVIAIU XNOp & SoTQpoul 
SION JUDIPNId S|] “SOUUDI[ISaIq soguUOpP xne GH sepoylow 
soy quonbiydde (e666) OPY 19 NOX “ayovoljjo.p ules 
3] JoNUOU! Inod d9I1OqQUIa INA B UOISSOIB9I Op I[Qpowl 
3] Inod snuajqo suuskow WFWOA,| IP INs[ea ve] kB sind) 
-BUII]SI SOP DUUDAOUL 93991109 JIPIO DWIAIxNep 9p WO. | 
juareduiod s]j ‘suoisai sayed ¢/ ud sadnoisal [Isoig np pns 
Np [[eJap op SuIseSeU [CG OP UOT[HURYdE UN,p jUvUdAOId 
sogquuop xne snuajgo Isule GN’ Td Sinayeuinsa say quonb 
-1[dde sj] ‘xneaatu xnap & safapoul sap Inod JFWOA,P ps0 
DWIIXNAP IP $19dOD S9XUUOD SINIJBUIT}SA $3] 19 CN IdINA 
SINdJVUINSS soap jUsUUDNGO (6661) WOH 30 eNO 


XNBIAIU XNIp & SIIPO|. ZT 'h 
“SJOUUOISUDULIPIUN SaTIPOUL Sap sed oJ SuLP 


anb axafduios snd 3sd WOd,] op SANoaeUINsa sop Jye[os 
steiq np yuoWaIOdwI09 a] anb sasuad & JUDUUOP (6661) OPA 


12 [OYNIS sp suONK|NUIIS Sap syeI[NsaI Sa] sjouUOIsusWUIpIq 
IOWOQUID INDIO B UOISSIIZ9I IP SdJQPOU! Sap seo a] suep 
WOd.| 9p (e1p10 swWaIxnap ap NO) sasieiq UOU JUSWIA] 
-PWIXOIdde $]931109 S9XOUUOD SINAJCWINSA Sd] 19 EN IdINA 
SINBCUISA sap jUsUUDNGO (6661) COPY 19 [aymMsS 
“OUUN | Op NVIAIU 
ne aseq ap s[apow! 9] Inod sanuajqo ‘sakevg ap sapoylau 
Sd] Ins ‘ued ane ,p 4a saouanbayy soy Ins ‘wed oun, p ‘sdaxe 
Ind1d | Ip sainsaur say sonbruiduss ya sanbyyATeue sapoyjeu 
sap ied juaredui0d (966) UURWIAJJayg 19 JOYMIS ‘ysulsg 
(6661) OPY 19 peseig OP AN’ IdWa-Opnesd sinayeunsa 
xne safqeiedwioo sinayewinse sap ywnpoid inb qH-opnesd 
spoyjsu oun julod ne siw UO (G6G6l) COPY 19 NOX 
("Q) WO”7.| ep 100109 o1ps0 oWIaIxnap ap InoyeWINsa uN 
ISSN¥ JUDUUINGO (666) OY 19 pesvig ‘asdepuos op ueyd np 
a}dwWi09 11u9} sed au ap ayqissoduit jsa [Is SWIQUI ‘aTapour Ne 
19 BSepUOS op ULI Ne JUDWIANLIAI 9SIVIG UOU JUSWIIATIRU 
-1xoidde ee ‘gfgpour Jed gysisse yso inb ‘inajyeunsd 19d 
‘¢ ro) Toye 'Q= “9 AN IdW-opnesd inayeuinysa d aene 
mod fo|duudo J[2poul np suonIpuos ee BuEP ’0 12 ‘o 
J[QPOUL NY SAULIOJUOD sunayeuNse say Jed ? 70 19 °0 snuuooul 
sanoweied sal yusoer[dwias spi ‘sing ‘(guun | op nevoaru 
nv IsVUUO][ULYII Pp Ja[dWOd sjapow Np suONIpUOd so] 
suep GN TdW Inayeuinsa,| ep egyjip [I.nb eored GN Td 
-opnesd ap aytenb jsa inayeunsa a0) puvss isa ‘AV IS 
'Q = a no jo Het ndos op Senne SOUUDAOU SOP INDJOSA 
3] 189° OK. no (fa ae re) ‘ON fii = “a onb aTeIOU ud ti ) 
JINPSI JJQ9POW! J] sade P ce fe) “'0)"g SuOSIp ‘ *0 12 70 ap 
saxl] singyea sap inod ‘'4 + rg! Ke fe =P aNTaW- opnasd 
Inayeuyss un apa ia SII Lach “a 79 ax inod SOITR[TULIS 
suotssaidxe sap 19 "a! jm = "Mm one Coa! =“ nO 


(I'p) ee) tee q*’x =k 


v oUN | op NeoAlU 
NV ISCUUOT[NULYSE Pp B[QpOUW 9] Ploge Pp JUaSINpal S|] “o}USU 
-Sne ‘'u ‘uoT[HURYoY,| ap aI][Ie) ve] aonb oinsaw RB osepuos ap 
uejd ne jnejad su9S19AU09 JUaINaUAp Inb 39 “M aSepuos ap 
sptod sap juapuadap tnb ayapour sed saqsisse sinayeuwitysa sop 
INOQUIA INI B UOISSAIB9I Op BJQ@pou ds] nod yUsuUENGO 
(6661) OY 12 peseig ‘asepuos op spiod sap sed yuapuadeap 
OU 9UUN.| OP NVdAIU Ne B[QgPOW UN INS sapuo} sINdyeW 
-1]S9 SQ] ‘Z UOTINGS LI B QUUOTUDSW SUOAR | SNOU SWUIIOD 
‘sanbnayuds no sajjae1 suoneindod sap 
Ins juvyiod uonejnuuts red sanbissejo sinayeuitysa xne JUSU 
-aaneieduios uoisel ayned oun nod [e}0) np EN TW ne} 
-PUII}S9,| OP UOISIOSId B] JUDWIITeS9 JUDIPNIE S|] “Sosudanua 
-sajgnbua sap 31x9]U09 3] suep UOIsaI aed sed uoNeW 
-11s9,| op ndsade un juouuop (S661) AZypNoyD 39 ory 
1 
‘Z UOIIDAS PF] B QUUOTUSU B | UO SUTUOD 
‘SO}XIU SAIIVOUTT SANDNSISO] SAa[QPOUL Soy 19 VLOWwE]e INI || 
OP DOULLIVA PR] IP Sa[apoul soy ‘xNeoAIU XNOp & So[epoul 
S9| 19 S[OUUOISUSLUIPIG SA[QPOU! SI] ‘SSLIVAN[NU SITQPOUL S23] 
juonjour uoneindod op 9i1uN,| op NVdAIU Ne sa[apoW Sa] 


IIHOGUII INIIAI B UOISSIASIA IP SI[IPO]A] 


IHUN,| 2p NBIAIU Ne Sapo, Z'p 


gjepow uN Ins eepuo} ejeuo!Hes UOI}eWISa,| JUeUIBOUOD sjUsde1 SeiHoid senbjanH :oey 802 


“'g Re aseuUol[NURYoe,p 
gjapour aj Juenbijdde ua sanuaygo saljao ap aanRollUsis 
uodse] ap JaJayjIp juaanad (p'Z) asvVUUOT[NULYIE Pp dJa9pou 9] 
juenbijdde ua sanuaigo Wdo0laysod v SdOUdIDJUL Sy ‘SaT]Ie} 
sajjed op suoyjnueyse say inod ‘anb JOnUOUR inod dH 
sapoyjeu say anbiydde yt ‘('4) 80] = = ; ‘aA 
anbjursoddng ({‘Z) uOstel] ap sJapoul AI 0 ‘9 a 
-UBYD9 ,P SINDLID So] DdAv “ZX B (p'Z) aISI|RAI snyd asvuUol[y 
-uryo9,p ejapow np uoneoydde.| sipmig (6661) NOX 

“saque.liage 
SUOISaI Sayed xne Ayoned ap uonqiysip ey juonbiydde 
s[L ‘sonbnysiso] 3a aovjdey] ap ‘47 ap SuONNqI}sIp sop ynjoul 
IIOSIIO 99D “'A SaO|e SloJjo Sap sayewoU suoNq 
-ISIP op Saiapuod sasuejsul op a110sa}e9 oun kv snsnfuod 
UOIZAI RP] OP NVIAIU Ne Iseq Op dJapoW Np UdAOUL Ne a}snqol 
GH wvoneuinss,| Wosigpisuod (C661) HY] 19 ened 


SUOISUI}JXI SONY Pp Tp 


“«<YOURTG deI SP SUTWOY | ZOYO 
SNPUOJUOD JIDURO ap SdasaIs 39 SAdA} SNO} IIPe[eU! ap d1I03 
-9789 v] Inod (auNnol ap siatyeydsoy sulos sap yUdUUdT}qGO 
SJUSPISAI So] NO Nd] np uoNoUOJ ua sadnoisal sayW0S 
OP I[GUIdSUD) DIULS AP SADIAIOS BP SUOISAI So] Inod gs11I09 
258 ,[ UOTas onb Isule ‘ase | UOTAS dII]eUOU Op xne] Sap UOT} 
-PLU]S | B SJe][NSaI Say UoNbrdde s]j yuawiajsnle | ap saqual 
-Q]JJIP SOINSOW SION B ddRIZ ‘soTapoW sane ,.p Ja1edw0s 
Inod sauuatsakeq sopoyjeul sap jutod ne issne juayou! 19 
H Sinoyewinsa sap 11u9jqo Inod |Z uordes eB] & SQUUOTUDU 
o8e.p odnols a] UOTaS safapou saz_ qwdsI[ON (R661) 
‘[]09 19 WeIpUeN “JOp[ey-UoAR[D ap saguUOp ap a] quUasUd || 
ap udsXoOW ne spOYJOU RI JWOIISNII[! s[l 39 ‘[°Z UONdeS 
R] & QUUONUDUW JOp[ey-uoIAR]_D ap aapow 9] Juenbiydde ua 
WOd.] 2p $108109 aipsO SWIAIXNap op SINdyeUII}Sa sap 19 GA 
SINDIVUISS SOP JUSUUSTIGO (9661) HEY 19 Lye] “ajapour 
Jawad 3] Inod sonuaqo sajjao anb sayqiey snyd juos yeneds 
Q[Qpoul ag] Inod sanuaiqo sadAj-sindaa soy steul ‘sayapoul 
Xnap sat Inod sajqeiquies Woy qos ‘g sap suoNRUINss 
SY] ‘|Z UONdes PT Be QUUONUSW ’g say] Inod a[eneds souep 
-uadap ap a[apoul np suOnIpUod sa] suep qH{ UORUINS=A | 
JUSWZ[VS9 IIPNIa I] (L861) JOp[ey 19 UOoJARID JoNsUOD 
‘syusWaUSIasUuaI op snjd nod ‘(suorse1 saied) stessooa 
S9IWOD OP JULUDAOIA dIAQ] VI IP Jad0Uvd J] INS sanUUOD UdIqG 
soguuOp xne sjei[nsai sot anbydde 1a *'g ap uOLa}sod & 
goueuva eT 10 ‘'g op GH SinojeuMsa sap quonqo I] 
7-0 ap Puutues LHoUd e UoKNNGUIsIp ouN,p Ja 71 ap Sy woud 
e “uonngiasip oun .p onb sure ‘(0 ‘1) AV 'g Sop =‘g 
spend a! Wd = — 'g | ‘« a[apour np yas as Fer) Mey 
soipeeul 
sap onbiydess0j189 uoejUISI1da1 ap SIPIPO|. CT" 


‘qq Anayeunse | 
IP WO, | 2p 9109109 aIplO BWatxnap sp UORUINSA | 
juginoyed = sinajne sat ‘sqD eI] saide.p sayoolp 
SUONLUIT}SS Sa] anb 3a GH Sinayeuinsa say anb syejnsos 
SINI|[IOW op Issne JUsUUOP qA SINa}eUITIsa soy ‘UOT 
-BLIRA IP SJUDIOIJJI0O Sa] saide.q “SdO PI] ep seauuop 


LO0¢e 


Sa] Saide .p ajoarIp UONeUINSa,| anb sjej[Nsa sauna] [low 
op JUOUUOP soaNY so] 19 SUN Sa] 10 ‘GH SinayeUsa 
Sa] onb s}ei[Nsai sina][iow ap JuoUUOp g_ SINd}eUINSS 
Sa] ‘sIe1q Sa] Inod uaXour nposqe Jvyjai siviq nv jUdT} 
Ud,S UO,] IS ‘SqD k] ap seguuop so] squde,p sagpnoeo 
SoJOaIIP SUOTJRUITISA xNne 39 (9661) T[O9 19 YsoyH 
op qH suonewnssa xne ((NIdWd) gy suonewnse 
So] Joredwioo nod sajjag1 sinayeA WIWIOD ‘Q86] 
dp JUDIUSSUDDOyY Op S9gUUOP Sa] Saude ,p sagtNd[ed “6.6 | 
ap suONRUINSS sap judAres as st] °”n Inod amOywETe 
JUDWIOUTWIaYS ap ajepow uN ek asnsnluod (g°Z) UOSIeI] 
ap sapour 9] JUaIo[dws sj ‘sayesdaAsues Jo sonbisojou 
-O1Y49 saguuop sop saide .p souuosiad anenb ap soured 
-LIQUIR Sd] [IWR] SOP URIPSU NUdAAI Z| Ja[No[Vo Inod qy 
SINIICWINSS SOP USSTTNN (6G6]) VIEP 19 WUIYR’T ‘eneq 
"SJUDWIOU Sdp SINdJVUIT]Sd Sap opoyjow ey] anbijdde 
nox onb sipur} ‘syapow np saneuvied sap YAW 3° 
AW Sinoleuinsa ,p JUdAIOS 9S *[[09 19 eNeG *"N xn aI10} 
-Pg]e JUDWIOUTWIOYD ap sepow uN,p uoNeordde | ve ans 
-n{uod (9°Z) [BSIDASULII/[PUIPNIISUO] UOSTeI] ap sJQpoul 
gj Inod PIO, | oP $199.09 s1psoO sWIaIXNap ap saxduUOd 
sinayeuinss sop 19 (qq) AN IdIWA Sinajyeunss sop 
JUBUUINGO (6661) NOX 19 (6661) MRI Jo Ltye’y “ened (¢) 
“aSPWIOYS 
op xne} sop soalguuostes suoneleA sap aydwos 
J1ua} Inod samejusurgtddns soussa} sap (9°Z) & uanole 
stew ‘"n Inod amojege JUeWIeUTUIAYS ap s[epoul uN 
% gnsn{uod (g°Z) UOSTeI] Op afapour a] JUAsT[NN (6661) 
NT 10 ‘HIeyy ‘arye’T ‘eyed ‘soasipan x sapqeiiea sa] ans 
SJUDWUIDUSIISUSI SOP (P66) “[[09 19 BNE SUepP PIDANON 
Ina}o9] IT “GH sinayeunsa say Inod 39 SqgD PR] anod 
Sag[noyeo sodd}-sinaa xnv JUdT} UI,S UO] IS “SqD PR] Op 
SOQUUOP SI] INS Sdgpuo] saTJao aonb sainoj[low JUsUIN}}9U 
SUOTJRUINSS Sap juasInpoid gH sinojeuNsa say] ‘sures 
-ILIQUIe S}e}q SO] SULP BSeUIOYD ap sTonsudU xnv} Soy 
JawWINs9 Inod sopoyieur say juenbrdde syy ‘uonesyi9A 
-d1U0D PI] INS sagpuojy sapoyjowW ap ‘ajapow 9] 
Jopl[ea Inod ‘jusWa[eS9 JUDAIAS 9S SI] “GH Sinayeuinysa 
sap jutod ne amouwi nod (9°Z) wns ‘n no (QI'Z) anbr8o0] 
-OUOIYD B[9POU NP JUSAIOS 9S (P66) [JOO 19 BNR (Z) 


"sue Q[ Op apotisd oun ins sye1q 

IS so] anod of ‘T=2'tg ‘7 ‘T=2'"Q seyoonp 

SUOIeUINSS So] seide,p souUuosiod anenb ap soyfrurey 

Sop UIPSU NUSADI Np uoNeUINsd,, eB jUonbijdde 

So] 12 (9°Z) 19 (GZ) Jed guuop sanbisojouol1ys 

SOLIQS SOP UOSILIT IP B[Q9POW Np suOTIPUOD sa] sup 
dH Sinoyeuinsa sap quaddoyaasp (9661) [JOO 18 ysoYUyH (1) 
sanbisojouoayd Sajapoy «ZT 'p 


“soleatun uojonpel Jed sinoyeuinsa 
xne yoddes sed aqyoiadns Inay ayuoWwap jd sa[eUuoIsel 
suoniodoid sap 3a souudAow sap (sajytsodui09) sateAnyNu 
uoljonpel Jed sinayewinsa sap 1U9NqQO (666) ploJsuoT 

“NUIADI B[QIeJ B SOIL] Sd] JULSTA dISJOUS,p B1ENeU 
ud aple,p oumweisoid un sJansturupe inod ''g ap suon 
-BUII]SS SOP WIS JS UC “S9LIVAN[NU SaTIpOU Sap Ans sapuoy 


666} aiqwevap ‘ejenbua,p senbiuyoo | 


sanbidwos snjd sinayewinsa sap Jastyyn,p apynur ysa qt 12a 
sye][Nsg1 SuOg ep OUUOP , GH sHeATUN INayeUUNsa | ‘UOTS 
-1dde an09 sueq ‘Sqd ev] Saide.p sajsalip suoneunssa so] 
anb sina]jiaut stews ‘syuayeAtnbe sjeinsal sap jusuuop gy 
SINIJVUINSS STOI) SI] ‘s]VI_ Sop s[quidsua,| inod suuskouw 
DANL[AI anjosqe IMae,; suJeDU0d INb a0 ug ‘saT[ael 
SINBIVA SI] DUO ‘OR6] AIP JUSUIASUd.ay Np saguUOp 
So] Sqide .p saginoyeo ‘6/6] ap SUONeUINSd So] JURIapIsUOD 
9 ‘GH 1° , GH ‘eepouwi un ins saseq saueatq yo spiieatun 
dH sinayewinsa xne 1a (SgqO) AdAINS uoNe[ndog JuaND 
Rl Op SJOIIIP SINIJBUIT]SA xne 6/6] US souUOsod anenb op 
So]|fuey so] Inod snusiqo *. qH “syueyNser GH sinayeurnysa 
sop juoredwiod sj ‘uljUuq ‘sqqig op oseuuoTNueYoe ,| 
aonb tsure ‘ajapow np saneuvied sap sasnjyip woud ev suon 
-NQLSIP Soy Issne uast[NN st] “sadnoss ston say Inod juow 
-9SUIN9I IP S9QUUOP SI] INs 9puoj DoUdIEJaI Op oQuuP | Inod 
URIPSW NUDAADI JJ 19 JUDWIISUdIAI Op SaQUUOP Sa] INS spuoj 
QSILIOD ULIPAUL NUDADI J] SOANVIITAXa sa[qelvA SUIWIOD 
JUSTIN S[[ 7 1eyW,| Suep souuosied Hurd ya stony ‘asyenb 
op Sus Sop Sjool sueIpow SNUSASI Se] juajueseidal 
9 1 “9 ‘Ng no (9 “9 ‘'9)="'9 Io] ‘suleoui9ure 
sey SIOAIP Soy suep Pies ns Op say[iuey sap 
URIPSW NUSAI NP GH sinojeumnse sop jurod ne anjour snod 
(JOLMS}-ACJ) UOIZAI LP] OP NKIATU Ne SILIVAN[NUW solTapoul 
IP IUDAIAS 9s (966) ULfeIeIeN 19 VISURN ‘YSoYy ‘eneqd 


SIMIBAH[NW SsPpofy Tp 


‘Z UONNDAS RP] B SQUUONUSW SoIpeyeu sap onbiyd 
-PIBOULI UONRUasgidal ap safepour seq onb tsure ‘sanbis 
-O[OUOIYS 39 SOLIVAT[NU Sa[Qpoul Sa] JUONJOUI UOISaI P| 
ap NIAIU NB aseq dP I[QPOW Np $a}UId9I SUOTSUd}X9 SIT 


UOIS91 B] IP NVIAIU Ne Sajapoy "fp 


Tp uOrOas BT e UONe[Ndod ap sytun || 
ap NVIAIU Ne aseq ap B[Qpoul Np jd ["p UOTDaS RI B UOIZII 
R] Op NKIAIU Ne aseq ap Jepoul Np sayuaogI suoTeoridde 
9 suorlsua}xa sanbjanb jueuajureur suojuasgid snon 


SNOISNHLXYH  “P 


(S661 OSSNY J9 Is1O[e 
‘IsJo[e) dayoe uoTeindod x] ins suuartey aJgnbus ,| 
OP sped d] sup [eIoUrAOId NedAIU Ne UOT}RWINSA | & 
(11139 (9661 SUIJUH) IOLNSIC [BUOIssaISUOD Np neoatu 
ne asseUsWI NP NUDADI 9p Sal10s9}e9 sap jo 1o[dwia.p 
SO1IOSIVO SOP QUIT}]SO JUDWIdIqUIOUap Ne (II ‘(C66 
Jopuexey 19 pueyd) JUsUIAaSUddAI Ip INd}9es Np NesAIU 
ne Iseugyd op xnv} sap uoTeWINsa | e (1 anbijdde a9 
JUDUI[LS9 & UOISAI LI OP NVIAIU NR aseq op sJapoul aT] (¢) 


‘066I OP JUSWIsUdN—_I Op SarJJIYO xne 
suosivieduiod sap 39 UOISSaId91 Jed soNsouseIp $1So} 
sop stiduios A ‘saiaqlio sinaisnyd ins yuapuoj as suon 
-PUII]SA Sap 1d SA[QPOU! Sap UOTJENILAY,‘T “Sa[Qpoul sop 
UONLNIAY, | INS 19 S9IWOD Sap NVIAIU Ne I[QpOuw o| suRp 


SO9ST[IIN X SI[QVULA So] INS JUDWIDUBIOSUdI SAP (8661) 
[lounoD Yoivasay [eUOHeN suRp PIANO INI}99] 
JX] 3814,] Op nesatu ne sjapow un saide,p sanusaiqo 
1e1q,| SP NVSATU Ne SUONRUISA sa] ddAv JUAPIODUOD 
sg[ja,nb uye quanonb np sanrien spoyiouy ey Jed 
a SUOTLUINSA Sat a}snfel e He CANS Adz Q) NOd 
uoneunxodde | op uakouw ne ue ap WO. [ usa & UG 
‘ined g8nf ve uo; onb —"*8 outiay 9] (L"¢) suep Jaquio} 
juessiey ua ‘{(' Q)ASIN% + ‘g}dxo = i ‘Q]PULIOUSO] 
uOTNGNSIp ve] ap suuekouwl ke] Ins sgpuoJ ‘souTTJeI 
snjd apoyjsw ouN.p IAIas d}I[ea1 Ud ySa,s UO STeW 
‘('g) dxa = ‘x uojas (g1W09) uoIs94 aed sed (g1a1Aned 
Bl SUBP JURAIA aIIv[OOS 98R,p sjuRJUd,p siquiou) 
‘XK Xnv10} sgj Joumnsa ssoye nad uQ *'g ap ‘'9 ‘AN IdWa 
SOD: a elo) Inod ‘sh ap area INTRA PI 
SUILUOD ace 0 = "sh ‘aquey[nso1 UoNeUINSa dl aoe 
v2 UuO “$0 op ‘uoneunse gun I1ua}qo Inod ‘ Os 20 ='h 
anb juesod ua ‘yueInod re 3] suep s9siqnin e 
uo, anb 7h = h jusesoddns us “0 op uoTyeUIsd ouN 
‘JUILLIDSUIIAI OP S99UUOP $2] saude | _P ‘nuajgo & uo ‘asau} 
oat SIMUIIP 99199 Op NLDA UY KG 2 ‘O)N eo B-]S9,9 

‘'a aonb ayiqeqoid ap 10] awigui ey JUSAINS “4 ‘UOUT 
-9SUdIAI SP SUOIS9I Sayed sap sjajJa soy onb ssoddns ve 
uo 39 sh ‘aSeUUOTTHULYDY,p seouLLIRA Sop “sh SoTquIJ 
suOnPeulsa.p asodsip uo ajjenbe] 1nod ‘966 UWS 
-Udda1 op aguur | Inod (¢°Z) SWI] RP] Op sJapow uN,p 
IAJOS 19,8 UO ‘sh aIWeUUOD sed aU ap IIR] a] sod aonb 
D[NIJJIP PT JDUINOJUOD INO “Sa}UOd Sa] aud xNeISpa} 
SPUO] Op SIe][OP ap splel[iu / op snyjd yuow]januue 
Iniedgi inod suoneuitysd sao Ins spuoj 9s UONRONpY Jo 
quoumedsd SQ IT (866 [lounoDd Yoreasay [euoNeN 
‘L661 [aselS 10 JOUSIY) slup-sieq xne gaAned 
eB] SURP JURAIA aMejoos a8e,p sjURJUS,p ozquioU np 
‘9]U109 NP NBdAIU Ne ‘dJapour uN INs sagseq sUOTBUITISS 
sap oinpoid snod ‘x 30] = ‘g daa yUsUTUIADEI asITIN 
d19 & (€°Z) UOISII BT Op NVIAIU Ne aseq op I[Qpoul aT 


“sogIpnid a9 
dou sed yuo ,u sajgtidoid sas sreur ‘ me) Inod ajsissod 
'Q ap (‘A'9) UONeIeA Op 1UdI91J}209 a] anb oinsse 
SISIAOIGUM BINSIU SUTe}IO BUN SULp spoye aNaD 
dead 19) ((, 49) 9s] uoIssaldx9 | {12S 9S [I 
a) ap WOd, 19p uoneunsa [sginoyeo nog “JW sap sapeury 
SuoneUnse .P 1UdAIOS x) ‘sogisnfel Isule qq suoneul 
-Nsa Sa] “Xneulsieul xnvI0} Sop So}aIIP suONeUIT}sS 
Sd] DBAR JUSPIONUOD saT[a,nb Jainsse,s Inod yuayonb 
Np sANelo spoyyoul vy Jed suoneunss soy aysnfes 
smd iar = 7 fe "ZW ‘s9gSusda1 UOU sauUOsiad sap UoneU 
A ud Ht") Gq UONddI0S ap sinajovj Sa] IWIOAUOD 
tiemaee® ap. YAA voReUTse uN Ins yuEpudy es Ue 
(L’€) UOTas WO Ane] awnse 19 'g ep (qa) AN IdWA 
SUONeUINSS Sap Was a |] ‘aAUepusosap ofdnynw 
UOISSdISAI Jed sayqeueA Tp ap a[quiasua un sade .p 
‘x ‘SOATIROI|AX9 soTqeuvA So] Ustoyo [] °'g ep seuuop 
gourssind oun ge jauuoniodoid ys9 ‘sh onb yuesoddns 
Ud ‘SdSWISd saouRLIVA Sap asessI{ Jed sag[no[eo jUOS 
‘hh OSeUUOT[NULYDE,p S2dURLIA sa] 19 SITeIISUIO}Sod 


gjepow uN ANS sepuo} ajeuO!Has UO!}EWIISS,| JUBUIBOUOD SjUsde1 SeiHold SenbjanyH :oey 


(2) 


90¢ 


ajenbua aun sed saruinoy juos ‘g salsolp suonvunse 
soq °'g-[=‘qQ sed auuop isa uorlsa1 owial-7 ey 
SUPP JUSWIdIQUIOUaP-SNOS Op JOU XNR} FT “UOIS9I SWOT 
-1 R] SUBP JUDWUSUdDEI Op dJJIYD 9] 189 “9 18 (NUUODUT) 
[ool JUoWdIQqUIOUsp x] IS9 ‘fF NO ‘sUOSTeUTqUIOD 
(aoutaoid)z] x (a88)p x (axas)z B JUapUodsaO9 Inb 
‘ly (1 ='Q UWONDELION ap SINd}OeJ OG JOUINSA ,p Isa Inq 
J] ‘LpeUed NP [66] AP lUaUIAaSUd.OyY NP SIO] JOU JUS 
-d1QuIOUap-sNnos ap xnv} so] JoWNsa Inod (¢°Z) UOIsaI 
PR] OP NKAAIU NV aseq ap aJapouwl np Vas as (C661) YO (1) 


$9}U999.1 suonvotdde sanbjang) p’°¢ 


“‘sapoyleul soo yuasod anb 
SPINOIJJIp sane ,p wos yedap ap sinajea sap ja ‘f ‘Sa[NUWIIS 
suO][QURYOS Pp sIquiIOU Np ‘UONesITapyy ep oepoued vy] 
Inod J ap X1oYyd FT °(9G6] UlfABD 19 SA[MOD) JoTI0Eep sasudd 
JUOS S]I,Nb IdUdBIOAUOD Ap ddY99 ,P SOWIOJ Sa] 19}9919p op 
sinofno} sed yuanautied au dDUdSIOAUOD PI Op OISOUSRIP ap 
$}S9} Soy onb yey ne JUN PYIOOIW =sepoujeur soy juasod anb 
DI[NYJIP Ne SUP) “$9}991I09 1UOS SQqqIy ap saT[auuoNIpUod 
SUONNQIISIP Soy $djno} aonb stew! 9}9d1IONUI 3S9 DIQIUIOP 
91109 IS ‘oJURISIXOUI LIOLIa}sod e UOTINGINSIP oun,p jolns 
ne aqeuuosiel souaredde ua saouasgjul sap stojied yinpoid 
SQQqIy ap INsuUOT[HURYSE,| enb aNUOUT 1UO (966) BI[ASPO 
19 WaqoH ‘e[dwiexe eg ‘aouspnid sane FCOOW sepoyjeu 
sg] Jonbijdde ,p spuewm0dal $d [I STRU ‘9DUdBIDAUOD P| Op 
OIJSOUSIP SP $}S$91 SI] 19 PIODW Sepouieur soy sonbrydde ,p 
juayjoutied Inb YGOO 1° SON SISlolso] say Joinoo01d 
dS OP ASIv 1S9 [J] WOO! Sepoyleul sop UsWIeXe JUaT[I0Xe UN 
(8661) SYOO1g suep PIDANOI INd}99] VT “WoLIa}sod ve quutof 
-U0d UOTINGLYSIp ey op ined & suoT[MURYDE Sap JoUUONdITES 
Inod sqqidn op swy Ose, suep ‘ssunsepy-stodonopy 
OP INJIO SUILUOD ‘SOLOS sane ,.p JosINN s1oye ine [119 
S9[[PUUOTIPUOD SUONNGMISIP sourey9o Inod sgULIa} SULIOJ Ud 
UOISSaIdX9 SUNINe 9}S1X9,U [I ‘SaxaTdwiod snjd saTapoul so] 
Inod ‘anuoos seg ‘(aawey) anbndAyeue suo] snos sagumtidxa 
wuos “(ET'€) & (LIE) ‘Sef[euuonIpuos suonnqistp so] 
$9]NO} IVD ‘JUSLUA}SOIIP SUOT[NURYIE Sa] a1Inpoid suoAnod 
SNOU ‘UOISAI BT OP NVIAIU Ne aSeq Op BJepow 9] INOog 
“SqqIy ap aseuUO][NUeYdoE | Jonbrydde ,p jueae 
sanbryAyeue s[no[vo sa] alle Op s[[Iasuod jsa JI “Wuanbgsuod 
Jed ‘SIJU9A Isa [[AMYOR[G-oeY sp nuuood usiq suwiei09y) 
i anb 39 a[JauUONIpUuod souvsadsa aun Isa (“0) i) anb aoied 
‘Un A) Ge f Anayeurnss,| eyoejue tnb a]J20 anb syqrey snjd 
Iso (.)'Q INa}eWINSE,| eyoejue nb uONE[NUIS op Neda] 


(ST'€) LO'e- ()'e| ae + 
1 1 i 1 
(a) Pato)! '3] ge = (01 0)A 
i) 
1 1 : f ] é ie 
CTE Nr OO= ('o =| pais oes 


SUOISSa1dxa sap UdAOU Ne LOLIA}sod 
B DOULA P| 39 WOLIa}sod ev auUadAOU BT SUOWINSO SNON 


SO¢ 


‘a10]dxout ang wesinod ajurofuod Wolaysod & uoNNqsIp 
vy ted giguas sovdsa,| ap ajuewodu wed oun ‘uonnsexe 
aNSuUoC] sjnas oun,p seo a] suep ‘ayoURADI UY “«UONRSTTIGLVly» 
ap gjentul spowed ey aunoeys op sure uo,nb aoied 
‘sgovoyje ned ang,p juanbsi ajayyered ua suomnsaxd so] 
‘slojainoy, “sauUONUSUUSNS a][99 aonb a][9} UOINdExe ansUo] 
ajnas oun ins anb 303n]d ajayjered ua suonndsexo sinarsnyd 
Ins JU9PUOJ 9S SapoyJoW sonNe.q “Ww ‘T=1 ‘'9 19 
“o ‘g ap ajurofuos tolaysod e ee u, op apap nord 
suoj|nueys9 ¢ ow0s (f*""* “T = Loi (f+ ye? ‘(nn9) 
Joqien sind ‘aouasIaAu0d op apes ne cobsnf ‘uonestiqey 
ap epotied op wou a] oUUOp UO ranbne ‘J SUOSIP ‘Sa[dAO 
ap sIquioU puUvIS UN Ja]NIaXxq mere oes uN JUSWIO} 
(9 @ (@ sadvig say (yf 19 wo ‘ST =9' fe 0 questyn 
ua (EE) ap ae JoNy (9 ° 70 a) ad juest{yn ua (cr ¢) 
ap ue ad me JOIL, (q' ca "€) @P (J 1010 10 ee re) 

9 yiedap op s1ngeA $3] veda © aH SUILUOS BDU0UI ,S 
sqqig ap oUNy IOS |e hse Ole Oicnons oust] 
SUIVI-? PI JUSWIOJ |x so, op d x wWadLNeUI LI 19 X NO 


1 I Ge Cc CAG A 
Ce 14 20) OR oe ey tO Oe 


T=26('A “g?x('A - 1) +'Q'A 


See Dear PN (11) 
= (59'9) ON mm 0 “29'd1'0 


(ZI'€) 


Cre & (X,X)$0 °9,X,(X,X)]°N ~ eo'eld @ 


SOJURAINS SQQIH ap SoTJOUUOTIPUOD sUOTINGLSIP 
Sop JIAIOS SNOU SUOASP SNoU 1) <q‘Q < D‘(q ‘v) ewes 
uOIINGLNSIP sun ysa Cr o="1)f word ev uonnqmsip 
ev, onb juesoddns ua sqqin op oseuuo][nueyos | sonbiydde 
Inog ‘dU[eUIOU BP SUONIPUOD sa_ sueP UOIS9I ek] Op 
NVIAIU NV Seq IP I[QPOU! IJ NVIANOU ap SUOIJAPISUOD sNoU 
‘SqqIg op osevUUO][HULYDY | 9p UONLST[NN | JONsNII! Nog 
"910909UT LOLIa}sod & UOTNISIp oun ,p uoneutxoidde 
UIWUOD 9}001109 WOUd & UOTNIYSIp oun JasI[yN eB JUSU 
-g[ duis 1no} eIpUatAal vjao Jeo “o Inod a19a1109 asnyyIp 
110LId & UOINGLYSIP SUN JURSSISIOYS Ud dI[NOIJJIP P] JOUINO} 
-u0d suOANOd dU snoU ‘jURdYdE S¥d JT “(O66 PI[ASPD 12 
19qQO0H) eer IOLI9}sod & UOTINGMISIP ouN & IOUS 1A 
-Inod (‘ 70) f{ osu0du! WoUd & UONNqLSIp oun ‘aUOod Jeg 
“gyNOLJIp sunone osod ou GH spoyyeW PT ‘AANLULIOJUI 39 
9109.09 1S9 (9) f onbnayjodAy woud e uonnqiusip ek] 1s 
‘o]uUvIIOdWI UONeUINSa-snos dun Jasned nod Ue 
PR] op ainsau auru09 (“ 22) oa 7°) 3 yostjan.p 39 70 jueu 
-190U09 BpNjAVOUI | ap ardwios 4 J1ua} sed au ap wey a] onb 
anuoUl (Q[*¢) sreur (“ 70) Q= an® anb (6'¢) ap aynosep I] 
"[No[eo op saqNoIyIp $3] rajuouuns anod WOOW a1u93 
Np sapoyjsw op uONesI[yN,| 39 S[[QUUOISUSWIpH[Nu uoN 
-RISOIUL | & SINOIII BJ JUDANOS JUSBIX9 soxa|dwiod sajepoul 
so] ‘juowanbiun s][auuoIsusWIpruN UONeIsaUI Jed jUaU 
-onbiiguinu JonyeAd soy suoAnod snou ‘tor guTuexe a{duits 
Svo 9] Suep siew “(Q[°¢) TU (6'¢) Inod saWIIOJ SULIOJ UD 
UOISsoIdX9 SUNONe 9)SIX9,U [] “(Q | 70) f Qu120U09 a 90 ud 


DOURLIVA BI 19 sOURIadsa | quaiudsaader eilonment 8.1 2° gq no 


666]. eiquiadep ‘ajanbue,p sanbiuyoo | 


(O1'€) ((0)'91"'%A + [($0) "8 + (49)""8]8"a = (| '0)A 


(6'€) [(0)'9]"a = Col'oda = 4/0 


ULIOJ BP] SNOS LIOLIA\SOd v dOURIIVA PT 39 QUUDAOW 
eI eu ses snou tsury ““0 10 g op uold v sourpusdeput | 
32 “o op woud e& uonnqmusip ey juesod ua ‘(9 | sos 
Wouaisod ev uUONNqMsIP evs psoge.p suojnovo Snou 
“0 JURUIONUOD OpNyIsOUI,.| op ajduioo Mua} Inod ‘adeia 
oulaixnap ey *(50) sai C 0)''3 ev afe8a iso woLajsod e 
J[[QUUONIPUOD doURLRA P| 3 ( 79): Q@ AN TdW Inoyeunsa | 
v onbyuapt ysa ‘“o guuop juRi9 ‘WOLa}sod & a]]aUUONIpUOS 
suushow eT *g Ins Wold ev saguUOp ap souUAaSQe | 19}]9[JOI 
Inod g ap “ysuos » (g)f cia woud ev TOnNISIp 
oun juesoddus ua ‘oxy “o oun snod us 0‘Q|'Q)A 
jo, (10 8 lk Q)q suousjqgo snou ‘adja ouattuard ea 
ation “* <1) = g no ‘sadeig xnap ua (g |'9)A Houaisod v 
JOURLIRA BI 19 (Q ‘|'Q)q Woussod v ouuskour RP] SuoUd}qo 
snou ‘ajeuoUu UONNGLsIp ap 'a 19 ‘a oaAe “(Z‘Z) 19 ([‘Z) 
‘UOIS9I BP] OP NRIAIU Ne ISeq dP d[aPOU! Np sed a] sueq 

“OLIaysod 
douelieA vs Jed uorstogid es SUOUTULIO}Ep SNoU Jo LIOLIa}sod 
ev ouuofow vs ied ’g no ‘x suowmsa snou ‘uougstogid 
snd ‘10110}sod & UOTNGMSsIp PI INS S99PUOJ JUOS SIOUdIOJUI 
sxq“'Q = (‘4)8 no ‘x xneuorlsai xne}01 sap WOLIa\sod v uo 
-nqNsIp e] suouajgo snou sind ‘(sanaureiediadAy sgyodde 
JUSWITe39) B[apoul Np saneurvied sap woud ve UONNGMSsIp P| 
suosiogid snoN ‘sqqig ap InsuUOT[NUeYDE ,| SWIWUOD ‘JUS 
-WU9091 JUIOd Ne sas (YOO) AOL op oureyo ooae 
O[IeD dUOJPY Op sapoyyow soy Jed saxatduros sawejqoid 
sop Joye op youtlod afja,nb ya «sajoexd» JUOS sadUdI 
-9Jul Say onb ‘ayduuts jsa aja nb sored ‘ayeuoiseal UONPUINSA | 
B® g[ayo9 opuvis e sanbijdde 19 & GH spoyloW eT 


X 


(qH) sokeg ap snbiypaess1y apoyjayy «s¢"€ 


“Q[PULIOU IO] BT JUDAINS 
SOTQVLUILA SI] IS S}eI[NS91 SOUIQUI So] JUaSINpOId sagBIIIOS 
AN Id 19 Ga Sepoyjeul say] “Uonbesuoo seg *(g'¢) UOISEI 
RI UOTSS WOA.| Op myeo Be onbnusp!l inoyewiyss un yuoU 
-U9I1O S]I ‘STeIq 99 JUBASIIOD UY “(Y"E) OP NO (L"¢) ap steiq 
Ne JUSWLIUOS ‘| UW SIPIO ,P SOULII} Sop puetduo9 steIq 
3] onb dIIP-e-]Sd,d 4J91I0D JIPIO DUIQIXNEP op IeI[NSOI op 
sed ouuop ou aja, nb yuanuow (/66 |) Liye] 10 Jejng seul 
*“0 9p io g op aIquuea | op adwod sus) nod onbujgwiesed 
des}oog epoyjeut oun juasodoid (1961) stnoy 30 prey 
‘WOd.| Jed sainsoul a][a01 euiaeles ev] op ajueyodut uon 
-RUUT]S9 -snos oun B oUeUI INb ‘pM’ heals 7). ‘'3 ed aguuop 189 
3][2 ‘SI[BULIOU 9p SUONIPUOD So] sue © a0 OP DI[IGvURA P| 
ap DINSoU ap Was WOLIaisod v uoneunse, | OP OULLIA BT 
‘g]Qpoul Np sanowivsed sa] JURUIADUOS 
woud ev sauUOp suNone Ans oindde,s ou aT]2 ‘GH epoujow 
PR] & JUsWIIeNUOD ‘saauUOp so] saide.p Japl[eA ynod 


x 


uo | onb uosiely ap yo aBeUUOT[NULYIE,p SATQpoUL say Ins onb 


aindde ,s au ayfa seo ‘saouanbadj Soy Ins daxe JUSUUATJaIUISsa 
S89 Gy spoyjow ev] onb suousijnos ‘ajulofuos uoNNqLsIp 
S00) B a[eiguas uodse} op onbijdde.s qq SRauio PR] STR 
a0 AN Id Wa ae | @ anbyuapt isa re a) ‘ouyeu0U 
ap SUONIPUOD say sue * 0 qq Inayewnsa | 1sd WOLa\sod ev 
ae vonnarysIp ev] op ouUdKoU! eT ‘JUdWISIO9Id sNId 
Dols 9) f ‘’@ ep (uola}sod & no) s[[auUONIpUOD 
ee UONNGLSIP eI INS seoUdIEJUL sa] SUOpUOJ snou 
sind 'g sap afeursiew uoNnqsip ey sqide,p ofapow! np 
songuivied say suowinsa snoN *( oe q‘ ‘0 | ‘@) f xed suas 
del “0 32 g 2[apour np saneuesed soz Jo ‘ i) guuop jure 
‘9 op a{jauuonipuos UOTINGLNSIp BP] pIOge,.p sUOUaIgoO snou 
‘(Z'Z) 19 ({°Z) aed guuop ‘uoIsel e] Op NedAtU Ne oseq op 
J[Qpouw 9] o1In.sysuod Inod gy epoyssu BI SUOAINS SNoU IS 


(qa) sokeg op enbiudura apoyjay._Z€ 


‘sqquBLoge JUSWIS}I0J ‘'g ap sINa[eA sap SUIUIOD 
‘SOUQIIXO SLO Sa] SUBP JUSWONbTUN 9gsIeIq UOU INd}JeWNSa | 
B JUDWIANLILCUIOD SdIDOIPSU s}eI[NSI sop JouUOp jel 
-Inod a,apouwl uN Ins gseq INayewINs9 TJ “(1 °Z) anbneujodAy 
UOSIVI] OP I[QPOU! NP IAVIS JUSWIOUUDAOUW UONPIOIA Op seo 
Ud DWIQUI ‘d][2UUONIPUODS PICA, | D9Av USI Zasse JUSpIONUOD 
Inb sjeynsoi sop yinpoid [I,nb 3a gsteiq uoU INayeWINSa | 
anb afqeis snjd dnooneagq jsa ‘(1"¢) ‘a[agpowl uN Ins spuoj 
WOd.| op Aneyeurtjsa | onb yuswranburdwis syuour jo sapqui 
-eduioo syel[nsai sap nud}qo jUO (/96]) OVY 19 SUBMY *’Q 
SO] QUUOP 1Uk}9 ‘JUDLUDT[OUUONIPUOD aIIp-k-]s9 9 ‘aseUUOTIN 
-URY99 Pp dJQapow! np jofns ne,nb asayjodAy oun jUENOUID ,U 
ua ‘UOIS9I B] SP NVIATU Ne aseq ap e[epoul 9] nod (“4 0)! ) 

='0 AN Id Inareurnsa | ap affauuontpuos FO, | ep astviq 
UOU INd}eUISA UN JUDUUANGO (66 |) BJUOW[Ag 12 ISOATY 

‘(40) "8 outa) sarwaid a] anb efqrey snjd aspso ,p 1s9 

[E Sreul é 0)’ '€3 anb a]qQuIs SUIOUL 1S9 (°¢) Op SULIA] JOTWIEp 

ea (9661 OvY) “0 sajuRIsUODS sap JUSUUAsNfe Pp INS}BUINS | 


nod (‘th + $0)’ ae wz = (70) A = (40) 'y 19 (20) g = g no 


(ge) a) Meld x - 'Q) [,CA + 20) /2h] + 


(£9) *8 + (49) 78 + (49) "8 = ('9)'uibe 
Jasin yned uo ‘ajdwiexa 
eg “(¢ me) "£3 inod (¢°¢) SULIOJ BT JURSI[MN US XIOYo sanNe.p 
JOANON ap of!oRJ 182 [I ‘s}ojamnoL ‘(p'€) op sieiq of sed 
suuatasaiut 'x onbionb ‘'g ap sed puadgp au [1,nb suas 99 
Ud UOISAI eT B Jalfnoned sed ysa,u Inayeumnsa a0 anb yey ne 
1U9N WOA.1 oP (Z'¢) InayewNsa | op sanbyuo sap oun J 
“g sIOOIP sINdIeUINSE So] 
INS O[e.NUIO SITU] BT 9p SWUIAIOSYI Np 19IJ9,] ap nua) aidwios 
DULUSIL.NUOD SUIOU JSd BSayOdAY 23399 sIvUL ‘dTeUULIOU IO] 
B] JUSAINS ‘a BSeUUOT[NULYDE,p SIndLa sot anb sesoddns ap 
anuNnuod uo, onb JausI[NOS op JUSIAUOD [J “ApITeA sINdWap 
steiq op saAneutxoidde aouasqe | aonb suas 99 ud ‘ayeuUJOU 
lo] Be] sed quaains ou ‘4 xNRUOISEI sjayjo say Is aIsnqol 
1S9 (L°¢) aonb asNUOU! JUO (CGG[) ORY 19 LUIYR’T ‘sojuR}sUOd 
sop jusuajsnle p inayewnsa,, op usfow ny (0661 


g|epow uN ins sapuoj ejeuoiHas UOIeWUI}SS,| JUELIBOUOD S}Usd91 SeiBod senbjenH :oey 0Z 


ORY 19 peseld $166] UryR’T 19 ened) 70 ap AW Inayeunysa | 
inod sed jsa,] au stew “YAW Np a][a9 Inod anb sajurjsuod 
sop juowajsnfer sed uoneunsea,p spoyjgu ey sinod 
udIq Issne aplyeA Sa (Z°¢) UONeUTXOIdde /J ‘puvs Iso Ww Is 


, Wf & INILIDJUI SIPIO Pp 389 (L°¢) OP Stel 2] “Ip JuoWaNNe 


(L'€) ‘(29)"8z + (49)'8 + (29)''3 = (19) urbe 
Jed guuop jso ‘(7'¢) aonb uonewrxoidde .p 
dIpso augur aj Anod yeu09 ‘(’9) WO .P IneyeuINse UA) 
‘gsoddns 
Q[Qpoul Np ssnaynur uoneplyea oun ke Jopgooid Issne 
WeIASP UO WudWAT[aAINIeN “sh & JUSWOAeIedUIOD s[apour 
9p souRLIBA aI[qQIey ouUN yUasInpold Inb {'x } sourerpixne sjuoUT 
-dUSIaSUaI SUOG ap UONUA}GO | op o1Ied opueis us puodep 
uoIsa1 aned Jed uoNeWINsSa,| ap sadons 9] ‘JUanbesuos 
eg *'th odeuUOT[NULYDE,p doURLIRA FYB THOUISANE IAI ained 
se) “0 3]Qpowl np soueueA RI anb no iad ysa ‘A Is ‘(¢'Z) 
aJepour NP SUOHIPUoD sa] Sup ('Q@) NO” enb ained snjd 
JUDUIZ|QuISpIsuod ang yned (’ Q) WOW oenb anuour sua) 
Jotwuaid af anb oe Vv “pues so w Is ‘(_uwO Boe P 
ie Sno} }UOS 0 op uoNeWINss,| op asneo ve ‘(40)'*3 
‘g ap uoreuinys9 ap asneo e ‘(‘0)"*8 aonb sipury 
mie sIpso.p 3so ‘A = ((0)"8 sua} Jonueid a7 (0661 
ovy 19 peseig) 79 op onbnodurAse sour Pe] S39 (°9) A 


(9°¢) (10) A Ea 79)7 A] w 

(SO) C9)a (de - ‘oa [,('A + 20)/2A] = ((0)'8 

(pe) OX [Cas Fo) six'x Ke iX Ch - 1) = (9)"8 

(©) Nhe Ca)? 
no 

(7) (So) "8 + (C0)'8 + ((0)""S = ('Q) NOT 


Jed 
ouitidxes ‘pues ysa wis “(9 - 'Q) 7 = (Q) NOT.P 212PY 
uonewlxoidde aunQ ‘GN IdWaA Sinaiewnse sop WO. 
ap soyeply suoneutxoidde ,p uonusaqo | & SoguU SaIQTUIOpP 
S30 saplOdNR 919 B UOTUDNL,p dnooneag ‘juanbgsuod Jeg 
“sdorpnonsed seo suieyiso suep Jnes ‘WO 390 ap saulloy 
QULIOJ SNOS UOISSaIdxa OUNINL d}STX9,U [I STRUT “SITIGVUeA vs 
op aInsow oun sUUOp {NIWA Ineewnss | 7p WOT 

(p'Z) aast[egs snqd ajepou 

3[ Jondope Inod (ZZ) asvUUOT[HULYSE ,.P [QPOUL 2] SIJIPOW 

uO] IS QNIdWq uvonewNss,p spoyjyow ey sonbijdde 
jnod au UO ‘[°Z UOTJOAS BT B SUOUBI[NOS 3d] SNOU SUTWIOD 

“OUyPeWIOU 

-UOU 3p SUONIPUOD sop suep oapr[eA JUoWoNbNodwAse 

juowaese yso ‘g ‘40 op YAW JNeyeuNsa un ooav 

‘uonbasuod Jeg ‘ai[eUIOU ap SUONIPUOD sap o11k99,S UO | 

IS SJUISIOAUOD JUDIINOWIIP $I) XILU SOITRIUT] SBTQPOU Sap sed 


€O0¢ 


3] SUBP OURLIVA P| Op Sy ete Sop WAIN Sinayeunysa 
sa] anb amuour (Q66[) SuviC * 70 Jowinse inod gytyews0U 
ap SUONIPUOS soy sup (YAW) JUIOI]SOI IOUL|QUIDSTLIA 
Op WINWIIXPW NP dpoOyIoU PI OS (B[PULIOU IO] B[ DIAINS ap 
sed a81xa,u Inb) sayurjysuos 2p justassnle | ap epoyjeuw P| 
MOS Jastqan suowinod snoy *(’ Q)Y = ( Q) ,_ 8 sed guuop iso 
‘X [e101 np inayeumnsa,J *(“ 70)" Gre ‘0 AN Id Wa No saisap 
Xnoap & InayeuNsa uN muaigo ‘mod ‘ 70 gudoidde inayeunsa 
un sed suoseyduios Bl snou ‘gnuuoour 3sa “o anbsing 
“QTRULIOU IO] Aa! quaatns ‘aja ‘a onb sed o81xe,u Ge T'¢) yeqynser 
71 (i *0)g; x onbneyuds uolssalz9a1 op INd}eUIT}sd.| Op 
195 Q asip Ind}ewWINsa | op sa1gpuod UosteUIquIoD aun 3s 
AN’ Id Inareunsa,| anb (1"¢) ap aqnooap |] *_("sh + 20) 
spiod say soae g op (qOIW) Selgpuod sazed soipulow 
sop InayeuINsa,| S89 (10) g 1 (‘h+ =) / 70 ='A no 
(1'€) (19) g;x((h- 1) + ‘Qh = (19) '9 

ULIOJ 
RI snos ‘(¢°Z) guUOp jURIe *’9 OP GINdW JnoewNsa,| 
Jouidxa suoanod snou ‘sa}xMlu sollegul] Sa[apoul sa] 
Inod snuaj}go xneigugs sye}[Nsai soy ins yueAndde snou uq 


(AN Td INA) P9stelq uou asreguyy 
uonsIpaid sinajjiew ey] ap enbiadura spoyjayy_—sdL''¢ 


“p UOINIDAS PI & SoWIOap JUOS UOTe[Ndod 
op suuNn.| op nesalu ne jo uolse1 aed eT op nesalu 
ne Iseq IP Sda[apoW sap SUOISUd}X9 sasIoAIq ‘onbneid us 
npuedal sa jso asesn | JOP ‘(¢°Z) UOIS9I LT Op NedAIU Ne 
dSLQ IP I[QPOW J] ANS SUONUIOUOD SNOU sNoU ‘sapoIaU Sd] 
JONSN][l Nog ‘JaIaJJIp UdAnad sy]IqQeiueA Ins] ap samnsoul 
So] STB ‘GH Inajyeuysa | v xnese jusWoNbyeId 39 oy[eULIOU 
ap SUOTIIPUOD Sa] SUeP SanbyUApI JUOS __q 10 FN IdWA sinay 
-PUIIS9 So] ‘AI]NO UT “sINa}eUII}sa sap (VM_) euuehow onby 
-eipenb india ,.[ JOWISd Inod sfeWIOU IO] L] JUDAINS SdII0} 
-eg[e sJajJa say aonb yusanos osoddns uo sew ‘uonnqiysip 
PR] JUeUIZDUODS asgquJodAy ouUNONe JUd}ISSad9U 9U FN Id WA 
sonbiidwia sinayeuinsd say ‘ayeigues snjd 3s9 gH 12 
Aq Sapouisul sap a][99 onb stpur} ‘say XIU SauteaUl] SaT@pour 
xne sgl] 89 GN IdNA spoyjou ey op uonvorydde J 
“Q[QPOU! UN ANs dgseq I[PUOISAI UONPUINSS | SUBP B[OI puLI 
san un gnof uo gH 19 €y ‘AN TId WA sopoujgu so] 


NOIDaY VI 
ad AVAAIN AV ASV AC ATAGOW 
<ATAGOW NN UNS AAGNOA AONAAAANI “€ 


“Q]RWIOU IO] OUN JUDAINS WS‘, =7 
le Noise 6 fi fi fi 

tl ‘Sl Van Ae TRAN tle 
ap 9[Qpow! np “a Naa ,pP Saud) Say 19 ‘a SoMOIVZTe SIdTJO 
SO] IS IDIJI9A Inod a17evd 1yd 3$9] UN yuUTOd Ne STU UO (9661) 
NA 10 Wye] ‘suri “somoyegfe sjojjo sap sois9}UI jUOS 
sfonbxne sajgpow xne sorqevordde sanbrAyeur $}$9} Soy ins 
XNVARI] SUILIIDO ONAaI UD assed 1UO (P66) ORY 19 YSOYH 


6661 siquiedep ‘ajenbua,p senbiuyoe | 


"SQOURLIVAOD 
sop soojq sed a]euoseip ainjonns oun.p aseyjoddy,| 
op JUSWIAYoRIaI UN auasgidal s[Qpoul 9D “([,0 ‘Q) ~ a ap 
juepuadeapul ja (70 ‘g) ~ ‘A no ja ‘auUOJOD anbeyp suep | 
uN SUIOW NR 39 aust] anbeyo suep | [nas un. nb yuawiajoexa 
ye A.u [I,nb aylos ap ‘| sap 19 Q sap anb puaidwioo au '7 no 
(€1'7) 

{OULIOJ BP] OP DOURLIVA BI Op asATeUL _p SA}XIW XneIgUaS 
Sa]QPOU Sap IUSIPNIP (666 [) NOX 19 ORY ‘seq “hh = (2)'Y 
18 “0 = (2)'9 ‘1 ='Z‘'g = 1€ sane (Z1°Z) SULIOJ eT Ap asa 
(€°Z) UOIBaI P| ap NeaAtU Ne aseq ap a[apour 9J ‘a[dwiexa Jeg 
(®)'Y 0) g;, ‘2 ep wepuedeput 1 ((2)'D ‘O) = 'A NO 


(ZE'Z) wo ily im 'A'T, a d'x = '& 


(L661 Hye] 19 ENE “0661 OY 10 pesesg) [PUIPNITsUO] 
OXIW dIIegUT] sJapoul gjadde stojied ‘saouPLeAOd Sap Sd0[q 
Jed gyeuoseip ainjonns oun dade ‘jIns Inb yeiaues 31xIW 
OIV9UT] Bapou np xne1oads sed sap juUOs dastyeloads anjel 
11] BP] SUBP SILIDSP SOI XIU SOITV9UI] SATQPOUL Op IIQUION] 

-': ap aipuedgp ined 
: Q 9p JUSWIOW SUAIXNap JJ 19 (-)/ SSIOAUI «UOSTLI[» Op UONDUOJ 
ep Inod (g/z)y='2 39 ‘’g ap yuowour somweid 9 10 
'Q so[euol3e1 souuahou xne sguUOpsogns ‘4 sap s}UustOW 
sistuaid xnap say anb asiogid ou (C66) URYeUNYSseY 
“‘suOIZaI Sayed say Jaydnoo inod samojege sojuad saaR 
SO}XILU SoTeguI] Sonbujsiso] sayapoul op udAOW ne sleUIq 
IQVIUILA PI OP SLO J] WSIPNID (1661) MIO] 10 AWIeLO | 
“YSURIPIG “2PM 19 (6661 “9661) ORD 19 SIAR ‘SoTRI 
“XNVIAIU XNAp B SdILIIWIS So[@pou Sap ‘Issne 
Xno JUdIPNId (26661) OVY 19 NOX ‘UOIsaI VI Op 19 ONIUN | 
Op NRdAIU Ne Sa[qeLIvAOD sap uONesI[NN,| sQpou [nas 
UN SUPP IJOIZ9JIUI “USUIIATIDOJJa ‘OUOP ‘UOIZdI BP] Op NVIAIU 
NV SdIIVI[IXNe SaqeulueA Sap Ins Jopuoj as assind uo,nb 
JO SOILOJVY[L JUDIOS ‘SNO} SIIOA ‘UOISSIIS9I BP SJUDIOIJJA09 
suleyiao aonb 90 & UOde] ap (T[°Z) BJQ@powi a] JUSsI[eI9Uas 
(6661) 10H 12 BINOPY ‘ddLOQUID INaLId & I[[OUUOISUSLIIP 
-W[NUI UOISsaISe1 op sjapow un ynpoid uorIsua}xa 39190 
(L861) JayeHY 30 Joy[N ap xneavy soy ins yuvAndde.s uo 
<'¢ J|[SUUOISUSWIPH|NU J[qeLeA vp sv ne ([ [°Z) sun, op 
NVIAIU NV I[QPOU 9] JWOPUDI (G66) PMESEG Jo Aeq ‘“eNeEG 
‘9 ap onbineuiesied uonnqimsip ounone yuastogid ou 39 
“'0 Op dOURLIVA J[NOs oUN 3a QUUDAOW a[Nas OuN Nb a\sIxo ,U 
ji,nb yuasoddns (7661) ov y 19 BJOrM {(g ‘V)O om -0 anb 
31/91 70 DLOJWY]L NILA ,| IPP VULVA DAP (| [°Z) SUOJ PI 
9p sUUN | op Neetu Ne sofgpoul sap usIpNi9 (L661) UY] 
10 VIOIYV ‘(Z766]) OVY 19 Jory ep xneary sap juvsidsur.s 
“SUOIS9I Sayed say suep SeIsap xnop ke sseUUOT[HULYDE ,| 
B Safqvortdde saoquia INa1d & S[OUUOISUSUIPIG UOISsoIseI 
QP SIJQpoul sap JUsIpMia (6661) OFY 39 [2xMS “sogsodoid 
919 1U0 9]1UN | dp NKAAIU Ne dseq ap Sa[QPpOUW sap suOTsUa}x9 
SOSIOAIP ‘Sagquue soigtutap burs anbjeanb sop sinoo ny 
‘(g°¢) uonenbg,| JuvUa}UOD oydeiseied 
3] JaNsuod ‘pies 399 & faJapow Jed sajsisse SINdJVUITISO Pp 
JUVAIOS SNOU Ud as8epuUoOs ap sptod sa] JaIsayuI A suoAnod 
snou ja oulajqgoid a9 sed asod ou ayun.] op neoatu ne 


1 gy A ee Al7+qx=.A4 


‘T=! 


J[Qpoul aT] ‘sanaueied sap sapquisul JUSWIaOJ SuONeWINsa 
sop sed yinpesy as Inb uonenis ‘aqesstuljapul yuowIsenb 
}So no gqessiulap snjd jsd,u afapour a] ‘sanuuOdUI yUOS 
‘th ap sungyea sa] anb suosoddns snouts ‘'sh o8euUOT[|NUeYDE,p 
SOURLIVA BP] WRUUOD UO] anb puajud-snos stew ‘sajUTeNUOD 
soo ev mofnsse sed jsa.u (¢€°Z) UOIsdI eB] Op NedarU 
Ne IJQPOU! JT “saresa sayiqeqoid oaav osevUuUOT[NUeYDS,| Op 
SkO 9] SURP ‘M = "M IS OIIP-R-]S9,9 ‘g1gpuodojne 1so oSepuos 
ap urd 9] Is Jnes ‘ajuswSne ‘wu onb onsow ev o3epuos op 
ued ne davai IOUdSIOAUOD PY aTJLIOeS UO] anb uarq Is ln 
‘asepuos ap splod sap sed yuapuadap ou ayrun | op neaatu ne 
J[QPOUL UN Ans sapuo]J sInajeUINSa say * x QUUOPp IURId NK 
@ dal[al ang sed welasp ou ‘Dp ‘UOTTHURYD9,p dOLNOIpUI 
g[qeliea ev] ‘xneigues snd asepuos ap suryjd ap seo 9] sueq 
“SUOIB9I SO] SURP SaTBSd saqT[Iqeqoid SaAav aseUUOT[NUPYDE ,p 
uejd jno} Inod ayejsyes isd nb uonIpuod ‘uoNdetas 
op sieiq unone ajstxa.u [I,nb Jalgpisuod no asepuos 
op ueyd 3] Ja10usI suoAnod snou ‘jIp JuowaNNY ‘uoNeindod 
Op sJepoul aj JUSAINS {mw ‘"* ‘T= 2 rl cian ti"x AQY 
uoy]QueYyse.p saaguuop sa_T aonb suosoddns snon 
(6661 NOX 10 OY ‘seq) (GH) sekeg ep enbrys 
-IeIDIY JOUIIVJUI| Inod sasvyuPAe sSUTeLIDO JUSJUAaSaId INb 
yWqoid sUOTDUO}J Sa] JOsI[WN Issne yned uo.nb sioje “(1661 
Ul]JOqUIOT, 19 UOGGINopy ‘Jour ‘a[dutoxo sed ‘0A) oureurq 
yso € a[quuea zy] Is [(D-[)/v] 80] = (V)s anbystsoy uoNOUOJ 
RB] JUDANOS ASIN UC “DY = (1V)8 D9AR 1IOS9IVO 91199 ap JaI[Nd 
-1ed seo un 3$9 ([ [°Z) A}XIW SIIeaUT] BJQOPOU! JT “ayURSSTOIO 
JUSUA}OINS UOOUOJ 9uN jsa (.)3 NOI (“0 ‘O)N _~ 74 no 
ae g’x - (“g)8 @ puodsa09 uosIel] ap 2]apoul Br (tr "9 
anbiuoues saueied ace a][aMUaUOdxa aT][IWIe} eT e JUOU 
-uaredde ja sjuepuadeput juos 4K $3] fl Q So] QuUOP qURI=9 (I 
:QURAINS SULIOJ BP] ap JUOS safapoul say anb juasoddns 
(2661) UTERO 19 pnons ‘uefereyeN ‘YysoyDH ° 4 ‘sorolegye 
XNVUOIBA SJAJJO DOAV YSI[LIQUIS 9}XIW SITOUT] SJOPOU! uN ke 
JUSANOS JINODAI UO ‘(aITeUTg s]dUIEKXe Jed) JJQIOSIP B[qQuLUIeA 
OUN NO JUSUIIIQUIOUSP Op I[QRLIVA oUN 38d 4 IS ‘aUOD Jeg 
“QNUIUOD 1so A J[QRIIA PB] IS JUSIAUOD (| [°Z) BJQ@powW aT 
- squusXkoul say no “x xnv10} 
SO] JUOS SsIPMI sanguIvIed sa] “UOIZ9I SWIQI-7 eT SUBP LON] 
-ndod ap saiun,p szquiou 9] 189 ‘Ay n0 19 (Zo ‘O)N oa Ng 
sop sjuepuodspur juos (‘0 ‘O)N om Sor 0 


beer 6 <l Cooe © fl ] fi f 
ee Visca Neal eke oO ee yy Xie 


Gro 


JONOQUID INI & [QUUOISUSUIPIUN UOISSIS91 Op B[Qpoul 
UN UOT9S “X SILI[IXnNe sIqUUeA LI & dgI[OI 1Sa ‘7 UOI9I 
ey suep fayun | e ag1oosse ‘A ‘€ ap angyea ey aonb asoddns 
uoneindod ap 9]1un,| op NedAIU Ne Seq Op s[Qpoul JT 


aq1un | 7p NBIATU Ne SIQPOT, 77 


“UOSTRI] Op BJQpour 9] suep ‘g sotoyegTe 

sajued sap aiduio9 Juawayese juouueN st] ‘fase .p odnois 3] 

Inod sa[qeLIvAao0d dp IN9}J99A UN Sd *X NO Jd ‘aB",] 19 UOISEI 

R[ UOTIS I]TeWOW sp xne} ZI SO Ny No ‘(,9 ‘O)N "4 
a Cee een hv ii ih ies PE 

Sane: EA exS ee Hol. jo (Gg Ud = “g|"« ~ enb 

juasoddns (9661) aP{ory 19 Ysueipas ‘wivipueN 7 uoIsel 


g/epowW UN Ins sapuUO} eyeuO!Ha1 UOIFeEWIISA,| JUBLIBDUOD S}Usde1 SeiHoid SeNnbjany :oey ZO0Z 


eR] SULP 12 a8e,p adnois sWiaI-/ a] suep saasodxa souuosied 
ap siquiou 9] 189 “uw 1a nuUOD gsoddns adnoi3 suaI-f np 
}9JJO,[ 1S9 “mM ‘7 UOIZ9I Be] SUP SQdaP ep nagid fi a 3 
0 ul =! 'a 00 (G'D)D x, '9 19 ('9'a)d = '9 |X 
'€ aonb juasoddns sjq (2861) JOpjey je uoeID 
dp spoyleu vy] JURAINS UD ‘"€ B5v,p sdnoJ3 9] UOTAS UOISEI 
Jed aipeyeul ev] ap sed ap aiquiou 92] JwasI[apow (9661) 
ney 19 LTYeT (L661) Joye 19 Wry ‘uelereieN “ysoyH 
ISSNV JA}[NSUOD ‘pied 399 & {7 UOISAI LP] IP SOUISIOA SUOIS9I 
ap a[quiasua un ja ‘g onbeyo anue uonryes oun qI[qQuI9 Inb 
(OU) a[euuontpuoos uorssorZas0 ne ouN ve JURINODAI UA ‘J 
Sa] Inod ayeneds pour auSuaD op [pout un Issne arepisuos 
1-4 DD .5,'9 ep nay ne (,0' MN <.'9801="¢ 
asI]ON (8661) eA UOISAl P| suep soasodxa souuosiad 
9p aiquiou 9] 389 ‘u 49 SOUSPIOUL,P [eg XNE} 9] 182” 'g no ‘(q 
‘p)D eUUUeS x 'g 10 (‘Q'U)d uosslog om 'g|‘« sed guuop 
}S9 UOIS9I andd: Jed gAlasqo oipeyeu ey. ap Seo op siquiou 
a] aonb 1asoddns ke ajstsuod ajduits afapowl uA) (7661) COPY 
39 YSOYH 9}0U 1U0,] SUTWIOD ‘SaIpE[eU Sap VoUSPIOUI,| Op 
}0 J[PUOISAI OI[CWOUW Ll Op UOTJLUIT}SA,| Bp NO soIpeyeW sap 
anbiydeisoyes uonejuasaidal ev] ap 3}Xa]U0D 9g] Suep sesT[aN 
919 JUSUA[VS9 JUO UOISAI LV] OP NKdAIU Nv Sa[@poul soy 
“sduua} np sinoo 
ne sagjai0d sed juos ou aseuUO][NURYSE .p SINdia say anb 
juasoddns sieur ‘xnesiaasues/sonbiso]OUuoIYO Sa[epoul sap 
Issne JUdsI[N (p66]) SPULOYL, 19 [aIURYY ‘YBUIS “sIU)-sIeIq 
xne dSeUQYd ap xnv} So] JaWINse eB seUNsep UONRor|dde 
Ing] SULP SdJQIUUOSIeS SUONBLIeA Soy JaIgpJar nod ‘a + g "x 
R souejuowgsddns sauio} sop juajnole stew ‘alre[ tuts 
Q[QPOUL UN JUISRSIAUD (6661) NT 10 HIE ‘uIYyeT ‘ened 
‘L = d no (6'Z) sed guuop aslojegye JUDWIOUTLUY9 op a[@poul 
3] Jed (6°Z) (LUV Fepow 9] JUsoe[duial stew ‘n-oFY op 
(2°Z) 19 (LZ) a8e[dnoo ap ja aseUUOT[NULYDE ,p SaTapour so] 
jUast|N (6661) HIE 39 yy ‘eneq *”n sduzsy np uonouoy 
Ud dLOJeg]V [UOIS9I JOJJo UNONe .p sjdwi0d JUN] OU STR 
‘gd soutoyegye soqued sap ja ‘4 samolegye xneuolsel s}aJJo 
Sap dIdWI0d jUdI} JJapOW 9D °(9°Z) dlOWeETe JUSUTOUTUTAYD 
ap a[epour 9j Ins ’n ja samoyege JUOS “0 sa] 19 “g say no 


(OV'Z) (Jon tz + a+ 1g "XN 7 a1 "6 


a7 

11109 ,$ UOSIeI] ap s[Qpoul 9] aonb yussoddns srew 

‘(L:Z) eBeUUOT[NULYDE ,p 9[QPOUI SUIQUI NP IUSAIIS 9S (7661) 
nr] 19 Lye ‘ene “(Z661) NA 18 ORY op quesdsut.¢ °"n 
sda} np uoNoUO] ud samoyea[e XNneUOIZaI s}oJJo sap anb 
Isure ‘a somloyegye XNBUOIZEI S}aJJo Sap INJoUT (6' [) UOSTeT| 
ap s]apour 9j 18 sduza) np sinoo ne sseuUOT[HURYDE,p siNdLa 
dUS SUONEISLION sap a}dwI09 JUS FUUONUEUUSNs sseUUOTIN 
-UYO9 Pp aJapoul oT *”gQ auWIOD “g yURITeN UD oIIP-e-1s9,9 
‘Q3RUUO][NURYDE Pp SINdLIO Sop ajdu109 nud} 10s [I,nb sues 
‘QUQUIOUOSY , p SITU XNBIQUIOU ap SURp sleep ud sILIDEp 
WUOs (6°Z) B (LZ) SWLIOJ BI ap safgpour sa] *,(7'Q ** ‘'Q) 


=79 2 (79o""Q)='9 N0 “(,0‘O)N — "3 daar 
: : : prt 
(67) i allie eer eR 
(DAV s[epoul uN sirejsnes 
asoddns uo, aonb “n sap juepuedaput ya (50 ‘O)N ~ ‘4 0 


prt 


LO¢ 


11 


(¢°2) ns tas gx" 
OULIOJ BT pusid UOsTeI] ap sJapow a] anb ya snuuoD 
Jso‘sh aSvuUOT[QURYDE,P SsdURLIVAOD sap sdINeU RT NO 
1 1 1 1 

(L2) Caen — '01'0 

pur s 
SWOJ RP] pusid asvuUOT[HULYIE .p s[Q@poul 
aj anb yuasoddns s]j ‘sajystpeai snyjd uostely] op 39 o8euUO][N 
-UvYdd,p Sa[apoul sap juasodold (P7661 ‘Z661) NA 19 OPY 
“SOSSI]| JUDUIDAISSIOXS SUOTJLUINSS SOP JUSUIA[GR|QUIaSIeIA 
ouop yNpoid jo suoIsa1 xne siatpnorsed samojesye sjajjo 
sop aj3du09 sed juan ou (¢°Z) UOstel] ap afapouw gJ (11 anb ya 
sda} np [lf ne sag[a0d JUSWAT[ONIIQeY JUOS SUOTILUITISS So] 
Jeo ‘ajqeuuostes asgujodAy aun sed o139-Inad jsa,u 7 anbeyo 
inod J ap sing[va sasJoArp sof 1nod “g sap souepuedgput.| 
(t onb y1ej ne yUoUUAN sUUONUSUISNS d;apOU! Np Sai] SIT 
“SILO]VITV JUSWSUTLUDYO Op NUUOD UdIG sJapoul JJ 1S9 (9°Z) 
anb viajou uQ *"Q sLIeAN[NUI seo 9] JUaIPNIE SII ‘sITTEOI 
ud ‘sonuuos quos “Zz 3a “XK sourelIxne sayqeueA soy no 


(9°7) CAN A nen 


jo 


($°2) (Jo''n'z + g/x)N ~ 'n|"6 


OULIOJ 
B] & UOSIRI] 9p B[Qpow a] aonb ja ‘sanuuod jUOS ath oaeunel 
-uvyo9,p soouetea soy no ‘("hh “ON om gq |"Q OULIOJ 
R] & aseUUOT[NURYDE ,_p step) a] aonb juasoddns (9661) 
wry 39 BIsueN ‘ysoyH °“Q ap 1OAIIP IneyeWINSa UN ISO 
“g anb 187 USWIOU Ne 7 UOIZ91 ayNed e| Inod sipme angered 
un ajuasgidai “g anb suosoddng ‘sanbrsojouoryo seauuop 
SOP 1d SaTBSIOASURI] SAQUUOP Sap JouIquIOS Inod jurod ne stu 
$]U9991 Sn{d sa] soTgpour sap sun-sanbyjanb suoatisep snoN 
‘(p66 ORY 19 YSOYH ILOA) suoTeNs sone Pp 19 SaTBSIOA 
-sueI] SoquUOp Sea] ‘Sanbiso[ouOIYS satigs soy ‘(saueAn[ NU 
seo) 'Q seneuieied sap sinajo9A so ‘sarloyegye xneUOoIsel 
sjajjo sop oajeneds souepuodap ey ‘sagjauo0o aseuuo][N 
-UBY9E,P SIND Soq Joe IMOANOd e UOdseJ dp UOIBEI 
PR] OP NVIAIU Ne oseq IP JJQ9pOW J] NpUd}a SUOAR SNON 
‘(|p UONDES PT ILOA) Svd 99 JOWeN 
Inod jurod ne sasitu 3139 JUDALOP sapoyeU Sone .q “(¢€°Z) 
J[QPOUL NV JUSUTIIIV.INUOD ‘DIIVAUT] BJ9POW Np s1109U} B] op 
sodA} syei[nsas soy Janbiydde ,p sed youtsad ou (p'Z) aapow 
3] “Uonbgsuod Jeg “d}XMU sIIv9UT] sJapou! uN sINpold 
Inod uosiel] ap sfapoul oJ Daav (p'Z) Jourquios sed suoanod 
au snou ‘slojanoy, *’{ [2101 Np sSdepuos op urd ne yUdUIOA 
-IWvJa1 9stelq UOU INoyeUINNSA,[ 189“ NUOP ‘Q = (1X | Ja) q no 


one Pay 


v 


(p°7) 


Jed ountidxa ,s 
aisteai snd aseuuorpnueyos,p sjapowl uQ, “ZK = (A | ‘OA 
aulp- R-189,9 ‘adepuos op urjd ne JUSWAANIOI asIeIq UOU 
Isa ‘4 JOOIIP INdyeUINSA,| Is WU ‘'X [eI0) Np aIIe9UT] UOU 


6661 eiqwedep ‘ajanbuae,p senbiuyoo | 


uoToUoJ aun sa ‘g aonb ja aned sa ‘uw UOT[MULYDE,P aT]IeI 
BI Is oplyea ang sed ou ywesnod Q = ('g|’a)q a[enbey uojas 
asoujoddy | “(7°Z) asvuuo][Hueyse .p s[epow a] sueq 
“9 syOolIp 
sINaeUINsa sap steiq 9] Jed a8epuos ap sprod sap aydwios 
I1U9} Ip IdeLIULAL | SIJJO (¢°Z) UOIZ9I BP] Op NRdATU Ne sJapoul 
JT ‘p'€ UONDES PI F SQUUONUDU JUOS ‘# SNUUOOUI oURLIeA 
RI Jouen ap suskow sorne,q *'th oresA QOURLIRA B] SULOD 
sioye aye uo, anb ‘sh safqeis suoneunss sap i1ua}qo 
Jnod ‘th SOQUIT]SA SOOURLIVA SOP ISRSST] Nv JUBANOS apgooid 
UO ste ‘sh SVUUOT[NULYOE,p dOURLIA PY JUSUIeI WRUUOD 
uo ‘anbyeid ug ‘ajapoul nev saaneyjar ‘4 samoyegye sopquuea 
sop 19 a8epuos op uryd ne saaneyas ‘a samoyegye solquiea 
SOP SIO} eT & puaidwiod (¢°Z) anb JaUsI[NOS ap USIAUOD [J 


1 


(€°Z) 
(6L6[) JOLUOH 19 Avy op NUUOD UdIq UOISAI BI Op NdATU Ne 
OXI DIIV9UI] B[QPOU 9] SUOUd}GO snoU ‘([°Z) «UOSTeI[» ap 
JQPOU Nev ISeUUOT[HULYIE ,P 9[@POU 9d SUOUIQUUOD SNOU IS 
‘anuuod so ‘sh sjanbsa] inod sjuepusdgput (‘mh ‘Q) Ay SOULS) 
sap juos ‘a asvuUO][NULYdE,p sina sa] 10 (‘4)3 = 'g NO 
(72) '2+'9='9 
anb sosoddns ap janiqey oro us so [T “<u 
[euolsgr woTAUeYDE,| OP [lei eI Is juawonbyewisyshs 
O1STX9 yi op a JOdIIP Inoyewt}sa un nb suosoddns snon 
‘sadnois SIdAIp Soy Inod ([°Z) WO P| 
OP SIOUNSIP Sa[Qpour Sap dIIN.IysUOd ap Jd sadnoid ua sUOIsaI 
$3] JOSIAIP op ajqissod juawsTesa 3so [[ “SoquUOT]NHURYIE 
uOU SUOIZEaI xne Issne onbijdde-s ([°Z) afapowl gq] “ayeutou 
10] 2uN JUaAInNs ‘4 sat onb ano ua asoddns uQ 0 OULLIVA 
oun 32 anu suUdAOU OUN 4UO 3a ‘safaII0D sed jUOS ou 
“a S23] NO 19 UOISSaIZI Sp saNguIVIed sap d in9}99A 9] 189 J NO 


(12) we 


Tein eter dix=c0 


:‘a SoMloyegye xneUuoIsel 
Siajjo & SiegUl] e[apoul uN B JUALIgULIOJUOS 'X & O9I[OI 
4so ‘()80] = = 'g anb a9 ‘Cpe= 'g ogtidoidde uonouos 
ano} no “x uorlsai aned vy ap uoNendod vy] asp ouudAouI 
eB affaenbey] uojas asaujodAy,] ins apuoj as uolsai ve] ap 
NVIAIU Ne I[QpOul UN “JUdWdTeJUSWUepUO, ‘sogUUOT[HURYSE 
uoU SUOIS91 Sa_ Inod onb tsure ‘(w ‘* ‘[ =) 7 saguUOT[N 
-uvyoe suolse1 soy nod ‘’x ‘uolsei eT & sozatpnonsed 
solelfixne saguuop op asodsip uo, enb asoddns ug 


UOISI1 Bl IP NVIAIU Ne Szjapoy. [7 


‘OUUN, | SP NVIATU Ne SaTapoul Sa] 9 UOTSEI 

Rl OP NVIAIU NV S[QPOU SI] IIOABS B ‘SolIOS9}v9 XNep ud 
XNCUOISAI SOTQPOU So] Jasseyo jnad uo ‘apesJgueas UOSe] 9q 

"6661 JOU -9661 AGUS -S661 

Areylypy 39 UNYypNeYyD ‘p66! OssmyY 30 Issoyey ‘Is1O[e 

‘gjdurexa sed ‘1ax[nsuod ‘piesa joo ke ‘(JJa ‘UOT[HURYI9 | 


op gle} eB] Op UOTOUOY ‘anbyayUAs) a19e1IPU UOTFRWISA Pp 
SOPOYIOUW Sd] INS SJULSSOIOIUI XNVAVI] OP S}eI[NSAI So] JUSU 
-W9991 atyqnd yuo sinajne SIdAIP ‘SIOJa]NOT, “UOT[HULYIE ,p 
SOQUUOp op USXOUL Nv Sa[apour $9] JOpI[eA op JouLiad aja ,.nb 
We] NV UI} [Q@pOW uN Ins dxv dpOYJOU! LT Op ISeIULAL 'T 
‘SoJURINOD SOATILIISIUILUPe SagUUOP sa] NO saqyudde1 snjd 
Sd] JUDWUASUIIAI AP S9QUUOP Sd] SUTLUOD ‘SaIIeITIxne saguUOp 
SOP B BOVIS SUOISSI sayNad sa] ajUd UdI] UN JUassI[qeied 
nb soqrorjdxa sayapoul sap ns Japuoj ds JUDALOP Sa}DaJIpUI 
SUOT}BUII}SS Soy onb Iny ,pinofne jUdWaTeI9UYS JOLUIPe UO 


XNVNOISAY SHUTAGOW = °7 


“suoneordde 
SINZ] op 19 (GH) sedeg op onbryosesst1y opoyjauw! PT ap ‘(qaq) 
sokeg op onburdwe spout e] ep ‘(GN Td) eesierq 
UOU dIIe9UT] UONDIpeid oinay[1ouw ey op onbrsrduia aspoyjeul 
R] op uae mb xnao Jainonied ua ‘saguue salgruiop 
buro onbyenb say satjqnd ajapow un ins seseq sa[euoIsel 
UOTJCUIN}SI | B SQIOVSUOD SAIOITIe Sa] Ins a0d ‘(p66 [) OFY 19 
ysoyuy sed sartqnd ajjao ajayduoo nb ‘apmia ajuasoid eT] 
‘unone dIIOA ‘UOTTHURYDE Ned 
un.nb sagjaid au uo sayjenbsay] snod sane .p JUSWILNEp ne 
SOdIPNIO (SOUIBUIOP) SUOIZ9I SOUTLIIDD JOUUOT[HURYSEINS B 
uodey op ajygnbua ,| UsWISJEqITap SAtOSuOd UO] aonb date [I 
‘JusUTUApsoaId QUUONUSU SUOAR | SNOU SWIWUOD “sagIpnys 
SUOISAI Sajjad say sajyno} inod sastogid juoWWIeSIJJNs 
Sd}DOIIP SUONPUINSS Sop aiInpold 11oAnod Inod apuess Zasse 
JUSULAIIESSa99U Sed jsd_,U SUO][MURYSE Sap aI[Ie} eB] ‘oInsowW 
op oluas 90 puaid uo Is sWQW ‘sIOJa]NOT, ‘aseWIQYd 
-QOULINSSE P SUOIS9I Sa] sUWIOD souIeUIOp sop nod 
aNn{NoA uorstogid ey] Itua}qo Inod ‘aygnbua,p ueyjd np uon 
-PIOQE]9,| op JUSWIOW Ne ‘atqissod np ainsouw e] suep ‘sastid 
ae JSALOP ‘UOT[HULYSS,| Op sileIpsuojul UONedal P| 
SUIUIOD ‘SaAUaAgid SainsaUl sof ‘juonbasuod Jeg ‘(epeuRD 
ag Inod %IC‘T & BE op 12 ouejuO,| nod wp‘¢e & 
WRT op UONRJUSWISNL) [PUONeU Jo [eIOUTAOId xNneaaluU xne 
"AO NP uUONeWOWSNe s19S9]| UN .p xd nV BWp‘'6 & B/‘LI 
ap oueuges oid 9] nod anuajqo *A*d Np ANIIeA PI Jassieq WeJ 
ISCUIQYI-dOURINSSE .P UOISAI LI UOTAS sarqissod suoeUISS 
SAINI|IIOW Sa] asInpoid inod saseusuwl sane QOYO L1 sep uoN 
-edai ve] sind ‘sayqeij sayetoutAoid suoneultysa sap I1u9}q0 
Inod saseusw YOO Zp ep UONTuedal eR] ploge .p yueucidu09 
sodeje xnop ua uonniedgas oun ‘amjUod Jeg ‘adeUIQYd-sour] 
-NSSP,.P SUOIZAI SoUTeyIIO suep %/‘/ [| sIpUloye jnad nb 
(‘A’) UONRLIVA BP JUSIOIJJOOS UN «SINIUIOYO» sa] Inod y1np 
-oid yeroutaoid nesatu ne uonestwindo | ‘saseugw OOO 6S 
ap [ensuswl UOT[HURYSS UN,p sgidne sasi[eai sa INb ‘epeueD 
np sanoe uonefndod xy ins ajgnbuq| ap seo a] sueq "[eI9 
-UIAOIAVIJUL Jo [LIOUTAOIA XNBOATU XNe dUT[IQUI} Ip Sd1gqLI9 
So] oulejsyes Inod soiessao9u (a1leIpswajuT uoNNIedsl) 
uoT[HULYOS,| ap JdeJJo,| op UONIedal ap stuoIdWIOd say 
ANSN][I Udtg OJ JUSWILULIOU UO SI] “saVUOIse1 sonbnsneis 
S93] Ins souaprour oun yuo Inb asepuos op uryd np sjoodse 
So] JUIUIeXA JUO (PGGI) [AULYY 10 OUIqUIey ‘YsUIS 


g[epow un ins eepuo} eyeuoibes UONeWI}sa,| JUeUI@DUOD S}Uade1 SeiBod sanbjend :oey 00Z 


‘OMS STH ((OuvIUD) CPMLNGC ‘AJISIOAIUP) UOJIpLIVD ‘soNSHLIS puL soneUaYy eI] JO [OOYDS ‘ory “WN 


‘anbuysije}s e] 
OP [PUONLUIDJUL ININSUT ,| IP SA[[ALNSOWas sag] quasse Sa] 39 
UONLIDOSSY [VONSNLIS ULILIOWY | Op Sojjonuue sog[quiosse 
so] suduios A ‘suaionsneis ap sojuad91 sajjouUoIssayoid 
Sog[qUasse Pp SIO] SaUe} 919 1UO J[RUOIS91 UOTRWINSO,| 
INS SdWIJO 19 SddTOI]JOS SUONROTUNUIWOD sasnoIqUIOU 
ap ‘aTINO UT "666 1008 6] J ‘otuoNIy] ‘esry ev ‘algnbus.p 
SUSIONSNIS Sop J[VUOTVUIAJUT UOTJBIOOSSY ,| Jed asturs10 
‘ORY WNL «[euorsel uoyewnss,| & UOTONpONUT» (It 39 
C66I TW EZ 19 ZZ SAI“ O' “UOISuTYse AA “AOIDOg JeoNsNeIg 
UO}SUTYSL AA P] 19 ASOTOPOUIA|Y ADAING Ul WeIdOIg JUIOL 2] 
Jed gstuesio ‘ajqreyos “TMA 10 UOYeY “DH “aN “VA ‘OVy 
“SN‘¢ sed «uorsai ayned sed uonewmnsy» (1 UOp sesodoid 
919 JUDWIITRS9 UO SAB9IQE SINOD SOC *6GH6I NOV [Z 19 OZ 
Soy ‘aUONTT ‘eSry & nal] na ev inb syeuoisa1 UOTeWINSA | INS 
JCUOICUIOIUL JI ][IIVS DOUIIOJUOD PJ (11 39 YGGH| SILWI /7 19 
QZ $2] “Od ‘UoIZuTYse AA ‘SNsudad aU} Jo Neaing ‘S'_Q 2g Jed 
DISIULSIO J[LPUOIZII UONPUINSA,| INS IOUdI9JUOD PJ (I SUOIO} 
-nofe snou ‘inof e a}siy 91100 dI}}OW INOg ‘saguUR SoaIQTU 
-19P SIO SISIULSIO I[PUOISII UOTLUIN}SI | INS SJoI[aye sop 
39 sanbo][09 sap ajsI] B] 9sSaip 1U0 (P66) ORY 19 YSOYH 
“SUIROLIOUIe 
XNvlgpaj SOUULISOI XN S}ODIIPUI SINDJVUINSS Sap UOTE 
-1[ddv | op npuai-a}dwi09 jusaTJa0xa UN (966[) BIqQreyoS suep 
d1]NO Ud BIDANOI) 1N3}92] FT €66 1-766] Ua. nbsnl saatjqnd 
Q[PUOISAI UOTLWINSE,p sapoyJoU sap uOnENTeAd,| vB 39 
jJnsneyxa uswexa | & speooid quo (P66) ORY 19 YSOYUH 
(GH) sokeg 
op onbryosresary inayeuiysa | 19 ((NIdWa) oesieiq uou 
aulegul] UONOIpeid sinayjiowl ey op onbisidwia inayeusjsa | 
‘(qq) sodeg op onbinidwa simoayeuiijsa,| JUONTOUI UOI39I 
RL & Siotpnosed sjajjo soy sais9}ul JUOS sjanbxne sayioljdxo 
SoJQpOWl sop Ins sgpuoj xnado onb spur} ‘sajytsodui0s 


i 


19 sonbnayuAs sinoyeunsa soy JUaNpOUI soyWorfduut sayapou 
SOP INS SPPUO] SJODIIPUI SINIJBUITSS Sa] “SoyUvINOD SdAT} 
-PIJSIUILUPR SOQUUOP Sd] 12 SJUIDI JUIWIISUIIOI Op SatfJIYO 
$2] SUIWIOD ‘soitejustUa|ddns saguuop sap & ddvI3 SaXOUUOD 
SUOIBOI Sajned sa] DdAv UAT] UN yUassI[quia INb saqror{dxe 
NO SoA SaT@pOU! SAP INS S9PUOJ JUOS S}JDOJIIPUI SINd} 
-PUIT]SO SAD ‘“UOISIOgId BI OUOP ‘UOT[HULYSE,| OP OANIEJJO 
JT[Ie} VP] JUDUSWZNe IND «s}OaTIPU» SINd}eUIT}Sd Sap I1U9}qO 
@ UOSRJ IP SAXOUUOD SUOISAI Sd] SUP «S9d10J Sap JasInd» 
nev} [I ‘suorsa1 sayyed sao nod suoneuinysa sap Japnoyeo 
Inog ‘(A][[NU SUIQUI SIIOA) aIqQIeJ Iso UOISdI ev] Be oidold 
uoT[HULYSE | op o[Ie1 ve] anb sored ‘«suorIsa1 sayyad» sap 
QUILUOD S9}WOD Sd] NO $}e}q Sd] JaJOpIsuod ynoad uo ‘ayduraxe 
129 suRC ‘SdIWIOD so] SUNOS ‘suOIZaI-snos sap nod 
ae} ds] op spqissoduut sinof[no anbsaid jsa [I 9 syeI_ Say Sno} 
‘suosip ‘Inod sa[qely saydeTIp suOTeUINSe sap asInposd nod 
puvis JUSWIUURSIJJNS UOT[HULYSE UN IOUUONDIIS op a[qIssod 
JUDUIOIeI ISO JI ‘suIOWUPAaN “ase,[ NO onbiuyje odnois 
d] ‘DORI BI UOTAS Sasse[o souTeWOp sap inod aqridaooe 
UOISIO9Id ap $d}DdIIP SUOTIBUIT}SO SOp INUINO}J Inod anduo09 
iso ADAING UOTyRUTWIeXY UONLINN pue yyeoy yeuoneN 
PIUYL “S'Q eI ‘epdwioxa seg “saysaIIp SuUOTJeUII}SA Sap Ja[NoTeo 
assind uo j anb nod apuris JUSUMUeSTTJNS IOS UOT[URYE | 
op a]]1e1 ey onb oued ysa [I ‘sonbrydevssoas suoisei sayyjed soy 
jUsWdIET[NOWIed ‘saurewop syed sureyiso inod ‘juepuadag 
‘ouivuUop ne saidoid uoj[HURYde ,.p SeauUOP So] Ins JUSUI 
-anbiun sgpuoj ‘«sjdaJIp» SInda}eWsd,p UsAOW Ne SoUTeU 
-Op SpueIs sap sonouesed sa] oWISa UO “JUdUATTENIIGeH 
‘(soutewop) ‘suonendod-snos sassaAIp Inod issne stew ‘uon 
-ejndod ve] ap ajquiasuad | Inod juswaynes uoU suoneUIT}sa 
Sop Jaynoyeo 1nod asepuos sed sajgnbus xne 11n0de1 UE 


NOILONGOULINI “T 


“‘XNBUOISaI Sojapowl ‘sakeg ap onbiyoseis1y opoujawl ‘sokeg op onbuidwia spoyjay_ ‘SATO SLOW 


‘Q[LUOIS9I UOLUINSA,| ap saj}UddeI1 SuOTwoITdde sinaisnyd 


Issne aJUasaid |] “Sa[apOUul sad kB ‘(GH) Sodevg ap onbiyosess1y spouow ke] 19 (qq) sodvg op onburdurs spoyjou bP] “(GN TdWaA) 
dasteiq UOU aIIeaUT] UOTOIpsid aina[[Iow! ev] op onburduis spoyjaul ve] JUOP ‘sapoYIoU SasIOAIp op UONPoI{dde | Ja xneuoIseI 
sojapour sinaisnyid sunuexd inane | “uaWwastodid sn{g ‘P66 US OFY 19 YSOYy Jed gijqnd tnjoo ajayduroo ‘saquue solgIWep 
buto anbyanb sap sinoo ne s9si[v9J dJQpOU! UN INs s9seq UONeUINSd,| INS xNeAeT] xne j1eI) e INb ‘joe JUuasaid JT “€661-766 1 
ud nbsnf sarjgnd ayeuoisa1 UONRUINSA Pp SAPOYIJOW XNL S9IOBSUOD SaJoITIe Sop dATJSNeYXd apnje oun kv spgo0id yuo (P66 1) 
ovy JO YSOYH ‘sojusoelpe suoisal sa] Ins saguuop sap Jed sgo10JUSI JUOS INb ‘aTapour UN INS saseq XNIO JUSUTUIL}OU ‘s}OOIIPUT 
SINDICUINSS Sap JOSI[NN.p ailessaoau ouOp js9 [] ‘apqrey doy JUsANOs jsa UOT[NUeYDI | dP a]]Fe) eB] ‘sSuUOISaI sayed say Inod 
‘anb sored ‘stogid juowuresyyyns sed yuos ou sanbisse[o s]ooIIp XNVUOIZEI SINDJBUINS SI] “SO[QeI] XNVUOTSEI sINoJeUINSO,p 
QJURSSIOID OPULLDP L] V ISUOdDI UD SOQUUL SIIQIUIOP $9 D[VUOISII UONLUII}SI,| B DapPIOOOR 9)9 Be UOTUDNe p dnoonvag 


aWnsay 


OVE WNL 


d[QPOUI UN ANS sIpUoyJ 
I[CUOISII UOTVUISI | JUBUAIIUOD $jUId9.1 S91d01d sonbjangd 


661 


epeuey anbiysiejs 
Zb2-664 ‘dd ‘Z u ‘SZ |OA 
6661 eiquieoep ‘ajenbuse,p senbiuyoe | 


“TE-€7 ‘7 ‘aianbua_p sanbiuyoay ‘sajdyjnur 
sgisop & INES sseuUO][HUeYoS UN suep ajIUypyoRf ooURTIeA 
ap SINaJeUNso sop UOHeSeSUTT ‘(9661) “Nf OVA}? “MA ‘ONNA 

‘OP9-SE9 ‘Lp ‘UoNDII0SSy 
[PIUNSIDIC uDIIdaUYy ay] fo JoUANOL “saInseau UOTIsod 19y}0 
pue SUBIPOU JOJ S[eAJOJUI 9DUSPYUOD (7661) “SU ‘“AHNAYACOOM 


“CLI-991 ‘6 ‘SouSUDIS JDIIDUAaYIDP fo sjouuy ‘satdures 
ISIC] WOI} S[LAIOJUL DOUIPIUOD IBLIOAR ISOUOYS “(SE6I) “S'S ‘SMTIM 
‘Q6E-LBE “18 ‘SoMJawouorg 
fO Jousnog “suoyouny joatd ysnqo1 jo sjool [eoliournu 
UO paseg JDUDIOJUI [eONsNeLIs JO SUOTeVpUNO (8861) ‘G'H ‘GONIA 


‘Pe-ET ‘ST ‘anbysuvis ap auuaippuvs anaad VT ‘(UOISSNOSIpP 
DOAV) ‘QDUdTOS [eIDOS pue SADAINS [BINOS (L661) ‘A W'L ‘HLIWS 

“‘BeLIO A -Josuldg :yIOX MON “Surjdiumyg Kaaing pajsissy Japo- 
(C661) “f ‘NVALAYM 19 “ad ‘NOSSNEMS “AO “TVGNUYVS 

‘977-177 ‘pS ‘anbusunis 

ap ajouolousajul anaay “SiOJeUINSa PpoOoylfoyl] wWiNuwirxew 
SUISN S[BAIOUL POUSPIYUOS IsNgOI apo (9861) Wa “TIVAOU 

“OSE-EEE ‘9ET “VW SALIas ‘K1a190¢g JvkOY Jo suoNovsuv.s 

poriydosopyg “Ayyiqeqoid jo Aloay) [eorsse[d oy} uo paseq 
uoneunse [eonsneis Jo A1osy) & JO 9UTTINOC “(LE6T) ‘f ‘NVINAAN 


"TS9-8S6 ‘L6 “Ma190g JoousuDls 

jokoy ays fo Jounog ‘(UOISSNOSIP 9dAv) ‘UOTOaTas aAtsodind 

JO poyjow! oy} pue surljdues polyyens Jo poyjow oy) :poyjow 
aanejuasoidol Jo syoodse juoJayJIp OMI UD. “(PE61) “£ ‘NVINAAN 

“epeuesd onbnsiyeis ‘arsojopoyjaul 

RB] ap wuonselld “A 8ZO-88-CINSA “ON [learn 9p jusuinsod 

‘ues uoNe[ndog ay) JO aseg oyf, ‘uOoNONNsUOD JeAIOU] 
sdUaplJUOD JO} suooUNA SuNeUNsY JO IF UL (8861) “T HOV 

“CTV -LBE 

“DQ ‘dyoUalD lupaojsad Og sidospy ‘Burjdures Aytyiqeqoid 
ul suajgoid Joyo pue Asoajens winuindg (6S61) ‘f “Marv 

‘TLI-LEL ‘TZ ‘aouasafuy puv Suuunjpg J0INSUDIS 

{oO [Dusnor¢ “(UOISSNOSIP 9dAv) ‘UONVUINSS pooylfeyly-tsenb 
Jo uolsusixg UY (6861) ‘AWW ‘NOSdWOHL 19 “d’A ‘ASINVGOD 

“QCT-LTZI] ‘pS ‘anbys10¢ ap ajouoipusajuy anaay ‘uonewnso 

pue diysuoneyel toy, :uonejndod Asains pue uonendodiadns 
Jo sisjoueied (9861) ‘AWN ‘NOSdINOHLL 19 “dA “AGIWWVdOD 

‘VVC LET 

‘¢¢ ‘anbysypig ap ajpuoipusajuy anaay “uotyeunsa yeurndo 
pue pooylfay!]-isend (1861) ‘OD “ACGAMH 19 “dA “AGINVGOD 

‘ppouvny np anbijsyvj¢ 3191905 

‘ajanbua p sapoyjau Sap uoNIas V] ap 966 Jlanoay ‘suljduies 
A@aIng Ur siojoueIeg JO uoneuMNsy (L661) ‘d'A ‘AGNVdOOD 

ESV.GaLGC 

‘ez ‘anbisijojs ap auuaippuvd andar v7 ‘Ayyeundo :surpdues 
AQAINS ul siojoused Jo uoneWINsSA (S66I) “dA “‘AGINVGOD 


aHeuuoj|ijUeYOS US SOURIJUOD Ap SaljeAJE}U! S98] INS pueHal NESANON :uosdwoy| je equepoy S61 


pure suonouny Suneurnsa Jo AjeuosoyUuO (1661) ‘d’A ‘AANVdGOD 
QT H-6I bh ‘TL ‘Oyldjauoig ‘sassaoo1d oNseyoo}s ul UOTeUINSO 
[dues ou jo suonepunoy a4 (S861) ‘d’A “AAINVGOD 
‘TI-L (87 ‘sousuyys joanynoiusy fo k1a190¢5 uvipuy ays fo jousnor 
‘suoneindod yenjoe wor Surdures Jo A109y} dy} UI syuaUdOJaAop 
jusde1 Jo aanoadssed yeouoisiy WY “(9L61) ‘d’A “AHNVGOD 
“STL-OOL ‘77 “Ka120§ oorydosopiyg aspraquing ays fo 
ssuipaaoig ‘UorRUINse yeonsnels Jo AIOBYL ($761) ‘VY “YAHSIA 
“L&b-LSP ‘SQ ‘DylaWO1g ‘(UOISSNOSIP SOAR) ‘UONCULIOJUL JOYST] 
pojoodxa snsIdA PdAJOSqO ‘JOJCUIT]SA POOYTOA!] WNUWIIXeU UY} 
Jo Advind9v ay) Bulssassy (8/61) ‘A’ ‘AATANIH 1° “'d ‘NOT 


“KOT 
UYOL YOK MAN “surjding fo Croay] awiog (OS61) AM ‘ONIN 


“AOTIAA UYOL YOK 
MON “(Py OWgI-¢) ‘sanbiuyoay surdug (L161) ‘O'M ‘NVAHOOO 
‘pue][OH YON ‘wepiajsury ‘suiduns Kaaing fo saisajpus 
pup Koay] payiu) (8861) ‘AMT ‘SOA  “V ‘TEHNHANVHO 
"EPOI-SEOI “6E ‘MONDIDOSSY [DINISTIDIC 
upouauy ays fo Jousnor “SKdAINS Xd{dWIOD WOT, UONeUINSS IOJ 
suonouny Suneunsa JO 98-) (F661) ‘Z “MV.LVd 3° “V'd ‘YAGNIG 
‘767-6LT ‘1S ‘anbusuvig 
ap ajpuolousajuy anaay “SKoAins xe{dui0d Wol, sioyeUINss 
[euou A]jeonoydurAse Jo saoueveA 94} UD “(€861) “‘V'd ‘UACNIG 


"p6T-L8T ‘OT “BAYYUDS 
‘yuoulsoe[dor jnoyM pue ym Buldwes uM (861) ‘Gd ‘NSVA 


HIAd VaASOITald 


‘SopuvIS JUSIUUUSIJJNS JUdTOS y ‘* *T = ren 
soyes sop ay][te} ey onb isure “w suoj[MUeYdE Sap oI] Ie} ey onb 
UONIPUOd FJ & “QUUOTJUDU ag ,p JUSdIA INb uONe{ndodiedns 
op sapour 9] aodurt nod ‘sapryea juos suoNeUITXoIdde sag 
"(¢°S) 19 (pS) Ua sUTUIOD (3)A UOTJEUITSS UOS ap jo (3)A 
OURLIVA LP] Op SUOTeUITXOIdde sap sUOAR SnoU ¥ “ST = f° N 
Q[Iv] Bpuels op soyens sop inod (AJ) — ({) ep sANsed e 
‘juanbgsuoo reg “(,U/,N)O 2Ps0,p 189 Y ap outa} JorueId 
a] aonb spur) ‘(A/1)O pso,p xnep sno} JOS g dULIA} 
2] 12 PY Op 9ULI9} OWIaIXNap a] anb JaNUOW OUOp ned UG 


Pra th aul ti oeane 
el raid ale gaa: 


dULI8} 9] (AT) 19 (IID) ue 3! ‘0 = (x9 - ‘A)3 
uone[ndodisdns ap sjapow np asneo e ‘anb saj0u VY 


(AD { sey: 
z A 


Z61 


ua pause as A; wee uo g 


aun oy eT = Nex PS =x 9 NIA ee {QO 
OX ee Ee ON 
(ID ST A a RE 


uae es apes 
x= MO oa Apt. 
Zz y 
®) ®) ‘63 ‘yu C xX fi 
{ex%- WE I aT kee A)+ 


B [&S9 1S9 «YW» ap sIqUuIOUI 
puodes Np sULI9} oWIaTXNap 92] ‘sn{d 39q ‘s}uBepuedapul juOS 
soddeis sojusigjjip Inod a8epuos ap suvyd say *¢ uondas 
PR] Op INgEp Ne gyeUsIS SUOAR,| SNOU SWIUOD IC) ‘sax 2 ) 
soddei3 sa] juonurew nb souvsedsa,| ajuasgidel °F no 


fica eos 
“fae / (xo) Gia wee 
@ z x 
ou0qd 
(1) ‘9+VW= 
, P i= ialt 
‘ 5) xX >) ns 5) xX 2 ze zN fa 
0/ (x42) Shed (4-4) Sf eae 


a ) X 2 ise 7N 
: {u/ (x4) ape Qa- (ia 


snid aq 
0 = (8)q anbsind (, 8)q 180 ‘(38)A aIIp-R-1s9,9 
(€¢) ud 8 UONeUITSd,p UOTDUOJ B] Op OURLIVA LT 


AXUNNV 


666| aiquaoap ‘ajenbue,p sanbiuyoe | 


"S[No[ed Soy 
Inod d0ur}sIsse Ind] ap Jo S[IasuOd sind] ap SuvAA Suvrxurry] 
y9 USYD enNyRIf JUsWITe3S9 SUOTOIOWIAI snON ‘asodxea 
uasoid np ainatigjue UOIsIaA ouN,p jefns ne sanbiewsl 
sosnatogid sas ap YSUIS "D'V JOlOIOWIAI B SUOUD) SNON 


SINGAWHD Yaad 


“UONeNIS 9199 puaj-snos 
sonbinaweied sajapouwi ap assvjo apuvis oun ‘onbineuresed 
-Was gapowl un Inod «apifva» ysa ([][*L) JoAId neaAnou 
anou ‘snid aq ‘suone[Nulls SoU ap s}eI[Nsa1 Soy JUONbIpUI | 
SUIWUOD ‘sat[aUUONdadxa JUDIRIAS SIDURISUODIIO SaT[a1 op 
‘QBEPUOS UN Pp 9}X9]U0D J] sue “(Z'8) JAUUONUSAUOD JoaId 
JJ INS S9PUGJ BOURIJUOD Op SaT[BAIOVUT XN JUSWIANeIedWOS 
(SO][VAIDJUL SAP ININSUO] PI Op 39 BINIDANOD ap aytpIqeqoid 
RI op 3sd Inb 99 inod) sajqeiisapul sajyatidoid sap MOAR .p 
anbst1 JayjatJ ap ioatd aj Ins spuoy sauuaXouw ap one 
un Inod dduRIJUOD ap SaT[eAJOJUI Sa] ‘(O19zZ op juBYyooIdde 
9s SQUUdAOW Sap oun ‘(4 ‘x) ap saTqeuueA xnop & a]TeUIOU 
ve] ‘adwoxa sed) sanbinsureied suonnqimsip saureyico 
Inod :uvlys0D ap suNRAlasqo say SUOIPIOgR snoU ‘(//61) 
ueIYIOD sup UOT}sonb 389 [I JOP “JOT op JOAId ne yUSW 
-9]101]9 d]quassai (| [°L) JoAId neadAnou ayou onbrun ayes)s 
2UN Pp Svd 9] suep onbsind ‘anb aiassns v IndjeuIWIeXd UL) 
“QUdWISNe UOT[HURYDS,| Op oI[Ie} Be] onb ainsauwl eB JUSWIZTe39 
ONUIWIP BdUdIOJJIp VY JONUTLUIP & pu} ‘(7°g) [BUUONUDAUOD 
3] 19 (TL) neaanou QI ‘s}oatd xnap say aU JUsUIApUST 
Op VOUdIFJIP el ‘awWOJIUN | & JUOpUd) aJeNs anbeys 
Op UlaS NB dILOJYTR B[QVLILAOD K] Ap sAna[ea sa, onbsind 
‘eal uq ‘Inojdwe |, op pusid aioyegle s[qeieaod ey] 
op sing[ea Sap uONeIeA eT onb sinsaw ev a[qenbiewias snjd 
d109Ud squids sugUIOUYd FJ (7g) [eUUONUDAUOD JoaId np 
IN[99 B [eB9 SUIOUI Ne Jsd ([ [°Z) OATd NedANOU Np JUdWIApUdI 
J] ‘Z neafqe) a] onbipul,] swu09 ‘sajyes say sojno} Inod 
anbynuspt 9g Inod aip-e-jso 0 ‘uoNeNs s1QtWoId ve] suep 
‘snjd aq ‘(7'g) [AUUONUdAUOD OAT J] INS SapUOJ DOULIJUOD 
OP SdT[PAJOIUT Say onb «sagiepoap» dINLI9ANOd ap sar[iqeqoid 
sep soysoid snjd «saj[agi» dinyaAnod ap sazy{iqeqoid sap 
JUDSSTUINOJ ([ [°Z) JOAId NedANOU JI INS S9pUo} DOUTJUOD 
Op soy[eAlajul say onb ‘p 39 Z Xnvalqe} say sqide.p ‘aIe[D 
JSO [I ‘UOTENIS d]]9] ouN sue “aTINe,| B Aes oUN,p ILA 
Q onbsioy ‘([ [°L) JoAId nedanou 9d] INS sapuoyj dOURIFUOD 
OP SI[VAIDJUI Sap JUOWOPUdI 9] DIP-k-}S9,9 ‘8 UOTRUI 
-S9,p UONOUOJ LT Op JUSWIOpUdI J] JOIPNIS.p JueWoduT 
$91} }S9 [I ‘OUOP “JUaUIa}JQIDUOD ‘aystyea1 snd ysa ‘ala 
‘UOHeNIIS BWAIXNap LT “UdIG sa aUUONDUO] ‘(191 sagjuasaid 
uoU) UONRINWIs op sapnja sou juonbipul,, sWUWIO0DS 
‘p UOT}OAS P| Op ULj RP] B QJUaSaId yoald 9] ‘anbi09y) jnoyNs 
}Q19}UI UN d1JJo INb ‘(sayeNs sa] $ojno} nod onbyuapt g Inod 
OIIP-B-}S9,9) UONPNIS d}99 sue “UOENIS dgIWoId Be] suRp 
anb gfeundo jsd,u ([[p) ud 8 UONRWINSO,p UONDUO] eT 
‘orne | B aeNs oun .p (dnoonvaq sed sreut) auea Inb g snod 


MUIIXNAP P| ‘SaywVIJs So] $9jno} Inod anbnuapt g UOIssais9I 
ap jato1jjaoo un Inod asarwiaid ej :suoneniis xnap suoas 
-PSIAUD SNON “IINQns zasse sioje sd (7g) JaUUOMUDAUOD 
OAld np 39 ({ [°Z) 10AId neaanou np jUsWAepuUa Np UOsTeIed 
“WO BT “aslojegye a[qeieAod oun JayOdw09 jueAnod suoney] 
-ndod sap nod aourljuod ap sayyeasaqut p yafns ne syeqnsai 
SOP JWASSIUINOJ g UOTIDAS BI BP p JO Z xnwa[qei sa] 
“o1109u) 
PR] & OWIOJUOD Jsd Issne RAD “JONUTWIP B puda} ‘([°g) OAT 
3] Ins one] 19 (6°L) JOAId J] Ins spuo} uN,| ‘adURTJUOD 
OP SI[[VAIOIUL,P S2[QUIDSUS XNaP SI] BUS BOUdIAFJIP PY ‘(191 
SULIO9P UOU STR) JUDWIdINILIA}U SQUUONUDU SUOT}E[NUIIS 
SOU Op s]eI[NSai So] sqide .p ‘suOT[HURYSE spuRIS ap INog 
“Ouyne | B Bes UN, p OUeA 
Q anbsio] SWIQUI a[quyeA 9)SaJ (¢"p) Ud 8 UONRUINSA,p UONOUOJ 
eR] op aytpewuindo J onb tor 1ausi[nos e suoUd} SNON *g UOTIeS 
e] op Ingep ne sain elap UOISN[OUOD kB] JISUO]OId JUSTIA BIID 
eS tte Katey ‘0 = (@-'4)3 ‘uooel-snos onbunowesed 
-IWIS B[QPOul aOU ap nuda} a}dWI0d sipudye As WeANnod 
UO ‘SUONNQLISIP Sap SUL} PT [U QoURLIVA Pe] Jed sayono} sa} 
sed ysou uosiesedwi0s P| ‘JuoWestogid sn{g ‘anne | e aes 
dUN Pp SoUUdAOW SINIVA SINI] ap UOeUeA ke] ap isa nb 
99 Inod jnouns suonnqLysip sap puadap ({°g) jeuUONUSAUOD 
WOAId np 39 (6'Z) JOAId NesAnou Np sjUdWapUal Sap UOSTRI 
-eduioo ey onb aquias [I ‘awuojIuN ja aed IYO ‘aTeUOU 
OIIP-B-}S9 9 ‘SUOTINGINSIP slo] Ins saapuo} suOTJe[NUIIS 
sou saide.q ([°8) [euUONUDdAUOD jOAId J] INS JUdPUOJ 
as nb xnao aonb JusWIApUdI INITIO USIg UN jUO *g UOT}O_S 
Re] Op € 19 [ XNeaIqQu} Sa] SULP JO}e}SUOD 3] SUOANOd snoU 
SUID ‘(6'Z) JOAId NedANOU J] INS s|pUoJ dOURIJUOD ap 
SO[[PAIOIUL SAT “DOKdTJJO dTJonjouod UOTeUIT}SS oUN JoINSse 
Inod (uIajUI) aI19USSOWOY ouUN JURLOdUIOD SajeNs Ud UONR] 
-ndod e] ap uoneoynens oun ,p Jaq[Nsai JUSANOs jnad sayess 
op souUdAOW Sap onsd9v UONeLURA 99390 anb ‘/ UOT|D—S FI & 
Janbseulal WJ SUOAR ,| SNOU SLID “19}e}SUOD ap JURSSaIIUL 
SO [J “QJUdWISNe sayeNs ap souUdXOW sop UONLIURA P| 
anb ainsaul & 91101998 ,S B[GUIAS ‘s[AUUONUSAUOD BdURIJUOD 
ap sal[eariajur sap jso tnb 90 Inod ‘ajjaai 1a sere[oap 
SINWSANOD ap sayyiqeqoid say aNUa wed 499 ‘sINaT]Ie 
Jeg “«d] [99 SINUIANOD ap syT[Iqeqold VY] ap ajUdIIJIP Soy 
ang Inod «agie[dap» sINUdANod ap ayiqeqoid vy :sinodwon 
san ang juaAned ‘([°g) 0AId a] Ins yUapUoJ as Inb xnao 
DIIP-L-1S9 9 ‘S[BUUONUDAUOD BOURIJUOD OP Sa|[PAIDJUI SO] 
‘suo][QUeYde sjed ap INog *g UONDs B| Op ¢€ 19 | XNvaTqr} 
So] Sqide.p dled zasse s[quias ailoyeg[e s[qelIeAod 
ap sed ajstxa.u [I,nbsio] ayuasgid as inb uonenis ey] 
‘gsodxo juasaid 
a] Suep sed juvinsly ou sivu ‘JUdWTOINALID]Ue QUUOT]UDU 
919 & [I SUWOD ‘UON[NUWIS Op s}e][NsaI sone xnoIquioU 
ap ins anb swigu ap ‘8 UOT}DaS PT B SIOSp UOR[NUIIS op 
s]e][NSaI Sa] Jo SaJUapsdaid suONdas sap sanbioay) suOTIeI 
-9PISUOD SI] INS JUDPUO] 9S SNOSsap-I9 SUOISN[IUOD sa] 


SNOISNTONOD °6 


eBeuuoj|ijuUeYyOS US SOURIUOD ap Sa||BAUAJUI Sa] INS preHas NEaANON :uOSsdwoOU] Je equepoy 961 


9= 6 19 €=§ ANUS aN | V VJLIJS DUN, P DUILA Q UOISSIIZ9I OP JUDIOIJJ9O9 J] ‘snossap-19 (81) uoNe[ndod vy] Inog 


(NDDDIN NN} :€ 


68°07 8°77 060 LE60 S60 WEVEGCY SCO) (81) 
DIDI ID Ia 
(7g) 10AId = ({]*L) JOAId (7g) JoAId (T][°L) IOAId oyeurwioUu suo]]NueYyse uonejndodiadns 
auudXOwW InansuoT] Q]JOOI DINUSANOD ap dIT[Iqeqgolg dINOANOD SOP IIe L Pl op uonnqmsiq uoneindog 
(IA) (A) (Al) (11) (1) () 
p nesqey 
008 = 6 19 DOI = 6 aMUA aIINe | B aIeIs oUN_p DULA Q DUUDAOUI INIILA kT ‘snossap-19 (L |) UONe[Ndod ev] Inog 
r60I 9L'2I 6880 £60 $60 (rereeret) {ANNININN} (LT) 
(1'°g)oatd §=(6'L) JoOAId (1°8) 0AId (6'Z) JOAId oyeuruoU suoT]NUueYoe uoneyndodiadns 
uusKOul INsNsuoT] J] [991 JINUDANOD ap d}I[IGeqold dINIIANOD Sop [IV L, el op uoNnqmisiq  uoneindog 
(1A) (A) (AL) (Ht) (1) (1) 
¢ nes[qeL 


$=09197= 6 oNUI ANNe | E DIVNS OUN,P SULA Q UOISSAIS9I IP JUSIOIJI09 9] “(S[) - (E[) suoNe{ndod sane 
So] INO_g “€ = Q ‘SVMS say $9jno} Inod OXI 91S91 Q UOISSIIB91 IP JUAIOIJJ90O 9] ‘snossap-19 (Z]) & (6) SegjoJgWUINU suONe{ndod sa] Inog 


89°97 LEAL 606°0 6560 S60 Cr EO ADV O ORT Stoo Do) (91) 
ve 6E 88°Cr 68°0 76'0 660 (Z'P'€'Z) WOOL OOo) (ST) 
IO‘ 68°SE r8‘0 698'0 06°0 (Zr ET) (ODDO, tO OO} (v1) 
‘00! ESELT L8‘0 9760 S60 (ZP'€'7) LOO at) OO (€1) 
73°9 LOL €8‘0 €8'0 06'0 (CPSC) SAN NUN NG to iol (Z1) 
689 ag 73‘0 83°0 06'0 (Wre'7)  {N'N'N'N} {n‘n‘n‘n} (1D) 
6b'r9 6r' CII 9L8'0 9760 S60 (GEE OC) ens LO Oa LON Ol (Ol) 
(aus ZL‘16 780 6L8°0 06'0 (ZP'E'Z) {9°99 Dla 4 0 Dine (6) 
(7g) ioatd ({TL) ward § (7g) ioatd (TIL) Joard oyeurWou Ax 
guudXOul 9] [991 aiINJJeANnod suo][HuUeYoE uonendodiadns 
Inansuoy DINJIDANOD Op Sy[IGeqolg sp sy[Iqeqolg SOP IIE L PR] op UOTINGISIG uoneindog 
(1A) (A) (Al) (111) (11) (1) 
ANS LAG 


00rb = 6 19 COOL = 6 ONuUa ‘ane | e aJeNs ouN.p 
dUeA Q DUUDAOW INIzRA PT ‘(g) B (CG) ‘suoNe[Ndod sane so] Inog ‘QQT/ 19 O'Z aNUA AURA 9dA}-11899 | 
‘OOI = 6 ‘anne | e Jes OUN,p OXI] a)SaI Q QUUDAOUI INI]RA LI ‘sSNOssap-1d (P) B ([) ap sagjoJguINU suONRNdod sa] Inog 


96'6 69'€T 180 806°0 06‘0 (Zr ET) {N‘O‘n‘N} (8) 
Os‘ TI 9L‘07 698'0 L6‘0 660 (CPE) {N‘O‘n‘N} (L) 
9r'91 IL‘@Z 9L‘0 9980 06'0 (GVO) {O'N‘O‘N} (9) 
79°61 vE'PE 73'0 9660 660 (TP'€'TZ) {O‘N‘O‘N} (S) 
cSe 06‘P LI8‘0 06'0 06'0 (C'p'€'7) {a‘n‘in‘n} (py) 
Se Sr LO08‘0 06'0 06°0 a) {N‘N‘'N‘N} (€) 
1S‘6 LT‘€] 08'0 06'0 06‘0 (CPE) {O'n‘o‘N} (Z) 
eC ll £86 98°0 L960 S60 ZED {O'n‘D‘N} (1) 
(1°8) 1oatd (6L)IOAId = (J"g) oatd = (6'L) JOAId « 

ouudAOUl d]]991 INDANOD S[PUTWIOU SINYOANOD = suo] MURYOS uone[ndodiadns 

Inansuoy op s1Iqeqolg Op d[Iqeqolg SOP OT[IeL Pe] op UOTINGINSIG uoneindog 

(1A) (A) (Al) (111) (1) (1) 
[ neayqel 
‘gjduis sd (1A) ‘(A) ‘(AT) sauuojod sap uonrieid 


“OUN JUROACUIOD Ud (81) 19 QALOJeOTe BTQuIIeAOD ap 


sed juryodwioo ou (7 [) uoneindod vy ‘aunovyo sayenys yIny 
Ud SO9SIAIP JUOS p Jd € XNvIIqGQuI Sap (81) 10 (L) suoneindod 
So] ‘snssap-19 (Q[) — ({) suonejndod xne juswaenUoD 


S61 


-I9\UI J ‘UoWIaATDEdSal (Z ‘p ‘€ ‘Z) 1UOS SayVI]S SaJUDIOIJIP 
Sop SUOT]HURYOS Sop s{[Ie) ve] toed Tyo ‘oyeuIOU ‘o1Ieo 
1yd ‘ayewou uoNendodiadns vy] ap suONNLSIp op “UOWI9A 
-y9adsoa1 ‘sagin yuos (9g) uonendod vj ap sayens onenb 


666| eiquiaoep ‘a}enbua,p senbiuyoo | 


SI] ‘UNS SWWOD Wel] as ‘ayduiaxa sed (9g) Inod ‘] neayqri 
np odd} g[eJUOZUOY oUSI] oUN ‘IsuUrY ‘sUONR[NUIIS QOD + 
Inod ‘aourijuod ap say[eAJayUI sap suUdKOU! INaNSUOy vy] 
}9 B[99J SINDANOD op ay[Iqeqod Vv] JUDSSTUINOJ (IA) 19 (A) 
SOUUO[OD SIT “[VUIWOU BINIIOANOD ap aytfIqeqoid ey] ouuOp 
(AI) 9UUOIOD BT ‘saje}s SaUdIEJJIP soy Inod uoynueyss | 
OP 9][F) RB] IWgp (III) PUUOJOD BT “xg JULI9 (x ap JUepuadgp) 
A ap suudkoul ev] ‘x ailoyeg[e s[qeLIeAOd ek] ap anb uaiq 
Issne € ailojeg[e squueA ve] ap UONQINsIp ey anbiput aya 
‘auoos sed ‘7 nevayqei d] suep {¢ arloyegye o[quueA eT op UOT) 
-NqLysip ev] JUoWa,duits onbrput (11) suUO[Od BI ‘] NvITqQR} 9] 
SULP SWIUWIOD DITOJVYTR O[GeUAOD ap sed a)sIx9,u [I ,Nbs1o0T] 
‘(Q) suosIuN no (Ay) [eWIOU ‘(D) aed 1y9 adAj ap ane 
jnod uoNNgiysIp eT “sayeijs Say Sogn yUOS JUOp UOTe[Ndod 
-Iodns e] op suomnqimsip sat ‘(.) uonetndod ey] ap saiens 
anjenb say uojas ‘anbiput (11) auuojoo ey *(.) uone{ndod vy] 
op ogUINU 9] onbrpuT (1) BUUOTOD BT “(IA)” ‘(I1) “(1) saUUOTOD 
XIS undeY JUsOdWIOD Z 39 | xneaqr} sa] ‘sayes aenb ua 
d9SIAIP }S9 SuONLINdod azias sap suNdeYO ‘QUUOTJUDW 939 B 
[I SUIWIOD “O00 Z ap aI[Ie} ouN suNoeyo judOdWIOD (g) ‘(Z) 
suone[ndod sa] ‘QQ0 | ep aie] sun sunoeyo juazIodwi09 
‘(g) ‘(L) suone[ndod sa] inod ayrey uondaoxa ‘snossap-!9 Z 19 
| xnearqei sap (91) — (1) saaasrasqo suonendod azies sx] 
‘JUOWIapuUdI Np jsa Inb 90 nod aiyreredsip ev puay 
‘SJQUUONUDAUOD Say] 19 XNBIANOU Say ‘s}OAId xNap sa] a1jUa 
UONOUNSIp eI ‘OpULIS Sd] a]][Ie] op SUOT|HUPYDE sap Inod ‘Ins 
UdIG ‘PIe} NO IO], “S[OUUONUSAUOD sjOAId sa] aonb JUsWIAapUaI 
Ino[[fou UN JOUUOP JUs[qUUas s}OAId xNnedANOU Sz] ‘spueIs 
Issne SUOT[HUYdE sap Inod sUIgPT “UOIIAUD QS IP 9[eI0} 
UOT[HULYD ,p [Ie] oUN Dav ‘aUNIeYO Saje}S Q[ Ud S99STAIP 
suoneindod sap justeucidwiod saasnjjIp UOU UOT}e[NUIIS op 
sopnid SON ‘p19 € XNvIIqQe} Sa] SUP DUULIOD ‘(¢Z) BUUdAOU 
Q][!e} Op suoT[MURYDE sap Inod s]qQeIeA a}sa1 S[BUUOTUDAUOD 
SIOAIC xnv JUSWdALIAI SJOAId xnvaAnou sap ayOLadns vy] 
‘JQUUOTJUSW Ip SUOUDA SnouU onb ay[Ie} ayNed ap suoT[MUeYDE 
soj Inod onb aiputow gisap un Y ‘sfeuUONUsAUOD sjoAld xne 
JUSWISANLIAI sjoard xnesanou sap inatadns juowepual 2] 
‘uoatns Inb Z 39 | Xnea[qe} Sa] SUBP SUTLUOD “INJOSSOI XNITUL 
3] UOJ [[ onb gs] qQIej Issne (a[e}01) aII[Ie] op suOT[NHULYdE 
S91 9q “saatjoadsal sayeNs sop sain jueie Z ‘p ‘€ ‘Z OTe} 
op suOoT[MURYIE sap ‘sayeys oeNb Ud JgSTAIP Iso OUNILYD 
jUuOp saaalosqo suonrindod g] 101 suoae snoN ‘suOoTIy 
-uvyse sjijod ap & ynoyns jud}J0dde1 as snossap-19 sjLIOap 
$]e][NSII S9] ‘SIOJaINO, “S[AUUOTUSAUOD 39 XNBaANOU $}OAId 
SI] INS S9PUOJ DOULIJUOD Op SaT[PAJOJUI Sa] Joredu0d op ue 
SOQUSUI 939 JUO sogssnod UONPINUIIS ap sooudLadxe saq 
"S[QUUONUSAUOD $}OAId 
SOP SUIUIOD (Z'8) 39 (18) Op 30 SJOAId xNeaANOU Sap SUTWOD 
(TPL) 39 (6°) 9p suopsed snou ‘ferguas ug (LL61 ueIYy90D) 


"e351 f is c {=f 

; NA 2 Ws tcl Va 
(x-'x)= (coh —-—|— ¢ 
| eget od pat ae 


1s JnewIxoidde 
(1 ‘O)N oad Z| ‘ostoyeg[e s[qeIwAOD 9UN.p adUasaid uD 


(1'8) CK 


jneurxoidde ({ ‘Q)AV 10AId np ‘arojegye 
J[qeueAod oun.p souesqe,| Ud ‘snud}qo jUOS 19-xndd 
‘S[QUUONUDAUOD DOURTJUOD AP Sa|[PAIJOJUI sap Be sazedu09 
JUOS SNSSAP-1D DOURIJUOD dp SoT][BAIOJUI say “UdAINS Inb 
So[duiaxd say suRC] “dIIO]ITe I[QUIILAOD oUN Pp sed d] SUP 
(TTL) Joatd 3] ANS sapuoj DdULIJUOD Op SaT[VAIO\UI Sap kB 
19 ‘allOJVgTe a[qvleVAod ap sed a}s1x9,U [I Nbso] ‘(6'Z) JoAId 
3] INS SAPUOJ DOURIJUOD Op SaT[BAIOIUI Sap & [VIQUIS SINODII 
a] suosodoid snou ‘snssap-1d sajLiogp suOsIel Soy INog 
‘ye 7 = (“9 saquarayyip souuaXour sinayea sap juewoduios 
‘f, SALS IP UONONSUOD LY DUTeIUD SNPIAIPUI SJUDIETJIp 1nod 
Q souUdKOU sIna[eA sap sfqe{eaid UONeNyeAs oun ‘UONe] 
-ndod sun aynens uo, anbsioy ‘anb yuowanbidA} date 
[I ‘npuajus UdTg “aryNe | B aes oUN Pp ‘Q ap «sjIVd9 s]Nad» 
OP & OWIQUI JIQISUAS SdJ} SO (P UOTJOVS BT Op [,{(A }/3] 
S]OAId soy Ins juapuoy as nb xnoo ‘ajduroxa sed) 9 ap 
UNUIUUOD INJTBA OUN,p asauodAy | op UOTJOUOJ Ud sgTNoTeO 
DOURIJUOD Op SI][VAIOJUI Sap JUoWapUdI a] onb JUSWOIIe[S 
juonbipur sanbizguinu oanb uarq issne sanbiogy) suones 
-9PISUOD SAC ‘f337 SNPIAIPUI Soy sno} Inod «auNWUWIOS» 
Ingea oun e& g sawed a ‘uoNsanb ua agArasqo 
uoneindod ey] inod ‘ts opnyysad oaAe JIOAeS SUOANOd 3U 
snou ‘onbiyeid ve] suep ‘uawa[e1gUay “ane | B aes ouN.p 
JOUA JURUDIUTeW Jnad g ‘Wp juauTanny “y‘" ‘t= F432 
‘9 = ('x'9- O32 no 9 = (Q-'42 a[apour 9] Jed goeydurar 
SO ‘4,31 SNPIAIPUI Soy sno} Inod g 9p «aUNUIWOS» INa[VA 
gun sane ‘¢ = (‘x9 '€)2 no Q = (9- ‘4)3 uonendodiadns 
ap sJapour aj enbsio] souelJUOS ap saT[eAJO}UL,p UOONUSUOD 
eB] WOgp suoAe snou ‘ajUapgogid UONDes PRI VY 


SANOIMIdWNaA SALAIYdOUd = °8 


é : ‘ c 

(VL) (LON ~ {4} /8 
juowianbynoyduAse 

: [.,{(8)A }/38] op UONNQMISIP | OP UOTSIDAUL | INS JUBPUOJ 

as 4 Inod souRlyUOd op SaT[eAIOIUI So] ‘sIOJ ouN s100Uq 


(OIL) 


Ip TN ! Es 1 
(a Newt) See leis te Arik 


eBeuuojliJUeYOS UB SOURIJUOD Ap SaljeAUajU! Sa] INS pseHos NE@ANON :uoSdwWOU] Je equepody rv6L 


{ 
189 X/X op astwianua,| sed yuowonbiun x ap uonsuoj 
aun sinowiap inb sanbijduioo surow au0J aun ‘stojayno L 


“A t=f 
7" "y (NIN) Ge 
[x'uy fx IN] K / slur XIN] 


UNICA YON iM = 'V 
no 


SIO] Sap ‘(L°L) ed saguuop 
; A suoneuinse say sade .p (pL) ua (8) 4 JOULLIvA P| Op UOTeUL 
-Ijsd,| oustIsap (3)°, IS “([[p) ue 3 UONRUINSA,p UOTOUOJ 
aun Inod ‘asoyeg[e I[QelIVAOS 9UN Pp Sed 9] SULP ‘SUIQUI 9q 
. . ‘ I 
(6) (ron ~ ,{8)'} /8 
juouronbnoidurcse ‘[,,{(3)'4 }/3] 
jJneunxoidde joatd np uonnqmsip ke] op UOISIOAUI,| 
B OBIS SNUD}GO JUOS J INOd ddULIJUOD Op SaT[BAIOIUT SIT 


‘531 
(8°L) dla + £-'0-'h 
ne di 
ee eontahte ge tha lie Nagle! 
cla gh ee nee 
7 


SUOAR SNOU (9AqI] Op 
S9189p ° ‘u ap SUIOW dJIOdUIOD SaLIVD Sap SUIWIOS P| ‘AUII}SO 
1s9 i onbsind ‘oanb j1ej np aiduioo jueua) us seu) (Sp) 
dav aIso[eur Jed ‘s1o] sep ‘(¢°) ed quuop y“" ‘p= fA 
ap ry SUONLUINSS Sol Ins sapuoy (8)4 op UuONeUNSO,| 
iso (8)'4 18 ‘snd oq ‘(p'y) sed aauuop ysa (3), douRLIeA 
eI ‘(€"p) Ud 3 UONRUINSa,p UONDUO] eI ap ysa Inb 99 Inog 
"'y Coos 6 = [ 


Jed saguuop juos (9*/) ua sagstundo a op 
a (SUOTILUII}SA) SINI[VA Sa] aNb JIIJLIDA Op B[1OeJ 189 |] “(S661 
aquiepoy) sjueywodwi onbnsneys aouenbesuos ounone 
dJodwi0d au 3d ynoVINs gyOI[duIs ap tonos sed agidope 
JS9 OILIO9p Op suoUdsA snouU aonb {Ieaey op ssaujodAy,| 
‘UOT]DES aJUISEId LI Op INgep Ne sUUONUDL 9}9 B [I DUIWIOD 
‘Gal 'x aMloweg[e s]qQLVIIeAOD BI ap INgTRA BI B [QUUOIOdoId 


€6l 


1 


so 9 ‘Up juowmenNYy “G3! 8% gah a (x'9 - 103 
gouelivA op suonouoy soy ‘Q= (x9 - a jueyod 
-u09 uonendodiadns ap ren a] Inod onb [eae ap 
asayiodAy aurt09 suojdope snou (9°/) ud sh JURTNWIOJ UY 
‘QSULISL'T ap Ina eo|dyNu sy JUeAvIedNe SWIOD JURIa Y 


(ae fee Sp 


y "sar =f 
‘crime meen = nh 
A 7 


Jed ([°1) ua o 
uonouoy ve] suode[duros snou ‘apurss ysa y “" ‘, = FN = || 
saiens sop ples ry onb jueaviedne surwios juesoddns 
ud}0 “31 ‘f0= ee ely = « ba uone;ndodiadns ep SQOUELIA 
sot snjd op quejou ug “y‘ ‘p= f“G37‘g = ('x'9 -'4)3 
astogid juaov[-snos uonerndodiadns ap ajapowi a] anb 13}0u 
V ‘axl 4 uonendod ev] asp suusAow oun inod ‘y‘‘, =f 
at A sayens ap souusXour so] oJIp-e-1sa,9 ‘syuvasuvlap 
sanouiesed say Jase SUOASp snoU ‘JURARIedNe sUIWIOD 

“SONUUOD 
yuatos ‘yt pal ='y somoyaye sarqeueaca Sap soyens 
ap souuskou saj aonb sasoddns e ‘y‘ ‘, = f="4 squras 
-uelop Sonoweied sop steullosep juawoduios { Bos } 
Juewrxoidde joatd np uoNnqiisip e] JURSIOAUI Ud SNUd}qGo 
(X/A) Anod sjaniiqey soueIJUOD dp SdT[BAIAIUL SO] ‘SIOJIINO TL, 


fsaa Gy 


{Or- 4-4-6) <c 


G 


(9'L) 


pe 
= 
In| 


(SL) 
if 

I-'N 
'N 


f 
‘nN fw 
I I 


aN lf 
7 KOM 
ZN a 


Jed aguuop 389 (p'/) Ud (8)A DOUBLIVA PI ap 
‘(8)A dIIP-e-3S9 9 ‘aatidoidde uolewnssa J °9309 op Sassi] 
ang snjd quaanad ou ‘x y/q =" souuay So, ee 
“¢31'9 = (‘x'g—'4)3 afdnos snd ajapou neaanou 
np sousseid uq ‘9 «UNWUIOS» anowresed un juryodu0s 
‘31 SMPIAIPUr say sno} nod Q = (‘xg - '€)3 uonefndod 
-Iodns op ajapoul 2] 19 “AV Sales sa] nod ayjIe1 spueis 
oun juesoddns ua “x X/ =X SOUL} Se] 9190 op Juessie US 
(ZI'p) Ue (3)4 UoNeUIsa | NUsIgo SUOAR SNON 2 saves 
ap souuaour say juvarredne aumtu09 juvUusIsop y “* *T = d xX 

f 


“ot | 
cn {ys ety to] EM 
li If 
"N ay zN I=! 
Geek elas aa 


(Tp) ua 3 uoNeUIsd pp UONDUOJ RP] ap (8)A DOURLIeA 
Ry suep teers quos “{ Saqe.ns ap sauuaXour sgj ‘(p) US 
auUIULOD Betty ae fe ‘f ayedys P| JUvALIEdNe OWILUOD JURUSISEp 
tC “£31 ‘= (‘x'g—'€)3 yueuajureur onb OIP-B-}S9 J 
‘oune | & aes ouN.p JoweA assind 9g anourered a] aonb 
}9 aJsI[eVai Ja atdnos snjd sjapowi un Jed gor[dwias ag SAIOp 


666| aiquecep ‘ajanbua,p sanbiuyos | 


a[gpour 99 onb suosoddng ‘9g unumu0s aneuiesed un daAv 
‘31 SNpIAIpUT sgt snoy nod ‘Q = (‘x g — '€)3 yey ‘sjOU sUOAR | 
SNOU SWIWOD ‘(| |p) Ud F UOTRUINSA Pp UOTOUOJ PB] pud}-snos 
mnb uone[ndodiadns ap ajapou a] “a}Uv}sUOD UOU X aTLOJegTe 
3[qeLIeAOD oun ajsrxe [I,nbss0] {4 sayens ap souusXou sop 
UONPUINSA | JUDWIA[eS9 19SINs snssap-19 UOISSNdsIp eT 

; ‘ueyd np iso 
nb 99 nod steiq surs jsa ( « - Ys ss ice 2) UOTVUITSS ,p 
uonouoj ey onb ‘(¢"Z) & JWAWOANRIOI ‘19}0U Y ‘9Aneul 
-1xoidde uodej ap uowgines stew ‘sarjauuonsodoid quou! 
-910eX9 sed JUOS OU SUOT[NULYDE Sap JIIe] BI 19 SayeS sap 
[Te] eT onbsJOy ILAJas JUDUIETeS9 Jnod UONPIaI aJduuIs aN9D 


(eD) me =" 


a 


: JUSSINPSI 9S (ZL) 
suonenbs soy ‘y * =f (N14) = = Cn! u) onb o1ip-e- 189,9 
heen ne ‘u suoyjnueyse 20 gqqiea ey 10 ‘Wy 
SOVINS SOP oT]Ie} eT onbs soy ‘anb sajou Y “y “ST = L‘f ayens 
R] Op SUOT[NULYDE sap oT]Te) BT JUeABIedne oUTUIOD JURIE ‘u 


1=f 
[n/N] X 
4 C 
eat pion i 70 ety OS 
: Le, (n‘u)/'N : 


(ZL) 


qSoe 


no yi op 
iZ uONeWINSa] Inod gstutuTW 3so ([°L) onb JdIJUVA ap oIOeJ 
1S9 [J ‘Snssap-lo gFuUONUeU UONe[Ndodiadns ap afepoul np 
JUSUTWUepUddapuUT a]URARINIE JUDWIDAINIUL ISO UOTLUINSA ,p 
anbiuyoa} ayeD ‘asueisey op Inoyeorjdnjnw a] sd Y No 


Nef tad ‘sar =f 
(TL) e [ai Jedi -'«) KE 
AN 4 x 
UONOUO| 
Re] op aonb yutod un suoanoy) snou ‘y‘“ ‘=f 4 op 
sone HER Sap Inog ‘3! Se] SNO} Inod cae $ajUR}SUOD JOS 
“WO= me 9 - '4)3 dIIp-e-1S9,9 ‘aJQpou ap sooueLIeA so] onb 
[reavni op asaujoddy sourwood suojdepe snoy ‘asuvise’] op 
Inajyeo[dyynu np ajanziqey onbruyos) el op apie | e Noses 
9s ‘OXIJ aIso1 X uoneindod ve sp suuskouw ev] anb dasasol 
nos ty ‘y= £7 ep uoneUlss,| ap sweqoid oT 
a ‘yor T = £7 ap amimsuos isa 
(9 19 J 189 (A) NO “Z UONDaS I B a1TGRI9 919 B IND aI]99 
1so oinpgooid ey] ‘(p'p) ua € ap souRLIeA P| op UONPUINSA | 
op In[I0 ap “UoWoNbiyeWEYIeW onb UIQ Issne JUSWET[INI 
-da0u0d ‘JUdISJJIP WJ B INO} 3Sd UONeUINSS,p oUg[qoid 
90 onb Jajou Y ‘axXlJ A JueUdJUTeW Ud ‘y¥‘ ‘| = fy 
NO syuRdSuRIEp Saneurered say JOUINSE B SUOYSIDYO snou 12 


C 
Sol vy N I=f 
[ 1 
solace ae SS 
("A eK I INT 
anb suojou snou‘¢ = (‘6 ~ '€)3 npusig ajapour 
Np oped oJ suep (8), UOeWISO oUN JIUA]}GO.p UY 
“uoTeNIS 21199 


juatuasnf ajQ[Ja1 UONSES B90 apanNay “yo ‘P= LA - wl 


SOOUDIIJJIP SO] IISIVIS & PUD) «dUIO]UI» gIQUasOWOY UN 
ayes onbeys & JoUUOp & UOdSe} op UONRINdod x] Ja1yHeINS 
op wey of onb or suojoN “y¥“" ‘[T =f ‘9109 op sessIey 
ang snjd quaaned ou x -'x sauna soy “9 sed [y, orens PI 
suep Q Op JUdWIDOR[dUIAI 9] NA *9199 ap dassie| ane Wweanod 
yor alts Zz no 9-4 soUdIOJJIp vy] (SoyeNs sopuess 
ap inod) anb asgyjodcy,] ins justepuoy as (9p) ue (3)4 
Quonbgsqns uoneuiysd,| Jo oinatigiue uoneutxordde ey 
‘(p'p) ua x uonendod ve] ap suuaAow ey sed X es P| 
ap suudXou! vy JUeSe[dural US 8 ap soURLIRA BI ap ) zayooudde 
snjd ynod ou uo ‘stosamnoy, ‘9 = (43-‘0)(N/N) © a! 
onb soled) = ajquieA —BIO}SOI aujeundo a | (C661 
aquiepoy) one | & oe OUN,P JOLIeA ined '€ 3 JueUd}UTeU 
onb omp-e-sa,9 yo ‘pal gar’ 0=C 9- '4)3 npusis 
gjepour 9] ied govjduies ys9 32‘Q = (9 - '4)3 uoNeindod 
-Iodns ap afapour a] anbsioy aurguI a]quieA oSo1 (Ep) UD 


WN 
ae 


x 


S31 


es £6 


UOTJEUINSS Pp UONDUOJ e] ap aytyeuNdo | 
anb Jo}0u ap jURSSaIDIUI ISO [I | ='xX NO Sed 9] sue 
‘(S661 BQuIepoH) uoNendodiodns ev] ap asoueleAa 
ey Jed ogouontjur sed ysou ASST =1 “(x9 -'4)3 ap 
auyeundo | “ygigjur .p nb atury uonejndod ve] op anowieied 
gI 3s9,9 onbsing ‘n‘‘[=1‘Q = (‘x9-'4)3 uonendod 
-Iodns ap UONIpUOd ke] Op JUSWIaTTaNUASSa puadep (¢°S) 10 
(LI'v) ‘(¢'p) ua 3 UONeUITSA Pp sUOTOUOJ sap ayTTeuNdo J 


SHINGAYHAAIG SANNHAOW V SHLVULS °L 


‘yuauiaanioodsar ?y 
yo °4 sed ‘x yo '€ yuedeiduros us ‘ayuepuodsai09 uodsey ap 
4a «a» addei3 oun Jed «!» nprarput,] (p'9) Us JURdSe[dutal US 
(¢°¢) ue GN eoneays B] Op UONeWINSE | 1USIIGO UO ‘OUIQUI 
9d ‘N “| =2‘, =x onbsioy (p'9) op yetoads seo ap ann 
@ (9p) ua (8)” A S0URLIvA &| Op UOTUINIS | JUATIGO UO 

(ZI'p) us 


i C 

; i ; Suet 7 ND =[ 
(9) (8nA= [x4 «| ae v= (43)%A 
, oe Nc A < I Tye 


(79) ud Up uswWoNNY 


78+ y= (18) "q 
yh aktu spurs op Os 
‘(€°9) ua uonbgsuoo reg “YP =f “( iat ‘x (x/4) = 
‘(9 +g) 4Anod snssap-1o oe ] suep ‘nv ‘” ‘Tel 
Q=('x@-')3 weysnes ib uonrfndodiadns oun,p 
soem quos '€ sosoyegye a soy aonb asayjodAy | nA 


‘snssap-1d Sayles sop ied ev ‘suoae SNON 


eBeuuo||jUeyoS US BoURIJUCD Bp Saj|/eB/AUA}U! S98] INS pyeHas NES@ANON :uosdwoy] Je equiepory Z6L 


oN 4 
faens f ayens 
= 1=4 


en er 
aah (el 
ie J gipae 
x— =9 
IN S 
ly = 
N lt! 
(s% Jeu nle — ie 
4 A - ENvwst 
fENS , 
l=) 
xX : bszb a zN L=f 
Dap: Xn wane — — =g 
| A A 8 Ty 
f x le i uN K 
x =—- = SS = 
Z A IN y 
C 
OS ie } ting Mg Neel 
sree PCL racy aan iN 
no 
(€°9) Q+a+Vv=(9)9 
‘(7'9) ug 
(79) zo 7 8) d=\Cs) a) (3) a= CsA 
WW 


‘S- (78) ip 
SUOAP SNOU ‘uoUaAToodsal 
QOUBLIBA BP] 19 dp41jsjoog souviedsa | or i) a 9}]0U UO | I§ 


(1°9) 


Jed aguuop jsa 3 
UOTBUIT]S,P UONOUOJ ve] ep anbiigues dosjsoog 43 imajea 
aun ‘onbiigues a3ei un ajuasaidal Bb 1g “yo ‘| = fess 
(‘x op inued ve asturar ane asteal sa soSein op uv 
SIQUIOU UN :}INS SWILUOD Pe} 9s SIJHe.S BdVUUOT[HULYOIEI JT 
Taf 8951 (Cx 74) ap Sd99nj}SUOD JUOS SagUUOP SOU JURARI 
-edne sumw0g ‘axl ( ¥/ XA) aewesed np inayea ey] yuepIes 
ud ‘([[‘p) ua 8 uoNeUINSS,p UONOUOJ ev] ap dpusjo0q 
souvLIvA eB] SUOUd}GO snou onb suds 99 Ud aTfaniTqey 
IPOYIOW! LI IP DUSIEJJIP Iso dp4jsjoog apoyyeW ION 
“xneroads seo ap ol] B (¢°S) 19 
(Sp) SUONRUINSA sa] ITUd}QO WeLINOd UO ‘]IRJep Ud (Z|) OP 
SBD 9] SULP BPOYIOW! L] SUONSNIII SNON “(C°S) 19 (ZIP) “(S') 
Ud SaguUOP (8)4 DOURLIA P] Op SUOTJRUITI]SO Sap dp4IsJoog 
SUOISISA S23] UONIS ajuasad ev] suLp suOJUEsgId snoN 


dVYLSLOOd AGOHLAWN 
VTaVd DONVIYVA VT Ad NOILVWILSA °9 


L614 


(9661) O8Y 19 SuNZ sueP 19 (766) URWIOI AA 
Ja uOssuaMS ‘[epuIRS sup sjudde1 snjd sajdwioxa sap 


dANON] UO] aNb sipuri ‘QEG] SoQuUv So] SURP SIqoURTeYR|y 
op sasodiodns suojjmueyos xne sagoenel ang jUudAned 
SO[VIIUL SIOUDIIJOI SOP ‘SIQIUIIP 31190 ap ples9,[ V “(9'S) 
ud X Op soULLIeA F] Op a][QUUONIPeN UONeUMSsO,| Jed Issne 
se8vued qso a391Idosd 9y19 ‘sadde1Z ap souuskow! no xnv10} 
Sap SUOT}BUISS soy Jed yuoWONbIuN UOT[HULYDE | Bp SoJ10} 
-eg[e sofqelivA sop puadap (¢°¢) ua (8)4 uonNeUInse’T 
‘giqeis snjd yresas 19 a1Uepuadaput UOde] ap saeng 
-ISIP SOIlOJegTe SOTqVUeA Ip DUIWOS RI WeJas (3)4 ‘(9°C) 
ua {{ op souRLeA eT ap uONeUINSA,]} B JUaWIAITeNUOD IRD 
(9'c) “ytd ap sourlea ek] op UoNeUTsa} / (4 -4) 
ap auepuodsa09 UOTNGLSIP 
vey onb juowoapider snjd oquny es sida jUdWIOTeIQUaS 
wespua) {(3)4} A738 ap uonnqmsip ey anb asayjoddy | Joour| 
suolinod snoy ‘angweied np soiqi] ane uonlulyeap sed 
JUIAIOP SAQIWIAP $9 { NO { III ,p anguesed 3] JUSWII] 
-[QNUASSd JUDIOGUWIOD RI-Sa]]99 “JUSWA[eI9UAH “sINayeUINsa 
SOP SIOURLIVA SAP S9[[VUUONUDAUOD SUONPUII}SS Sap (3 UOT} 
-BUII]SS Pp UONDUOJ BI ap (3)A SooURLIvA Sap) (S°S) 19 (ZIP) 
‘(¢'p) ud (8)A suONeUINSS so] JansUuNsIp op sWoduI [J 
“JULDYDE Sed a] ‘SargTIUS saguUOPp Say INS JUaPUO] 
as nb xnao anb saovolyya Issne ojQ JUaTeINeS OU ‘saTqrieA 
aonb usdiq ‘aouRvlyuod op say[eAlaqu sag ‘ys ‘T= 's39 
inod sajqruodstp qustos °x ap 2x4 suoneumnsea so] oddess3 
PR] op neaalu ne nb uoIpuood e] e ‘addei3 anne | no oun, | 
JInod asepuos ap uvyd np aourssteuuod sunone JUdsIX9,U 
snssap-19 uoT}sanb js9 [I JUOP DOULTJUOD Ap SdT[VAIOIUI SIT 
‘(1 ‘O)N 189 UONNQMsIp e] JUoWONbY 
-oiduicse < {(8)A}A/8 yneurxoidde oard np o8euuo]n 
-UeYd9,P UONNGINSIP vl JURSIDAUT UD JURALIEdNe SWCD 
A n0 ( X/ Z) Anod souelyuod ap sayfeAsaqul Say 11u9}qQo ynod uo 


eoesgey at eb aN 
(¢°S) : soit are NY 
S ani S & 'N cC I 


Jed s9uuop 
}S9 (pS) Ud (8)A DOULA LI Op JJoINJeU UONeWINSS su) 


X "59 Ju ! 
(pS) Roeder <C I= (38)A 
(e x 


SUOAR SNOU BpuLIS ZaSse 
1sa ‘AY saves say $aINo} ap aTIIe1 eT QUOP Tg (‘axouUR J J10 A) 


ee ef -N 
rg ele (8)A 
7 


gra ay cts 
F jo. es 2 ae S 
yeyjsnes (¢°¢) Ua 3 ap doueLIeA Be] aonb ‘ayduis 


ZOSSE DIQQs]e oUN.p apie] & “IaNUOW ap siqissod jsa [J 


(€'S) 


6661 siquiaoep ‘ajenbue,p sanbiuyos | 


(I'S) 
sqidv .p suoae snou ‘4 inod oddeis ey] ap [e101 9] “x op aluep 
-uodsal109 uoNRUWNsa | aJUasaidal 24 Is ‘g[eO BBepuOs ap 
uvyd ap a1ua8 90 Inog “x inod addeis ey ap [e10) 9] Sa °X NO 


‘Q][NU UOU 98eI} op sut[Iqeqoid oun yueyodwiod , s UOTIN 
-uvyoe onbeypo inod yp juawiane ‘g[eo Isa asepuos op ueyd 
3] ‘2 oddeis onbeyo inod ‘anb jueuajureur suosoddns snoy 


(Z's) pate 
A 


SULIOJ BI SNOS ("S) ap 99IN Se CX/°Z) 
ep no °¢ ap uoneumsa,| Inod (¢66] Squiepoy) ateundo 


UONUINSS, Pp UONDUOJ BI ‘JUdWIdANOEdSeI x ap jo A ap 
saddeis sap sauusXour say Juajuasgidar $6 13": A ts ‘snd aq 


ay} 9831 'o59 iy, t=! 
: wees 
(1's) 1 [#]-' COCO «( 


Jed ({ | 7) ua 3 yuedse;dusai ua aguuop jsa 
‘snssap-19 guUONUSU UOne[Ndodadns ap sfapoul ne JUdUIDA 
-nejol ‘“(x/A) no X Anod g[ewunjdo uonewnsa.p uonouoj 
RB] ‘JUaWIaANOedsel y 19 { SasloU qos x 39 A ap UONR] 
-ndod ve] ap souuaXour say 1s “CN /'U) ‘t so 1 ap o[jouuon 
-IPUOSUI UOISNTOUT.p siIqeqoid ey ‘gs oddeiz ey ouop 
I§ “/2 1S9 UOT[MURYDE,| SUP 257 NPIAIPUI UN,P UOISNIOUT,p 
ayyiqeqgo.d ey (se11 oddeizd ey] stoj oun) anb {a} sd 9 addeis 
ve] Inod osepuos op urjd 9] anb jueuajureu suosoddng 
‘uone[ndod vy ap 7 
SNPIAIPUI Se] sno} Inod Q = (‘xg - '4)3 189 UONe{Ndodsedns 
op Wepow sg ‘sloJ sun s1OOUq “URAvIedne nb uoNe}OU 
OWIQUI BI SUOSITN snou UsWANNY “y‘" ‘] = eS eal 
yo U= |'s| dane ‘'s 910U so ‘g; aes e] op ait) saddvis 
op s[quissud | 39 ‘, 8 g]0U 3Sd 9 addeiB ev] Op sNpIAIpUl.p 
uoy[gueyos uQ “xy ‘ST =f ‘saddeis ‘NT ap seniysuos 
1S9 ‘of, HENS v] {9 soddeis sap yuvuajurew yuos y “T= ote 
sayelys op sjuoUg[a say ‘9 og}0U Jsa «oddeis» sup 
«NPIAIPUl» UN ajuasaidas 7 uRARIedNe SUILOD ‘a]UEpgd9eI1d 
UOI}L}OU L] SP JJUVAINS UOISUd}X9,| SUOSTTNN snou ‘[IeArd 
op sped sjOU B SsNssap-Id UOTeMIS Pv] JOIZ9}UI INog 
‘9139p Jotwoid np 
UONDIIPS B] Ip SIO] Sonudjai 939 JUO Inb saddeis3 sane sop 
sed puadep ou ja «addi» ey & «lalpnonsed» so adepuos ap 
uejd a- ‘saisap sinatsnyd e «a8epuos op urd» un.p apie] & 
JUSUZ{QISSod ‘(saWI[N) SNPIAIPUL,p UOTTHURYSE UN oNUd}OI 
oddeiz anbeyo ap ain uo ‘ayinsug “a[duuis aioyegye oseuUo] 
-[nueyoe sed soddei3 ap oiquiou yyed un a}e.4s onbeyo op 
oI) UO ‘asvuUO][HURYDE ,p aidep Jord ny ‘sayuRYONeADYO 
uOU SNpIAIpuUl.p saddei3 ud dasIAIp 3S9 aJe.NS onbeyo ‘snjd 


op ‘JUBUDUILU IC) ‘SaJUBYONRADYO UOU sayeNs US JURAPIEdNe 
QWIWIOD I9SIAIP 1S9 (S9IUN) SNPIAIpUl.p sJgNUS UONe[Ndod 
ve] aonb suosoddns snou ‘uonoas ajuasgid ey sueq 


CIRIRA SARS 
SdddVU9 NA FOVNNOTIINVHOU °S 


“(1 ‘O)N 189 uONNQsIp ey JuoUIaNbIO}dwWAse 
‘y{(3)A}/8 Gneutxoidde) yoard np aseuuojpnueysg .p 
UONNQMISIP BP] JURSIOAUI Ud X INOd doURIJUOD Op SoT[BAIOIUI 
$3] Jtus1go Ined uO ‘UONeUINSS,p SUOTIOUOJ sap dtIO9) 
Rl Saude .p ‘stoj oun aloouq) =A“ ST = 7 JuRISUOD= me IS 
(9p) ua amnpor assir] as (Zp) anb saiou y (x (XA) - A 
SQOUDIIJIP Set 9109 op Jassie] ined au uo sjenbsa| 
Inod sa[apow sap UOIssNosIp ouN / UOT}OVS PI B PIDANO] UC) 


rp) -(yX 4) eae 
a SG 


; 
N 


zN =f 

IN 7 
=(3)A 

([ [‘p) Ud 8 SOURLIRA PB] Op JURAINS INd}eUINSd | QUUOP eIaD 


i f 
Nu 
I I 


SOOUDIOJJIP SIT 9109 op 
assiv] UO,| anb ja ‘apuess jso j N Savens sap ajrei ey anbsi0] 
(f 
XQeex 


ae 

guuaid uo, aonb a1a33ns ‘Ay ‘, = 7 ‘Q = (xQ-'4)3 
uonendodiadns ap sjapour oy ‘stoy oun o100Uq * Xx Inod 
(gyeundo Juoweaeurxoidde no) sfewndo uonewnsa,| 
WUINOJ Q = 8 uONenbs,| ap uoNNyos ze] ‘ueAvsedne suWI0D 


(IIb) 


Jed agov[ dural sioje 389 (¢"p) ua 3 afeundo 
uoneUNss,p uoNouOy eT ‘9 = (‘x9 - A) ark ap uoNN{os ey] 
xX /A ep uoneunsa,| inog ‘WuoWIaATDedsal ‘Ss UOT[MURYDE | 
19 ‘f) aIeNS BP] SuRp x ap soUUdXOUI say yUOS “X 19 “XY NO 


T=f 
(OI't) niix'n {=x 
7 


JO 


(6') NI'x'N {=X 
¥ 


SUOSSIULJOP 


snou (Zp) 12 (Ip) ap sues af sueq NT =! 
=('xg-'4)3 kB Sioje puslg,s snssap-I9 UOISsNoSsIP eT 
puai-snos tnb 9 = (9 - '€)3 uonendodiadns ap sfapow! a] 
"Nov, =1 ‘nuuod 1s9 'x= x ‘7 NPIAIPUL,| INog ‘suolfduuts op 


ronos Jed € sud aleyeos sgsoddns Issne a]][9 ‘x loyegTR 


aBeuuoj|iJuUeyOS US BOURIJUOD Ap Sal/eAIajU! Sa] INS pyeHas NeEBANON :uosdwouU] Je equiepoy O6L 


J[QuIIeAOD 9UN sUOSSIUTJap snou ‘apna, Be A sILOJegTL 
g[qeuea ey ap snjd ua {A ‘y= 2:1} = & uonejndod xy nod 
‘anb suosoddng ‘aioyegye a[qeuieAod oun sinpour B UOdsey 
ap JasuoJOId JUDWIO]IOV] ASSIe] BS snssap-1o asATeuL TJ 
(L861 apAaH 19 OqUILPOD ‘8EsT SHTEAA) SiNOD snyd 
Sd] DOULIJUOD ap SaT[RAIOIUL Sa] JUQWIONDHO\dWAse UNO} 
{y(°A)/3} anbunauesed-muas s[apoul aj Inod ‘syinoo snd 
Sd] POURIJUOD ap SaT[VAIOJUI Soy JUDWANDNO duIAse UNO; 
{,,(99AJaSqO JOYS op UONPUOJUT)/UONRSLIg}OvIVD ap 
uoNdUOoj} PR] op UONNAIISIP PB] Op UOISIOAUT | onbINsWIEIed 
ajeapow un inod swu0d yno} ‘snjd aq ‘“UOTRSTIQ}ORIeO 
-isenb ap uonouoj ey e 8 ajewdo uoleWNss.p UONdUOJ 
e] aynuept efep suoae snoN “(T ‘O)N sed nod e amp 
-B-1S9,9 ‘sanbnusp! ane & 1USTeIpPUd} {4° A)/3} 9 ginuenb ey 
Inod uonejndodisadns op uonnqiyjsip ey 39 SaeuuolNUEYyD9, 0) 
UOTINGLISIP ve] “(spueIs jUsWOTqeuUOsIel y “ST = fA 19 
‘U Sop Inod sIoj aun a10oUua) aJens onbeyd ap ejduts amojyegye 
asvuuo][nueyss | Inod ‘anb yuawaypioey ayeisuod uC 


{s31 fu zN I=f s31 
d 1 0 
Sirs 1 es (= 78 C= BA =BA 
iN 7 
SUOAB SNOU 
(Gus = Cu Jed govydural ys (] - u) IS Jo ‘SOLULT 


S3JLIIS IP UOIIDALION PI 9309 Sp ASsIvJ UO IS “AY 39 “UW SpueIs 
ap nod ‘sio;y ‘(SsaIes Sa] $ojno} Op SdII} SNPIAIpUl,p) 
uoy[nueyoe | ajuosoida1 s jueaviedne owuwo0d no 


831 


se 4 =8 
QUIIOJ 


RI SNOs (Ep) UD F UOTLUWIT|SS Pp UONOUOJ BI SUOATIO SNOU 
‘s1HeNs o[duuts oo0yegie oseuuo][Hueyoe .p ueyd un inog 
{(A)/3} op onbnodwiAse 
(1‘O)N uonnqmustp ey Ins sapuoy ZX nod sodueIyUOD 
ap SO|[VAIOIUI sop s1gd3ns uoNeUINsa,p UONOUO] ev] Op 
d109U} B] ‘opurIs say sed yso.u y“" ‘T = f*u uoynueyos | 
ap aI[Ie1 ve] onbsioy ‘stojoynoy, {.,(°A)/3} op UuOTNGIsIp 
B] Op UOISIOAUT,| Sqide.p { Inod SfeubonuestG) ouRIJuod 
OP SO[VAIOJUI soy oUIeIUD eID °A o[[oUUONUSAUOD 
uoneWNse | & INped es (C*p) US A “Y SULA} O| 9199 OP OSSIe] 
uo Is ‘oUOp ‘suOT[WURYDE spuels op Inog Ae UIDO 1so 
Y SULId} SWaTXNap a] onb sipuey (u/1)O 389 2uLI3} Jomuoid 
3 (97) UoNenbs,| ap sIquIdUI puodas a] sueq “(Z'p) Ud 


(L'b) 


oumU0S y “* *] = f“s UOT[MURYDE,| op sUUdAOU PT ISO 1K no 
cole )» ('n La zN [=f 
(9p) Y+°A=¥+4, aa — <}- 
UN 
ot ON) we, 


€) kvm mes (3)A 


Jed aguuop ang nad (p"p) us ies A Q0uUeLIeA 
PR] Op UONeUINSa oUN “UdUDOR|dWIAI 90 & BDBID ("3109 op 


(Sp) ‘2A - 


x. 


681 


Sagssiv] og sed yusAned ou { = Tl SOOUIIOJJIP SO] sjanbsoy 
BIOANON 


Inod sajapoul sap wOrSngS oun £ uonoes BF] & 
uO) “(p'p) Ue yor ‘T= f ‘4 sed "x agoedural 30 ‘A= e 
SOOUDIDIJIP S2] 9109 ap Jassie] suOANOd snou ‘A saqets op 
sojte] sopues3 op inod onb a1a83ns ‘yn ST =7‘9 = (3 
OIIP-k-}S9 9 “(¢"p) Ud F UOTRUINSS Pp UONOUOJ PT pud}-snos 
inb uoneindodiedns ap ajapour a] ‘sjuvasuviep sanouresed 
sop WOS (pp) Ud "{ Soyes op SOUUDAOUL SI] 19 SPAIJOSQOUI 
'€ Sol ‘A 389 yQI9\UI.p eguesed aou onbsind ‘snjd oq 


{31 f 
Pe eee EN 
Ch - 4) € I 


Jed sguuop js (¢"p) Ud 8 sJeuNdo UONeUINSa .p 

uonouoy eT op urd go sed oynpul soueueA eT 
‘ued 9] ANs ‘WUdUIDIQNUS UOUIS “noLNs JUSpUoj 
9S SNOSSAP-19 SPUUOP BOURIJUOD ap SaT[VAIa}UI Sap saygudoid 
sg] ‘9 = (4)3 uonejndodiodns ap sjapour ne sty ios syyeU 
-1ndo ,p d19}119 9] anb uargq ‘ajgnbusa oun ,p 9}x9}U09 9] sued 
“O9JVWUINSS DOULLIVA BS Op Jd ‘ayeUIdo UOTeUITSA Pp UONIUOJ 
PR] OIIP-B-1S9 9 ‘UOTIBSTIQ}ORIE-IseNb ap UOTDUO] eI op ANed 
B QOURIJUOD AP SI[[BAIOIUI Sa] I1U9}qo nad uo ‘anbujsuresed 
-IWI9S d[QPOUI UN Pp SBd J] SULP ‘SUIQUI aC] “d9AJOSqO IOYSIy 
Op UONPWIOJUI | a[[oINJeU UOTFRWINSS UOS ap NO ‘(UOTIRS 
-1IQIOVIVO OP UONDUOJ LI OP DoURTIVA k] DUTWUOD SIUIJEp) 
JOYSLJ OP UONPULIOJUL | Op Ople | B IOULIJUOD Op SaT[eAIOUI 
Sap aiin.sysuod jnod uo ‘onbijewesed s[apouwl uN INO ‘(6861 
uosduroyy, 39 BquUIepOH {/86| SpAZH 19 SqUIepODH ‘CRé6I 
aquiepod) ‘uOTestIg}OvIeO-Isenb ap UOTOUOJ oun atjadde .s 
gyewndo uoneunss.p uonjouoj ve] ‘ouop ‘onbiyewesed 
-Tas sJapowl af sueq ‘anbinewesed sjepou un snod 
«UOTJESLIDIOVILI BP UONOUOJ» PR] 9dAe SajUeLOdUIT JUsWENb 
-siye}s saiatidoid sasnaiquiou op oseyed onbiyawiesed-tuies 

gjapow un Inod «ajeudo uoneuNssa,p uoNoUoOJ}» eT 
“DUISUSP Op SUOT}OUO]J Soy Jed sastogid 
sonbinowiesied jUsWIsJaNUa say@poul xne JUSWdIIeNUODS 
‘sanbinguresed-mues sajodde quos ‘ny ‘*‘, =1‘9 = ('4)3 
Jed Iuljap snssap-1d QUUONUSUL S[QPOU 9] SUILUOD ‘s}USUOU 
siorueid senbyenb say sed quowenbiun stuyep uonerndod 
-lIodns ap sajapoul so] ‘9 = 8 uonenbs | ap X usa uoNnNyos 
ey ‘€ red aguuop isa x ap sfeumndo uoneumsa,] isury *(¢"¢) 
ua guuop iso “8 no ((K)Q“%) °8 ouLI0J eT snos aquesgid 
a 33D “(S66I BQUIRLPODH ‘gg6| UOsdWOYL 19 squIepoy) 


b, 
Bboy 


eerie 


zN lef 
a ey A 
ras 


¥ 


(p'p) 


(€p) 


red a9uuop jsa 
(1p) ua Z uonendod vy ap suuaKou P| ap UOTeUINSA | Inod 
greundo uoneumnse,p uoNouoy ey si0je ‘9 - '€ = (9 “A)’d 
no (= (9°%4)'b bs ik =P uonn[os eT ounuo0s { suol 
-QpIsuod Snou IS 39 ‘AV ST = 2 ois "k)3 SaqUSI9 YIP TOU 
-g1qIssod saouerea sap stew Ay" ‘| = 2 ‘9 = ('4)3 ounuT0D 
suuskow oun jueyoduios uonendodisdns oun,p snied 
B JusUUepusdgput sain 939 uo (NA «* *'4) = € UONe[ndod 
Ind}90A np sjuvsoduios say enb suosoddns snou Ig 


6661 siquacep ‘ajenbuse,p senbiuyoe 1 


I=f 
(a) NI'RIN {= 4 
7 
SUOSSIUTJ9p Snou ‘anSoyeue uodsey oq 
=f 
(I'p) NIHUN {=A 
7 


isury ‘y°""‘] = f quouaansedsas 's uo][ HUY ,| 
19 ‘Gg, ens ey suep € ap souudkow sa] juajuasgidas 
“€ 9 iT ‘snd oq ‘u= ul by Oe gee |‘s| “s sagou 
juos /y, saves saUdIaIJIP ap SUOT|NURYDE so] ‘osTUAI sues 
atyHeNs sduis aoyegye oseuuo][NUueYse,p uryd un sane ‘yf 
ap imued e u afte) op s UoT[HURYD9 UN 9In UO Ay/'« tes 
uonelndod x] ap suuaXKoul P| op UOTeUIT}Sa DUN IIUA}gGO INOg 
“(Nae HQ) = € uonetndod unayo0a oY NSP = 1k = 49 
NpIAIpUl,,. Inog ‘ayordwis op tonos sed oueyeos 
aasoddns ‘€ yso gf uonendod RI Inod suljap s10jegTe 
gjqeuea ouQ “¥ ‘T= f° ote) op ‘g; saquBYyoNeAdYo UOU 
sayels ¥ Ud I9SIAIP Iso gy UONR[ndod ey {No T = 2:7} 
=d, 99}0U jso (so}tUN) snpIAIpul AY ap sajonbije 
uone[ndod ey ‘ajjamiqey uonrjou ve] suOsI{yN snoN 


AMILVALS ATd WIS 
AYIOLVATV AOVNNOTILINVHOU ‘Pv 


“OSUNUIWIOD 
QuusKoul oun juRwoOdw0D sayes op apjoroymse nod un 
uonenyis eR] Inod ‘jauuorsuowIprun anowesed un jueodwio0s 
g[eigues s139}eNs ve] op UONdLOsap dun UONdes ouIeYysoId 
PR] & RIOANOI) UO ‘slojaynoy, *( 4) g [EUUOISUSUIPH[ NW aU 
-eied un e juonbrydde .s sayqeiquias suoljelapisuod soq 
‘uone[ndod er] 
Op Iulj o1Q}ORvIeO Np ajduI09 juayy Inb yue}UOW UN,p ‘(9°¢) Jed 
SIUINOJ SI[[BAIOIUL SOP SJUdIOJJIP JUOIOS (4) INOd sal[ea 
-I9}UI Say ‘sane sap sun sa] jusyooiddr as nb syey[nsei sap 
JQUUOP JUIILIADP SaisajeNs xnap sao ‘ajapou np satidoidde 
S]JUSWI9[9 Sop & puodsaos Inb tstoyo uatq uefd un nog 


(e) ° |(0%4)'b { - (9408 X |i = (9 “X)'a"g 
G N 
no 
(()@"%) “a 
(8'€) tS ae eS, 
((O)9°)'8 °K 


UOISIOAUL | JOBVSIAUD Pp Jo ULI J] INS B9PUOJ BSIOAUI 
Tessa p aisajeys oun Jajdope .p isa gyyiqissod anne ouQ 


831 


(L'€) (woos ZJe- (M9°X) “a3 
no 
(9 *%) “af 
(9'€) sa Real LET ICET 


(90'S KX 


UOISIOAUL | 

JOBRSIAUD Pp 19 UOTOIPaid ap a1sayes oun Jajdope ,p jUuR}UA} 
NedANou sp Jsa [I ‘aouaJajul | ap Jof[qo | 1sa( 4) gQ onbsi07 

‘uone[ndodiedns ap ajapou a] Inod ‘amnyaAnoo auuo0g 

dUN SAR Q INOd OURIJUOD ap SAT[PAIOJUI SOP ITWINOJ WeIAOP 


(9°) /3 <P 


s31 


(9°) '8 


tae 


(ZZ) Op UOISIDAUT,| “Q Inod 
UONPUINSd,p UOTOUOJ ouUN JUdWIATeS9 ISs9 (Q ‘“X)'3 onbsing 
‘(p'€) BQO J JURAINS (4)Q Op aJen}oUOd UOTeUINSA | 
Inod afewindo ang sed ou no ang ynad tnb ya “(7'¢) wWeysnes 
mnb (9 “4)'8°*’{ = (9° X) 8 adeuuonueyog ,p uoNeUse,p 
uOT}OUOJ BUN SUOAR snouU oanb jURUd}UIeU suosoddns 
“QSCUUO][NULYI9,| IP 9]X9}U0D oy SuBp 
ULOMUI JUSWIITeSE 1S9 d]J[o STRW ‘SIQAVS SAT 9]UIeIUOD 
oun 4so (Z'¢) stelq op souesqe JT “{(Q “4) 363} QOURLIVA 
BI sp sinjonNs ev] ap sJuepuadgpur jso sues 90 us “8 ap 
ayewndo | onb 1a}0u y ‘uOT[HUeYD9,| SUBP 7 Op UOISNIoUT ,p 
(d snos) sypiqeqoad ey 180 ‘u yo 'u/(9“A)'d = (94) '8 no 
31 


(9 °C) '8 7 = (@°%) 8 


Jed aguuop jso ayeudo uonewmnssa ,p uonouoj ey anb 
Januouwi nd yuo (9g6]) uosdwoy 39 squiepoy ‘syeUNTUTU so 


(¢'€) 


ee 


M(G"4)'o €~ @° %) °3) a3 
N 
IS B[BWINdO SUILOD BgIEpISUOD ag nod 
(d*, 3) aisasens ey ‘(oxy ‘d)(d ‘3) sagsteiq uoU satsoyens soj Tue 
0 = (9 °X)'3 
op “9 UOIINIOS BP] SANOI) UO, | Is WNsinod 
as (4)Q snod ajanjouod uoneunss,T *9 ‘€ soy sno} inod 


(p'€) 


(¢'¢) 


T=! 


(9 K)'b | = (9 “%)'8°g 
N 


IS SIRIG SUBS SUILUOD B9JOPISUOD }sa 
(d‘3) uoneumMse,p UONOUO] sp aisgrens oun ja “(9° X) "8 uoNOUOy 
dUN 4Sd UOT[NULYE Pp UONLUINSS,p UOTIOUOJ dU, ‘asepUOS 
ap ued af nod souvradsa,, ‘“g wos *{s31:('K1)} = °% 
yeqnsal af Inod uonnqiujsip oun surenua d asepuos 
op ued of {Nv ‘T} ap Ss sayquiasus-snos op no suo] 
-UBYD9 ,P UOIDATJOO PI ‘¢ Ud dy][IGeqo1d op UOT}OUOJ oUN NO 
‘gsepuos op uvjd unjsa { ¢ 5s ‘(s)d} = d anbsuosoddnsg 
“guorjdunts 
ap ronos Jed sjagi UILIOD SUOISPISUOD Sd] SNON ‘dIUTy 
uonrndod x ap oyjne | ‘uone;ndodiadns ey] ap un | ‘saroosse 
soneuvied sap sumu0s (4)9 19 Q SUOJOpIsuOd snON 


(Z'€) 


T=! 
(1'€) ‘0= (9K) 'b “&¢ 
N 


eB euuol|ijueyOS US SOURIJUOD Ep Saj/eAUa}U! SB] INS pyeHal NESANON :uOSsdWOY| Je equwepoy ggl 


ap g Ud UONNIOs ek] aJUasaidaI 
inb aruty uoneindod ve] ap onewreied gf ‘(4)Q Issne 10S 
‘sasuodas sap uonejndod ap anayoaa 9 ‘(NA ** <4) = € OS 
‘Nov fT =21 nod g = (9 ‘’4)'b 3 anb sala) sayuepuadaput 
soleyuswig|g uonewMNss,p suonoucy sap dbo ''d 
wos ‘uoneindodiadns eve] op angureied un ‘9 10S 
‘uonendodiadns 
ve] op sanoweired sop e juapuodsauos nb aru 
uoneindod ey ap sginuenb op ayeundo uoneunsa,| inod 
JURAINS aIped a] ssodoid yuo (9g6]) UOsdWOY LT 19 squIepOyH 
‘[Qpoul 9] Ins onb uarq issne uvyd 9] Ins spuoj 9s sagasasqo 
suonejndod sap inod uoneumss, “UuaAnos zassy 


SHAAWASAO SNOILVTNdOd SUT XNOd 
SHTVIWILdO NOILVWILSA.d SNOILONOH *€ 


‘ueyd 9] 
Ins s9puoj (a[duis oiozeg[e oseuUOT[HUeYSS) UONeyNsnl 
oun jo uoNIpsid op uoNeiaidsajUI ouUN sto} eT Be BIOdWIOD 
(Z1'Z) ep y0AId a] “A atuly uoNeindod ev] op snowed 


gj Jed goejduior juvia 9 ‘(7°Z) ap a9 eB s[qQeIquias 


XN 


WO} ouN ajdope (Z[°Z) ep iOald 9] ‘OUOp ‘auINsal UY 


oe ae” 
4-9 & (EF 


(-') & 


jusWsATyeUUTXOIdde ajUasgidei Inb 39 


(91°2) 


YR. ELL ,9) 
4) ZX 


Os Yq yu 


‘ 


JUQUIOA 
-neutxoidde 3sa (ZZ) ap 2 oald 9g] ‘puvss yso Ay anbs10'T 


lee NN 


(S12) Op OWS ter ce 


se) 
(XA - 4)q,,U 9p sseuuol[nuryog,| ap soueLIeA P| ap oseu 
-uo][MueYoe | Inod sieiq sues InoyeuIT}sd uN ‘a[duuts a1OegTe 
asvuUo][NUeYydS UN 3Sa asepuos ap ued a, anbsi0T 


f u 
a's(E_F) z& 


janqyqey o[durts 
Wlojyeg[e ISLVUUOT[HULYDI | INS S9PUOJ DOULIJUOD ap SaT[eA 
-IQVUI XNv JUSWIIATLTAaI Saaiolfaue UOToIpeid op saiatidoid 
sop juoIne 10-xnao ‘anbnayjodAy s[apowl ef INog 


(p17) 


z27-u 


(€1'2) a 


Z81 


QUO} PB] SNOS {4 Inod «uonNoIpaid 
ap» So|[BAJOUI sop B nolT suUop 2 = [2| JOSIOAUT.P 1IRJ 
371 (1 ‘ON qouoaneurxosdde isa *,( N/T - 4/1) = 4 20 


(A - 929+ s(1- wf 


(CEO) SP IES ARREST  4 
(A-99yu 

anb 31419 .p 
youliod snssap-1d (p) ua,nb uonnqisip op aoay) owigUI 
eT] ‘UOT[NURYDE UN,p suoNRAIasgo sap med Be /’K "C= J 
atuly uonejndod ej op suussow ey ‘ajuazearnbg uodey 
ap «altpaid» no ‘IaWINSd suOTNOA snou onb jo ‘anbnuapt 
uosey op sanquisip ja syuepuedgpul (,9‘9)A Sep jUuOs 
Nout ps2 4 onb ‘aq alter op orury uonejndod oun suoae 
snou onb suosoddns ‘tsury ‘aseuUo][NuUeYde ,| ap 9}x9]U09 
ne gpuoj-uatg Ing] op 19 (QT'Z) ep 39 (ZZ) ep uoneidepe | 
Jaloj]dxa .p 1sa gsodxa juasaid np jnoalqo,| ‘auyeel uq 


(‘L128 € SUOTIDES XN UOTeIOQRIP | 19 UOTIR}OU 
RP] WOA) “INoaje1guInu np odA}j-11e99,] ap setidosdde 
UOTRUINSS oUN IS9 INdJeUTWIOUSp 9] 19 ‘{s37:('4 ‘)} 
= X “‘uopuueyos" un) aso s (4440) = 4 0 


(4) sh) QS X)a 
(LEZ) 


S31 


0 SSS 
honors (2 


Jed 9govyduias juris (Q[°Z) ‘auinpoid as ynad snssao01d 
omg aT ‘h & 19 @ & Sansoyeue stuly uoNe[ndod 
ap sonoweied sop quos (4) mh Ja (4) @Q@ oanbsioq (im 


“‘JHBOTJIUSIS 
dINdUWAp [I 19 ‘AJAINSINod 9s suIQUI ap nO} Jnad (QI °Z) 
19 (67) ‘(L°Z) Op aple.[ @ A op UOTFeUITSS.p snssad01d 
a (9'Z) aandefqo uoNoUoJ oUN.p UOTesTUTUTU 
eT op sed juataoid ou (¢°Z) awayshs 3] Is OW, (II 


“SUO][URYE spueIS op Inod 
juowanbrioay) Jorynsnl ev aptovj snjd ouop vias (QI °Z) & 
sInodal FY] ‘s}uBpusedepul jUsWOATyeWITXxoIdde nb yuos 
QU SOUID) SINd] 39 ‘sIeIq suRS JUDWIOATFeUNTXOIdde ,nb 
wuos ou (6'Z) 10 (8°Z) UOneWNSd,p suonenbs soy (I 


‘sonbievuy 


p] cro) 28 (A) 04)" <2 


831 


(ih) 9 '4)'3 {0 


jURSIOAUI Ud A INOd syneWTxo1dde soURTZUOS 
OP SI[VAIIUI SOP ITUD}GO Pp qvuUOSTeI sfquuas [I ‘sh Inod 
(efewINdo-snos jUW[qIssod) UoTeUINSd,.p UoNeNbe sun ysa 


(OVO? YRS 


$31 


0= (A) 9"')'3 Yp 


IS 19 ‘Q OP UOISUSWIP B] Op 1Nd}99A UN }Sd DIS 


(67) 


666| eiquiaosp ‘ajenbue,p senbiuyoo | 


“sjuvsodu0d sas op alevauly UOSTeUTqUIOD 9UN NO 


s31 
(8°Z) 0= (A)g'4)'3 | 
dIpnoseal op yowod +h UONPUITSS J 
“dh sa sh anbsioy Q Juels Y ‘Y 39 +h aNUe onboatuN souepuod 
-SolI0D ouN aysIxd TT “A= (Q@)N nb juR[NoA UuONoOINsal 
RB] SOAR ‘(aIIe[ROS) BSuURISeT op INayeor]dny[Nw un ysa Y NO 


$31 


9e 
(L'2) Vie = shea RO 
Ubsapegltes Organ e 


yeas (A) Q 
JOANOI] Op JuRyouULIEd DUIQ}SAS NP dI[II0}JOBA JULIO] eT 


$31 


(Ae"O'D X 


Jastuurur inod 
A IBANON op Wemeuwied sm Inod uoneumsea,p uoNoUOJ 
RY ‘SIOTY “A = (Q)A OXI INDTeA OUN INod (9°Z) JosTUNTUTUL ap 
wWemouued inb (sh) Q UN JURANON Ud aIIP-k-189 ,9 ‘«adeToId» 
ed sapgo0id yreumnod uo ‘(g)h op uoNeuNsa,| Inog 


S31 
@'O'o K 


adeeOs SAT}O[go UONDUOJ OUN .P UOTRSTLUTUTLL P] Op aI[NSOI 


(9°2) 


$31 
Oe (6 <4) SagK 


gsteIq UOU UONeUIT}SO Pp 

uornjenbg .p suraysAs 9] onb 39 ‘g anb yauuoIsusUIp a1qqyoeIe9 

awugu gf e& (Q9‘'<)'S onb ‘uonendodisdns sp sjapow 

Np a1peo 9] suep syuepusdgput juos '€ saj anb suosoddng 

“OMIeTVOS }QIDIUI.P aoUIeIed uN ysd (Q)M anb 39 INd}90A 
-INg[ea op aNeueIed un jso g onb jueudjuIeW suosoddns 

‘uoT[NULYDE,| ap adAj-11e99,] sa “s NO 


up pee 


“ox [-U 


(SO 


(2) +4 

quos 2 = |2| 
OP UOISISAUL | INS SPPUOJ Qg INOd doueIZUOD ap SaT[VAIOJU SI] 
(Z + U)/9-¢ 1S9 1 op yUoWIassNe{de | 39 ‘] = (2)JeA onbsind 
4 anbnsiyejys ey aonb ([ ‘O)N ap osejueAep aydoidde as 


AAR AN 
(€@) oe 


Ceone4 


sioye ‘anbruapt uodsey ap sanqinsip 
39 sjuepuodgpul (,9‘g)N sap juos s31 Soe Soy AISA (D) 
‘QuT]IGeUeA es onb suIgUI op UONeUISa,p 
UONOUOJ LI Sp SIeIq o] oINSOW UTED oUN suep 
viaqolsua (9 ‘'« )/3 °C ‘gstogid eur Iso a[Qpour 9] IS (9) 
‘(986 uosdwoY 19 equiepoH 
‘CQ6| SqUIepOd) INoyeI9WINU Np syTeUINdo | pud}-snos 


Inb juswauUOnTed swWgUI J] We UO. anb «uoNIpuod 
RB] R» INayeIQUINU Np «ddULIIVA» PI ISO (Q ‘A Monk 
uowgstiogid = snjd ‘uojjgueyss,, ep simjonns 
eR op sjueyodut syoodse.p nua} ajdwios ‘suonipuos 
SOUILIIIO SUBP YSILIG UOU SUIWIOD gI9pIsUOD og Jnad 
(9 ‘'« )/8 *°'( ‘agAJosqo UONPULIOJUL,| RoNZoreuRyuRIa (q 


‘{-9} op 
SWIOJ BT oUOduT nad ‘((g “74 )'8°°"{) eA op ‘J]apout 
3] Inod gsteiq uoU ‘INayeUINsS UN Isa (9 eg dla (e 


:syoodse sjualjjIp 

auodwos (7'Z) ap uonesiun,, ap gpuoj-usiq oT 
‘(866[) pout, sed s9uour 939 & aJUoNbasqns apnia sup.) 
‘(Q861) YOR suep (Z7°Z) ap sajatidoid sap so0d91d apnig 
oun RISANON UC ‘(Q- Q) OP BoULIILA LI Op sIna}eWINsa 
SIUSIDIJIP Op soUed oUldeI R] JWOTeID sINa}eUTWIOUAP so] 
‘SB SIOI] Sa] SUep {(.Q oQUIeIed — g UONRUITSS) InayeI9WINU 
3] asin saynoy quarear “(9g6I) [ehoy ep 19 (8L6I) 
AaTyUIH{ 19 VOY .P (S761) JOUSLA ep “(7'Z) ep sosnal 
-9]UR SUOISIOA SOQ “(S86[ BquIepOH) siInajne sop un sed 
‘soulojegye snssado0id op supe 9] suep ‘Jryeutxoidde joatd ap 

a & sgjUasaid 939 B (ZZ) Op a[eI9UIS SAI] UOISIOA BU) 
‘(T ‘O)W UONNGMsIp e] ap ajHUsoJed un jsa Zz no 


a7) or 


{ot 8 qa, ze 


JURSIOAUI Ud Q INOd «ajapowl 9] Inod saysnqoI» syneutxoidde 
OURIJUOD IP Sd][PAIOJUI sap Iua}qo suoAnod snoN 
‘SOIIRIUDWI[9 UONUINSS ,p SUOTIOUOJ sop qUOs '3 say NO 


(12) ‘sa1o= (9) J83 

18310 = (9) '83 
dae ‘SajUepUddapuUI JUOS Ss UOT[NHULYDE,]| ap 7 Inod 
'€ SUOTBAIOSGO SzJ ‘aJQpour 2] Inod ‘anb suosoddns snon 
‘uonendodiadns ap sjapow un.p 9g onbriun anowiesed un,p 
UONLUIT}SA | JURALID9P Ud UOISSNOSIP PI SUOUIEJUS SNON 


ATAGOW AT WNOd SHLSNAOA 
AONVIANODO AG SHTTIVANAINI °7 


"JUDWOUNINe JUSYONADYD OU $}eI[NSII S939 S]UDIJJIP JUOS 
sgjoie xnop soy suep sapsoge sowleqoid say ‘stojyaynoy, 
‘«sJuRosURIOp SaNouIeIed» sap jueyOduI seo a] JUapIOge 
‘(¢ uondes) asodxo juasgid 3] 19 (7661) AeIed 30 Jopulg 
Op Injao ‘sapojse xnap soy ‘ourguI aq ‘ue]d a] Ins JUapUoj 
as asodxa juasgid a] suep sa}uasaid souRIJUOD ap SoT[PAIOIUL 
sg] ‘uoNe[ndodiadns op s[apoul un eB lOAUaI 99 Wed Y ‘aquUOp 
guia[qoid un nod sastjyn eB sayorduit soueryuos ap sayyea 
-I9JUL SOP 19 UOTLUINSS,P UONOUOJ LP] BP XIOYO 9] 9]UdTIO 
‘gsodxe juasaid 3] 31]UOU S| SUIWUOD ‘UOT}RIAI 31199 ‘a]dnos 
sa) uodey op onb uarq ‘anbingureied-twes uonejndod 
-lJodns ap sJapoul un e yUdWIaUasaid saagartasqo suone[ndod 
S29] dor aypewNdo .p sd aD “uONRUISd,p suONdUOJ 


eBeuuoj|UeYOS US BOURIJUOD Ap Sa|/eAUa}U! Sa] INS pyeHas NE@ANON :uosdwoY] je equwepoy 981 


LOE TZN epeurg (OurIUC) OOPTAIVAA ‘OOpaIeA\ JO AIISIAATULE) ‘AUDIOS JeUNIOY pur soNsNes ‘uosdwoy] ‘q'W 19 squIepOH q’A 


sop aiyewndo.p aia ne yoUlal[aNuessa oyoRyeI 9s 
Jaiuiap 39 anb isa sasodxa xnap say a1jUd aseq ap dUdIOJJIP 
eB] ‘UOIWUINSA,p SUOTJOUOJ Sap DOSY) PI INS JUOpUoJ 
as gjore juasaid 9] 12 (p66 1) Yeied 19 Jopulg op gsodxa,J 
‘TauUONUaAUOD JOjNId ad} op juateya sajUasaid sdURTJUOD 
Op Sa[eaojUl say ‘stojayno} ‘seo 9d sueq ‘soxa[dwios 
sajgnbus sap inod uoneuwinsa,p SUOTJOUOJ Sap I[[OWIOJUI 
uodej ap asi[on wear “(EQ6] Jopulg) sinouajue uoneorqnd 
aun sup ‘inayne Jonueid a7 “(p661) Yeed 1° Jopurg sed 
oiedaid a19 & gsodxa owaixnep uA (1661) equiepoy ied 
[I€JaP US PJUSUILUOD 919 B JUSUINSIL 19d) “a][SULIOJUI UOSeJ Op 
SO9ST[IIN UOLUINSS Pp SUOTIOUOJ Op ApIe | B ‘9dAIOSGO UON] 
-ndod oun,p «uontsod ap sainsaw» sap inod souvlyuod ap 
SO[[PAIOIUL, p UONeISUOWUEp s1etUUId ouN gyUasaid B (Z7S61) 
JJNIPOO MA “JUaUaTNes sasodxea sanbyjenb suep «uoNewNsa,p 
SUOTIOUOJ» SOP BIPLD J] SUBP SBRSTAUD 9}9 B «aSBUUOT[NULYSE 
Ud JOURIJUOD dP SAT[PAIOJUL» Sap SUUVY} 9] JUdSoid e .nbsn¢ 
“OSCUUO][NULYOP | Op 3}X9]U09 9] Suep UONsanb 
97100 B asuodal oun }UINOJ (986, UOSdWIOUL 19 equIepoyH 
‘$86 oquiepoy) sayewndo uoNneUsa,p suoNoUo} sop 
a1109U} ey] Jed stuino] ‘onbineuresed-mwuas ajapow un nod 
‘Q9AIOSGO IOYSI OP UONLUIOJUI,| Op UONRSI[eIQUaS OU~) 
‘(8161 AdP{ULY 19 UOIJA) SOAIASQO JOUSLY IP UOCULIOJUL | 
ap ople| & Njosal yso “yudoel-snos onbiyawesed sfapouw un 
jueyodui0s anbnayjoddy uonejndod oun inod ‘aurefqoid ag 
{Sa{qisneld souvijuod op SoT[eAJo}UI Pp dLI9S ouN & JUeUOW 
(gneutxoidde joatd op no) 10OAId op WeIIAJOS JOURLIeA 
eR] Op suOneUIsSd sasnaiquiou sap a[[enbe] :19-a][90 3s9 
‘QINnIVIONT] VB] SUeP sapsOge sed JUdUETeI9UaS 1S9,U IND ‘aseq 
ep uonsonb ey ‘«uoneUso» oun Jed onuUOdUI sOUeLIeA 
BR] Jaovjduiol eB aysisuod ajuvinod anbneid oun ‘(gg6] 
SOA 39 LInypneyD ‘ajdwiexea sed) yafns 90 op quate Inb 
suoneorqnd sa side .q ‘aseuUo][nUeYyos UN, p 3}X9}U09 9] 
sup onuUod siewiel jsd,U SNSSOp-1d IQUUONUSU «IdURLIVA» 
R] Iwo ‘stojayno} a[NN ssens j4so,u ela ‘jnewrxoidde 
oad un ajuasgidar , (dourleA)/(onguiesed — Inayeunse) 
‘InoyewINse | Inod sayewrxoidde syewsou uoNnnqmsip 
oun nb yuesoddns us jueurxoidde souetjuod ap a][eAsoqul 


‘gsvUUO][NULYOS ‘UONRONeIS ‘oyITeUINdO ‘UONeUIT|SA Pp SUOTOUOJ ‘aoULTJUOD Op SaT[PAIOIUT 


I 


UN dIINIJSUOD ap owed ‘anuUOd sa aIIO IS ‘asTeIq UOU 
INdLUINSS UN Pp «<ddURTIVA» BT anb IIA jsd [I IO “sasteIq UOU 
Q[PUNIUNLU DOURLIVA PR] OP UOI}LUIN}SS | OP JJOYIeJ\[-Sssney op 
DUIIIODY} J] ISO ‘AUIPOU! SIZOTOUTULIA} BI UOTAS ‘191 UONSaNb 
Sd [I JOP oWIdIODY] JT ‘«Salenbs ysvay uo WolOsy]L 
JJOWRPY puke poyryy JJoOyIeY OYL» S9[NIVUI J] 9J0U ouN.p 
SIAINS ‘QOURIJUOD Op SaT[VAIOJUI Sop Ins jURJIOd ‘J 9}0U oUN 
yeyodui0o axouur | ‘sasoyo sone aU ‘oxouUe oUN jIR}9 
Plbl Op URWADN dp UONBOIUNWIWUOD P| Op [A UONIES VT 
‘aystjiqeqoid a3epuos op 
ueyd un Jed ayinpul uonnqmsip ey] Inod joatd op yuauia}9exa 
JIAJaS nod du jQId}UI Pp aNeuVIed Np 39 SUOTJBAIASGO Sop 
J[RIALI] UOU UOOUOJ oUNONe “UdWITeIO9UNS ‘UONENITS 91399 
sued (6661 APH “8S6I Nseg) suoIsuaWIIp AY ap anguivsed 
un ynvj [I ‘AV ale] ap daarasqo uonendod oun Jasta}ovIeS 
Op Ulfe ‘dI]UOD Jeg “JONUOWAP JUDIWII{IOVJ ISSIL] 9S SOIIeTeIS 
sanoweied sanbjenb sed sagsiajoereo §=sanbneayyodAy 
suoneindod saureyes inod (sjnewtxoidde sjoatd ap no) 
«SJOAId» ST] op ayyIqiuodsip ey] ‘(anuuod) oxIJ UOTNQMSIp 
oun quer 1Q19]UI .p anowesed np 19 SUOTRAIOSQO .P UOTOUOJ 
aun 4oaId op jueAJas oyQUeNb ouN,p INIed Be sOURIJUOD Op 
SO[[PAIOIUL SOP 11U9}gO WeANO UO JUSUWTWUOD 9.1]UOUT JUSU9}IO 
-1[dxo eB ueWAdN “(2€6]) Uanbesqns uoneorgnd oun sueq 
‘anbnayjoddy uonejndod oun.p saneuivied say uswayed 
-IOULId JIRUIBOUOD DOURIJUOD OP SaT[BAIOJUI S| INS UBWIADNY 
ap gsodxa,| onb ny ,.pinofne Jautyye suoanod snon ‘(2661 
YW “L661 PGUILPOD ‘9/6] BQUILPOH “OC6] Sura) Ino} 
np astduro0s uarq sed ang-jnad j1e}9,u ‘ed anne _p ‘anbney) 
-odAy uonejndod oun .p xnao 30 ‘ed oun ,p ‘agarasqo UOTIR] 
-ndod oun ,p sanawieied sa] oud UOTOUNSIp ve] onbodg | v 
‘gSeUUOT[HULYDE,p PUISYOs UN Inod aouRTyUOD ap saTTeArojUl 
SOP dI[9} DUO UOT}ONI}sSUOD eI WIDEep sed vu UPWIAON 
ap gsodxa | ‘ueyInod ‘asevuUO][HueYog | Ins yeyod uoneoru 
-NUIW09 BT “AJOINOS [VONSNeIS [eAOY PB] B Ba}UASaId (PEG) 
UeWIADN Op ONUUOD UdTq UONVOTUNUIWOD oUN SsUep 9yNOSIpP 
919 ploge Pp & JOURIJUOD OP Sa][BAIOJUI Sop dQ) IT] 


ANOIMOLSIH NOILONGOULNI  “T 


‘SATO SLOW 


‘UONLINUWIS ap SaPNig Sap SUP STOUUONUSAUOD doURTJUOD ap SaT[eAsojUI say anb xnamu dnooneaq jUaUUONOUOY 
QOULTJUOD OP SO[[PAIOIUI SaIINe Sod “QOURTJUOD ap Sa|[PAJOIUL,P OUOP Ja ‘OAId ap jURAJaS 9]NUeNb oUN,p UOTONsUOD 
9p d1901IP snjd spoyIgW ouN s1QBSNs UONLUINSS,P SUONOUOJ sap sLO9Y} LT] ‘sINaT[Ie Jeg *{,,(epyewINsd souBIeA)/(onguIeIEd 
— uoneuinss)} oaid op jueAsos oATeUTxoIdde 9yHUeNb uN ,p UONNQI)SIp LT JULSIOAUT UD SNUD}QO JUSANOS JUOS oQUILIEd 
un Inod doUeIJUOD ap SaT[eAIOIUT Soy ‘anbysHeIs VP] 9p SAUUONUDSAUOD SaUTeWOP SaTNe Pp sUBP DUTOD ‘aSseUUOT[NUeYOS UG 


aWwnsaY 


iNOSAHNOHL “HW 3? AANVAOD ‘dA 


ISCUUOT[MULYDI UI IUBIJUOD IP So][BA19JUI SI] ANS pAVSIAI NBIANON 


S8l 


epeueg aenbijsijels 
861-S8L dd ‘zu ‘Sz JOA 
666| eiquieoap ‘ajanbue,p sanbiuyoe | 


“S8T-6LT [| ‘SIUSIDIC INUOUOIT puv ssauisng fo ]DUANOL “eYP ISI | 

SANLISIUIUpR pur ‘AdAINS UOTeJOWINUd-}sod ‘snsudd JO Suljapow 
waisds-a]diiL, (€661) ‘SD ‘ONVDATON 19 “WV ‘AMSAVISVZ 

‘ATT ‘sunox 

pue ISuUIG ‘Od UoISUIYsEAA “YIMDasSay aspyuIT psooay Kune 
mouIauUua) (6661) ‘A ‘NAYNAHOS ?9 “A ‘MOUTNW “DO “ALIHA 

“snsuag ou] Jo neaing *S’Q :Od 

UOISUIYSe A ‘SSUIPIDI01g ASO[OPOYII|] [RONsHLIS UO daTUTWIOD 

[P19P94 6661 ‘ApMIs asevo ev se ADAING 9910,] INOGLT] ULISIMION 

BY] 2SONSNLIS Wd) WOYS WWOUOSS Ul SI9}SI591 IANLIISIUIUPL 
SuIsN JO SI9IJJ9 OL (6661) “I ‘ONVHZ 1° “1 ‘NASIWOHL 

“IZTZ-107 ‘7 (99 ‘anbusiis ap ajouoypusajul anaas OT ‘aOUdLIAdx9 

URISOMION OY) ‘StUd}sAS PIJOOI SANeSIUTUpeE puUe sAdAINS 
Ol] BVP SUIUIQUIOD (8661) “MV ‘AOWTOH ¥ “I ‘NASWOHL 

°89-€97 ‘7 ‘Juauajddns 

412190 JvoUsyDIg }okOY ays fo JoOUANOL ‘poyaW dAeIUdSe1d91 
ayi Jo Aroayi ay 01 suonnquuCD (SE61) ‘d ‘AWLVHXAS 

‘ssolg Awaproy [euoneN :Oq ‘uO sUIYse AM ‘JIOundD 

Yoiwosay [PUONRN ‘soNsHeIg [BUONBN UO da} TWIWIOD “spoysay 

SNSUAD AAl|DULAI]Y aJON]DA O] jauvd ‘ady uolouisofuy ay) ur 
ajdoag sununoD (r661) (SPA) N ‘NYNAAVU 9 “dd ‘AFSAALS 

‘90066 - AdINOCOOAE | 

“ON OnSO[RILD 666/ Jajyjin(- anol vy asnu :opounyg anbusipis ap 
adgIoUDUY 91L4NnJas VD] Ans aignbua,T (6661) VWAVWNVO SOLLSLLV.LS 

‘71-96 19 61-S6 ‘1-76 ‘€0-P6 *10-€6 ‘AZOOOASL 

“ON onsojeieg “QYIAIYIAA AP SJUIWNIOT -NUIAIA NP JA JIDADAJ 
np anbrunup vj Ans argnbugq (9661-€661) VWAVNVO SOLLSILV.LS 

‘CI ‘aJownyeg ‘ssunsojy 

[eonsneis julor ne joued np uonejUasolg “WINIUUDTIIJA, MON ou) 
Ul sonsHeig pue AdeAlg UO Jour, “SUIUTTY BIR (6661) "A “UFONIS 

‘OSI-ILI ‘€% ‘algnbua,p sanbiuysay 

‘TJ omseg - Inajeulps1o sed sguedde saguuop op sioryoly sop 
UOIsse1s91 ap askjeuy (L661) ‘M ‘MATANIM 3° “A “NAYNAHOS 

69-Sth ‘61 

‘ajgnbua_p sanbiuysa J, “Inayeuipso Jed sgjdnoo saguuop ap sso1yoyy 
Sop UOISsa1891 ap oskeuY (€661) “AM ‘YA TANIM 39 “A “NFUNAHOS 

“611-601 ‘6 

‘sousypig jvIIYf {OC Jo ]DUANOL “SULD\SAS UONUWIOJUL OJUT SUUDdSAS 
oanensiurupe SsulUINy, (C661) WL “‘VASLAd 1° “A ‘NAYNAHOS 

‘ATI ‘Sunox 

pue ysurg :Oq uosulyseM ‘sanbiuyoa] adpyurT p1oray ‘SUIQNUOD 
siys ueuNY ‘spslooel yey SuLyUIT (L661) “d ‘NHYNAHOS 

‘(€661) SSeid Awiapeoy [BUOneN :Oq ‘UO UIYSE AA 

“LEE-98E ‘O6 ‘UONDIDOSSY ]DI1ISIIDIS uDIIUaWUYy ay] fo JOUANOL 

U] “S9DIAIOS JUSWIUIZAOS JO AjI[Iqissoooe pue Ajl[eNnUSpIyUCS 
‘satorjod orjqnd pue saat] aeaud (46661) “4 ‘NHYNFHOS 

‘Cr-E 7 8 aouDYD 
‘(®C661) “d ‘NAYNAHOS 

‘98-81 ‘1 ‘9 ‘alanbua_p sanbiuysay 
(0661) USEY Op spate | Ns sosreyUSWIWOD *(0661) ‘d ‘“NHYNAHOS 

"QLI-SS ‘a2ladag anuaaay Jousaluy ‘S “f:) ayl Jo 

S8UIPIIIOAd /C96[ - Sanbiusa] aspyury prooay sued ‘soseqeyep 
a[diyjnus Jo oseyUr] UT sonsst [edISojopoyreW ($861) ‘A ‘“NAYNAHOS 

‘OSLII-€T UOnBoTqnd 

‘uoneNsIUIUpY Aj}LINIIg [eI90G ‘SOdIAJOg URUIN]Y pure yY)[eoH 

jo juouredagq “SQ ‘saseyury eieq Aouaseiayuy WIOIJ soIpMsg 

“Apmag yore ex €16] OY) JoJ uoNeuINs| Jo spoysW (1861) 
‘UYU “ADVAVASNA 1 “T “THDOA “TH “HO “d ‘NdYNEHOS 


“snsUa9 sp1O091 SANeSIUTUpe “S'Q) V 


JUBWSSUBIA! Je SjI}eJJSIUILUPe SIBISSOG :UdINBYOS 


“UONRNSIULUPY A}LINDIS [LIDOG *S"f] ‘SION SULYIOAA SSY’T ‘a]dures 

[eonsHels sanessiuitupe poyxul] poyessoiuy (6261) “A “NAYNAHOS 
“BULID A -IOBULIS “YIOX MON “SUIDLTOMg 

[049UID) “S'f) Ul SAOIDUMISTY 19a41PUT (9661) CPA) “M “ATAIVHOS 


“UONDIIOSSY JDINSUDIS UDIAAWUY ‘Spoyla YIIpasay 
Aaaing uo uoljzag ayy fo ssuipaav0ig j,uonejndod oy} junos 
SUI 94) UPD [9M MOH “(€661) A NWA 19 “W YAH “d “UATIVS 


‘UONDIIOSSY JDINSNDIS UDI1IaUY ‘SpoylawW 
yoivasay dading uo uolIasy ay) fo ssuipaazoig ‘ayepdn ue 
‘junoosopun uoHeindod CYT euL (8661) ‘WW YAGIM 9 ““d ‘YATIVS 


‘Tp EST “VW Selag 

‘€JA1I0§ JVIYSNDIS [VKOY ays fO ]DUANOL *SUOD puk sold [eoNsNe}S 
pue dANRISIUTLUpe OUIOS :s19}S1301 UONeNdOg (6861) 'd ‘NYAXGay 

“snsudd oy) JO neaing ‘S'7 :Od UOIduIYseE AA 

‘sSuIpaad0ig ASO]OPOYIaW [BIUSIYIG UO aal]NUUIOD JoLapay 

666/ ‘Ue[d yoledsal 9SuULI-SUO] B ‘nedINg snsudd dy) Je sasn p1OIII 
saneustutupe Jo uorsuedxg (6661) ‘D ‘TWAIODDAT 19“ “LSOATUd 

"ST9-8SS ‘L6 ‘K1a100¢ 

Joousypls jokoy ay) fo }Duanor ‘uondeyas aatsodind jo poyjyouw 

dy) pure sul[dwies poryness JO poyjow dy) :poyjow sanejuosaidal 
ay) Jo syoadse jusiayjip om] oy] UO (PEGI) “ff ‘NVWAAN 

‘Oq ‘uo surIYse MA :[lOUNOD YoIvdsay 

[euoneN ‘soouatog [eoneWayeJ] UO plvOg ‘soNsHeIS [eONIIOIY,], 

pue poyddy uo sand doysyioj, eB JO ssuIpss901g 
‘SIOg BIL PAISSeW (9661) SHONAIOS dO AWAGVOV TVNOLLVN 

‘PL-LSp ‘L ‘sousunis joo 

{0 Joudnor ‘pueyuly Jo dustINdx9 9y} :sp10901 JANeISIUTUpE pure 
$19}$1591 Aq snsudod — sreuuoNsanb Aq snsua_ (1661) ‘d ‘WINSYAW 

‘Oq ‘UOIBUIYse AMA :ddIAJOS oNUDADY [eUIOJU] “S'~) ‘sulaiskg¢ 

uoNDUAOful OJul swajskS aaypasiunupy suluiny~ ‘awoouy 

fo soysypig ‘suonedi[duit auios puke s}[Nso1 oWIOS :epeuRd Ul 
BJP [BIOS DANBIISIUIWPY (F661) ‘f “NIM TNO-TSTA 19 “f “SHAAT 

"SSO1g OSRIIYD Jo AUSIOAIUL) ‘TI 
OSvIIYD ‘Suo1NpOAay I1YfjUaIIS fo aANIONAIS aYT, (OL61) L'NHNM 

“LL-L9 ‘1 ‘9 ‘aianbua,p sanbiuysay, ‘yo{dwi0d yuoula|[9Anoudl 
DdAv SUOT[NUBYIE 19 sadvi9 Jed sjusUIasSUDDaY «(O66 1) “TT ‘HSIN 

‘TUY Xopulyos/Zsso 

/ssoysqnd/sn' pay qiys0q' MMM//:dyVY as ne opqruodsip ‘yes, 

JO UONNGINSIC OY} Pure “ADS C661 PUR *Z66I “6861 OU) JO} USIs9q 
IYSIOA\ IUISISUOD (L661) “T'NUYNAAGOOM 1° “VW “TIENOINNAY 

‘onbnsneis 

ap [euoneusajuy yMINSUT :BINqIOOA ‘adNIadsuag JOUONDUALAIUT 
uy :sousunig fo ainmy ay, (y661) (PA) "Z ‘AASSHNAN 

“KOTLMA 3YIO XK MON 

‘Juasadd ay] Oo} Cinjuay Yluaajuaaas ayj WOLY :aIUAIIG JDINSIDIS 
ul Sauyouosdag SuIpoyT (L661) (SPA) “S “ZLOM 1° “N ‘NOSNHOf 

“COE-IPE “SUOTIDN 

pau ays fo Jousnor Jwousipig “soouatiodxa ystueq wos 
- WAISAS [RONNSHRIS PIseq-1O}SISOI B SPIBPMOL (E861) ‘d ‘NASNAL 

‘UONDIIOSSY JDINSUDIG uBIIAaUY ay) fo 

joudnor ‘epuoly ‘edwuiey Jo snsuag ¢g6] 4) Suryoyew! 0} parjdde 
se ASO[OpoyoUI ISeYUL[-P1OI1 UI sooDURAPY “(6861) ‘IW ‘OUVS 

“LLT-SST ‘7 ‘SOUSUDIS 

pouyfE fo Jousnor “sansst [eoIso[opoyjow! :osodind jeonsneis 
Joy saseyuly plosay (L861) “A ‘NHUYNAHOS 1° “L “ANIGVE 


ysl 


“6-1 I-Z6SEL-06 ‘NASI “(pe ‘Aassousy °Z) ‘sousuvig fo aaning 
UL (P661) ANOILSILVLS Jd TVNOILVNYALNI LALILSNI 

COE 

‘pl ‘sousiplg joounwayiwp fo sjouuy ‘suonetndod ayruy woly 
Ssurdwies yo Alooyy 941 UO “(EP61) “M “ZLIMUNH 19 “WW ‘NASNVH 

‘UOlIDIIOSSY 

[DINSUIDIS UDIIAIUY ‘UONIAY SIUSIDIS JDIIOG PUY JUAUULIAOL AY] 

{0 S8ulpaazo0ig ‘SP10I91 JAVENSIUTUUpe JO sasn [eonsNes popuedxa 
SUIAJOAUT YoIeasar AVALd (8661) ‘d ‘NOLTOM 1° “DO ‘SALVO 

‘CW ‘oJownyeg ‘ssunoajyy 

jeonsneis juror ne youed np uonejuasalg “WINIUUDTI[IAY MON ou) 
ul sonsneig pur Aovaud UO Jour ‘SulUI Be (6661) ‘D ‘SALVO 

‘dT ‘Buno X pure ysulq 

VA UO WUILLY “ZI - ¢ ‘Sanbiuyoay aspyurT psooay “uoNN[OAd 
omueudp e - Aotjod orjqnd pue aseyur] prooey (L661) ‘I ‘IOATIad 

‘ssaig AWapeoy [euOnRN :Oq ‘uO SUTYse AA ‘[louNDD 

yolvasay JeUONeN ‘sonsneis [eUONeN UO day]TUIWIOD ‘:puokog pue 

OOOT Je2A dU} UL SJUDWIAIINbayY snsua_ UO Jou, ‘snsudD ‘Sf OUI 
SUIZIWIAPOW ($661) (SPA) ‘DO “AZLINHOS ?° “'d ‘NOLSNOWGA 
'SSOd LIN “VIN espuquiey ‘sisi4D ays Jo NO (9861) ‘M ‘ONINAC 

“yoreasoy 

Aoyog vonewoyiwyy ‘Od ‘uoIsuIYyseAA “uUONR[ndog ‘SQ oun 

JUNOD 0} SPIOIAY VOIAINS INUdADY [PUI] SUISA) JO AII[IGIsed4 
24) UO (L661) “‘V ‘WYIHOS 1 “T ‘ONAYOW “TL “VALVZO 

'QOP-COp ‘UOIIMIIOSSY JDINSIDIS UDIIMaUY 

‘spoylaw Yyouvasay Kaaing uo uolsag ayl fo ssuipaar0sg 

‘suInjol xe] Jo ajduies yenuue ue ul UOTaIas [eUOTIDaS-ssOID 
pue jourd Suruiquod (6861) “A “YANTVM 1 “TL ‘WALVZO 
"66-8661 ‘E87 ‘aouai2g “suIsIpesed Jo yorewW OY (6661) f ‘NHHOO 

6661 ‘SZ ouNE ‘snsuad 

oy JO neaing ‘S$ ‘fF ‘spsooay aauvsisiunupy sof K2110g ssazoVy 
pajsijsay uo unpuniowap (6661) ‘D ‘SALVD 9 “OD “MUVTO 

"ESE-SLE “bp EL ‘SuoNDN pailuy ay) 

fo Joudnor [994811015 ‘sue|d pue saouatiadxe :snsuao uRIpeURD du) 
Ul Bep SANLISTUTUIPR SUISF (9661) “NM ‘NVATOOW 2° “YU MALYVO 

“QUY IEISOMA (CW S[IAYIOY ‘snsuag oy} Jo 

neoing ‘S$’¢ a Inod giedaig [apo] UOISSoISIY [9Ad][-OM, :eIVq 
JUSPIUINN WSS YIM Surjapoyy Aitoruyrg pue sey (6661) ‘d ‘AAA 

“OUT ILISAM 'GW S[IAYOY “snsud_d oy) Jo nesing ‘Sp 2] 

Inod g1ed91g "7 UOISID A - JOPOJ] UOISSAISIY [OAI]-[eNPIAIpU] :eIeEq 
JUSPIWINN WSS YM Surfepoy Ayoruyrg pur sovey (48661) “A “AAG 

“OU] IVISAM ‘CW [IAYIOY ‘snsuad oy} Jo nesing 

“S'F) 9] Anod guedgig ‘suoneinqey, pue jusuidoyaaaq aly :e1eq 
JUSPILINN WSS YUM Burpopoy Aroruyi pue sovy (88661) "A ‘AAT 

“OUT 1eISOM (CIN 

I[IAYOOY ‘snsuag yi Jo nevoing ‘s’~¢ gj Inod giedaig ‘jesodo1g 
UBISAG :O10Z JO} snsuaD psosey saneNstuUpY (L661) “A ‘AA 

“snsudag oy} JO neaing “SFA, (Od UOIsUIYse AA 

“SSUIPAIIOI A8o]0poylayw [DIUYSIIDIG Uo aajJIWUuo-) [DAIPPIY 

666[ ‘suluurld snsusod ul ASojes poutjep-oid e se sassao0id 
SNSUDO [PUOTIPeI] PUL Paseg-19}SI591 SUIUIQUIOD (6661) ‘O ‘NATE 

866[ SIQUIDAON LZ ISOd uojsulyspp ay] “pnoay snsudd 
Ul oYeIs IB spuNy “UONeIUasoIdal Jo UOISIAI (8661) ‘f “MOIdANSIA 

‘PURT[OH-YVON 3yIOX MON ‘spoyjatu suds wopups fo K10]S1Y4 
fag y ‘Buydung :sousuig fo yooquoHy (8861) ‘d ‘ASNOHT14a 


est 


“snsudd ay] Jo neaing °S'fA ‘Od UoIsUIYsE AA 

‘s8ulpaa0dd KS8O0]Opoylaw JvIUsSUvIG UO aaljIUNnuoD j[Dvsapaf 

666[ ‘AecIng AyUNUIUIOD UPOOUTY dU) pue sp109E1 JANeNsTUrWUpe 
YIM UONUINSS J99JIPUT (6661) ‘N ‘GNWHO 39D ‘YAGNVXATV 

‘QOIAINS ONUDADY [euIojuy ‘AInsevo1p ay) Jo yuouNIedaq 

‘SA (Od ‘uOISUIYsSeAA —“YoMvasay p4ozray aalDusUMUpY 

paipjay pup auoouy fo sousyvig “(epeued onbusneis 

‘saka7q uyor Jed uoIssnosip ddA) ‘SNsuad sp1O99I SANRNSIUTWIpRe 
ue Jo} punoisyorg (7861) “dA ‘NHYNAHOS 1° “M ‘ATA TV 


aNd VASO Tala 


“SJNONSUOD Sai} SINSJeUTWeXS XNap xnv nb tsure julo[pe 
INDUPI,| B ISSNV JUISSIPE Ss SJUDWISIOIOWIAI SOY “JOIeS 
Jajad 19 sakaq uyor ‘aXg Auuog ‘Aaayy Apuo Ay Jouuonusw 
ine [lL ‘sopedroutid soy tue “apone 399 suBp SNUNUOD sogpI 
SQ] Inod s}UDWIIDIOWIAI Sap JUDILI9U SoUUOSIad sINaIsN[ 


SINGING Wana 


‘ayjanjoe ounay | @ Jans 99 B ayndexe [I, nb xneary Saf UdIG B 
JQUDW ap NvaINg snsuad “*S"p) Ne ayeYyNos af ‘snudAred yuOS 
A no arjduooor | ap aXesso elap juo ‘apuow 3] suep ynoyed 
‘Inb Sa]]Jad 19 XNIO SNO} JOIOI[IJ OP JUDTAUOD [I ‘pled9 399 V 
‘g[Suv 129 snos sIpNie ag,p 12 suISIpesed op juswWeSueYo uN 
UIWIOD IBPISUOD a9 Pp BLOW Jaed Way un ev onbissejo 
JUSUIISUDIAI UN ,p asessed 9] ‘apseS Ud AST 9}}99 DIB[VIY 
“SsUuoINjOAaY IYfiJUuaIIG fO aANJINAJS AY], IN J] SNOS 796] 
ud atjqnd ousipesed ap yusWIaSURYO Np Ure] BSeIANO ,| 
suep d1qg[eo wisIpered mou uolssaidx9,| npudl v [I puenb 
uyny sewmoyy sydosoyjryd 9] yWesuad syanbxne sanbynuaros 
sjuowaddojaaap op a1uas ne JUdWId][991 sIpUOdsaI09 sed 
dU SIOJIINO} JUdTeLINOd suOTesaT]e S99 Bp aiquuou aonb anole 
A uQ ‘«usipered Mou» uolssoidxa,, puosduioo guinsel 
3] NO aI J] JOP sanbiyNuUslds sapone ,p JURSSIOID dIqUIOU 
3] Jorado1 op yafqgo inod e inb «swisipeieg Jo yep su» 
sgimut onbiiqni ayjaAnou oun pusidwio0s (666 Ueyod) 
JIUIIIG BNADI VI WP 666 SALW OZ NP OlOUINU JT 
‘ue Jed stoj oun SUIOW Nev JOUTWeXaal PF] 39 JURUDJUTeUI 
uONRoIfULd 99{99 JODUDWILUOD 91}9-]NEd 39 CQ QZ Saude aJAINS 
-Inod & dYydIaYyooI op xneARN sap uoNRouryd ey] eV ayso0Lid 
RP] JQUUOP Issne WRIADP UM ‘6 12° CQ Saeuuv so] JURINp 
Sd9NjIIJJO SaTeUL} SUOAdaI Soy 19 Sa}O[Id s]UdWIaSUadAI SO] 
Inod JUSUSINITID}UL SBd J] 919 BU BIID oNb a1uUadEp kT Op 
soguur salgtuaid say yueInp pinoy snyd dnooneag vias sinbal 
yospng IJ ‘sqQesi[val JUdWaT[oUUONPIedo YCY 2 spuel 
ap 39 Jdadu0d gj JaANOId op ana ud xneIo9ds s}UdWIaSUdIOI 
Sop Jasi[val op ojqesuadsipul eias [I ‘juoWa}saplUuRyy 
“‘xnesgyt.nb xnesay yur} ‘UONPISTWUI.p s]UdWOdANOW 
so] quosod onb sawafqoid say yuowayloey snjd sipnosal 
op wemoued aseysidap a] ‘urleVIDOUI sa [RUT] JeI[NSOI 
2d] Sleul ‘oUUaIpeUed soUaTIadx9 ,| ap tor Jordsut,s nod uO 
“Q[eJUIWULPUOJ AYIOYOOI BP] ap ana op qutod np ssnayawioid 
snid ey wWesed nb ajja0 jsa aseisidap ap uoj[nUeYyos | ap 
B[[99 ‘UOTIOIS DIQIUIOP PR] B SoyIe} suONIsodoid xnap saq 


So]J9NIUIAI SaateyusUI{ddns sadezyy Lg 


6661 eiquiecap ‘ajenbusa,p senbiuyos | 


‘IOIWap a] sqide nb yuowapides snjd dnooneag ang,| 
JUOIASP S2[[9 ‘WUaWIasUdaI UTeYdOId a] Soide sastid jUOIas 
nb soinsaul sa] Juatos anb sayjanb ‘stojainoy, ‘assoiZo1d ve 
sajueINOd sajgnbua .p saumtueiso01d say inod asepuos ap aseq 
a[[2Anou oun ,p uoNdope J ‘sue xtp ap snjd Ins uapuays,s 
tnb sanbijsX9 sapoued sap sed sastigjovies juOs sjUdUI 
-9SUd9AI Say anb A1uajNos eLINOd UG ‘ansuo] don JUaANos 
}S9 JUDUISUADAI Jed sajgnbud sa{[aAnou sap sje] Nsai sap uoN 
-onpoid ev] 19 Ingap a] aNUe apotiad ve] Uepuadag ‘UoUIEp 
-Idev1 JUOUIWWIeSIJJNS IIsIes So] R JONUUOD ap UONIPUOD ke 
*S9]US[[9OXd JUOS AIAING APWUNWIWOD UPILIOWY ,| Op VIped 9] 
SUEP SJNLIISIUILUPR SIOISSOP Sap JOSI[NN,p SUOISRI9O SIT 


SdJUBINOD sajyanbua Sd[ JUBUTIDUOD sodejiq 9°8 


‘gyeronio 
JUDUIDTVS9 LIS JUSWISUddaI Aap SJoT[NoNIed sjeiNsa1 ap 
UONLISIIUL TJ “[PSIOASULI] JUDWdT[oNUESSe sUTUeISOId uN ,.nb 
10INId ‘suoNoRsURI) So] INs axe oWUIeISOId UN UA saIIeIIS 
-UDDIOIUI SUONPUUINSA Pp SUMULIBOIA 9] IDULIOJSUI) B IIII}SIS 
-U0d gy0LId ane suQ, ‘Wed ane ,p ‘salieysudoIa}UI suON 
-PUIT}SO Sop SUTUeISOId 9] 19 ‘ed ouN_.p ‘sayjanuur ja saljans 
-Udl sajygnbua ,p sjuvinos saumtuesso01d sa] aus apurss snd 
SATISO SIBIOUAS JUN B IOALLIC .P JAUISSA JUSWIITLS9 189 [] 


SAIIBJISUIIIIJUI SIde}I «Sg 


‘ureuny [vides 9] JUaNINSUOD Inb dagINp sNsUO] op s}eleU 
-oUed So] IIDIOJUDI AP 19 (66H WAISBIT 39 ISOAD uOlas 
ulel) Ud UdTq elap OJJd) STaNUasSse SIATYOIy sap IMgnboe .p 
UOISKINO | JUdWaJaT[NOWIed — yUdsoid jUISUI,| SUOSSISIES 
— WOIp ddied ‘sJyeNSIUILUPe SIDISSOP Sd] INS so9puoj SopNyd 
sone ,p aua9U09 INnb 90 Uq ‘Wp JUsWoIdoId JUDaSUDNNY 
np 19 VCuy Np saguuop sz] Japlyea op Issne stew ‘Q[ QZ ua 
allessaogu vias Inb apoyjaw oun JoANOId9 .p JusUIaTNEs UOU 
eijowed Yqy un Ans deseq a]JorIed UoNeWINSa oUN JUS 
-9UR][NWIIS sINpold e jURISISUOD UOTISOdOId BY “ITUDAR | 
19 assed oJ oNUa UdT] dT OIIe} INdA UO, IS o[qesuadsIpuUI 
S92 OOOT UL, PP JUAWIOsSUDDEyY Np syyenb ve] op UONRITJLIDA 
op a3gnbua | suep NS§ 9] Ins uoNsanb oun ,p uoIsnNfoul /T 


0007 Ue] 
Ip JUIULISUIIIy J[ JUBUIIIUOD SUOTISOdOIg f° 


"WUWSUdIAI [9] UN Ja]Ndgxa assind ou 
uo | onb jURAR Nat] AOAe Inb yeQap ‘SJuv.SIUTWUpe SIOTSSOp 
Sop Ins gpuoj JUaUIasusde1 np s}daouod sa] Ins oI[qnd 
JeQEP UN JASIULZIO ,P UOISEDIO ,| JUDTRIDUUOP DUIS 99 Op IO] 
aun ,p uoneordde ua esttu ev] Jo UONRIOgEIE | “UoUUapgogid 
QuuonusU 919 & BI9D DUTIOD “Wy Un Anod solressod9u 
SOQUUOP $I] ITUS1GO ,P BNA Ud SJNLIISTUTLUPR SOLUSTURSIO Sop 
UONLIOGE][OS L] Ip JoINssv s op ulje ‘epeueD np onbnsneis 
RI INS LOT RP] SUWIOD JNeISISa] 91x90] UN JoANOIdde osIey 
IP JOOJJa,S DOUIPIAY 9)NO} ap IeIADP nevoing snsusD IT 
“‘xnoroepne doy sed sreur ‘xnaroepne suodos ‘UOSIOWY Up & || 
sUWOD “eprwin doy JanUOU as Wesinod [I,nb yey ne yO INI d 
STRU ‘JUDUDAISSaIse don Jopgooid jrelunod nesing snsusd 
a] aonb yey ne sed uou yuan o[jae1 uoNnednosogid eT 


JUBWESUSISI JO SjiI}eIJSIUILUIPE SIBISSOG :UBINeYDS 


“sauoud sap juaulassi[qria,| 19 sjauuosiad 
SJUDUIOUSIASUdI Sap UOI]D9}01d ap suoTsanb sap uoNnjosal 
RP] JURUIZDUOD s]lasuOd sap sUaIgoO Inod JaNUdIDUOD 
as janba] Ins joainyeu ouistuesio | og Wesnod Ja1wIap 
99 ‘(pIvOg SULIOWUOJY SNSUID) JUSUISUdIOI NP douv]IIdAINS 
ap [lesuod un ajsIxo [I,nb JueudjuIeu ‘UOUIS “s}UdWdI) 
-SI3a1Ua Sap adv] dnod a] auIa.UOD INb 99 Us JUaUAJaT[NOIWIed 
‘oyqnd np jgiajul,| op ajduioo juvua} yuepuadgpul star 
UN JIUd]QO ,P ONA Ud ‘JUDUBINILIJIUv QUUOTUSW UOU ‘(pIvOg 
MIADY PeuONNINsUy) [auUONNINsUl UdWIeXa,p [Ilasuod 
UN Jd}[NSUOD Op JOSeSIAUD UeLINOd UG “1d]N0d9 19 JOAIASqoO 
UdIq dp Ilessadgu Sa [I ‘presd oo YW ‘snd gj JaIonos as Inv} 
[L UOP SaT[29 IOs sjauUOsed syUaUIaUBIAsUaI Sap UONIQ}01d 
BT JURUIdDUOD sasayjodAy say ‘saIeH sUTIOD ‘neoIng 
Np soiped soy sduiajsuo] sindap juauustnos 3] dUIWIOD 


sasaujodAyy ¢°g 


“IOSIOAUSI PY Sed JUDLUDINS STRU ‘QdURPUA} 93}99 Ja19duIA} 
JUIILIINOd UONPULIOJUI | IP S9[9-SaISOTOUY Ia} sap dUTeUIOP 
3 SUP II} Op JOYS uN 9149,p ANA Ud sjUdUPUIAd SLIOJJa Sas 
}2 SJNVIISIUTLUPe SIOISSOp $2] Ins JURJIOd neaiIng Np xneardy 
SY] “XNVJUSWIOUIOANOS sSoulstURSIO SAP UOTNJOAY,| op 
anbysiigjoevsed Ind}ud] P| Ip nus} a}dw09 ‘saguue saureysoid 
XIP Sap SINOD Nv 9NjUIdd9NR Ss UOINUIWIp By] anb s]qu|quiasiesA 
1S9 [I ‘SaTVS9 JULID S9SOYD SNe $9jNO} ‘19 SdTUUDIEP SINIIS 
-njd sindap Januluip ap asso BU UONRUWIOJUL,| ap Indj9as 
a] Suep nesing snsudg np gyorew np ued ey “uoneW 
-JOJUL,| OP 91d,| B ULL} BT B AN UdIq San JuaIeLNod ‘neaing 
snsuag 2] studuios A ‘anbysneis ev] op xnequed xnvoing 
sa] onb ajduiod aipual as ap [anuasse 3se [I uowonbiuoy 

‘g[duioxa un jso Ud ‘¢ UOT}OaS B] B VaSOdxa ‘InoNdaUUOD 
np svo op opnia,J ‘aisuajur.s sayduiod sap sipual 
ap uoNesI]qo | nb 30 & aIpuayje,s nad UD ‘neaing snsuad 
np sgoons gf Jonyeag snod sasijyn xnej}UsWepUo} suOTeId 
SOP JUOIS S]UBWIDUSIOSUdI Op SajUBpUddepuUI sadINOS sd| 
JaiZa\ul Inod sasijin suakouwl saq ‘aja v ay[a,nb ajodouow 
a] snjd steuossp elas ou JUoUaSUdDeI NP UONNdaxa | 
‘(stewiel 10s 2] af[a nb 3sa Jue} Is) soIaJsueI) 31N9,p Said sed 
1S9,U [SIOIJJO JUSWasUDdeI NP aytfiqesuodsai ev] aonb uarg 


JUIUIIUUOMAUI | IP IURT[IBAING 7° 


"9SSIO SUBS JOIJISUDIUL,S JUOIADP DYOIIYIII ap S}OJJo 
Sx] ‘oyns vy ied stuiad vias jusWIaYoRya uleyIa9 uN,nb 
12 QOOT OP JUSUASUDDEY NL SAI] JUOS SLOJJo Spuvis say onb 
Jasuad ap JO9IOOUI 1S9 [T “JURVOdUIT ang WeJANp JuRUOW 
3] 19 SNUA}GO OQ IUDIVIADP SJOUNSIP SpuoJ Saq “[eUuUddEp 
JUDULASUdIAI 9] SQide sajuLOduut souUOsiod sap 19}994JvdI 
ap no sjaspnq sa] JoulIdwos ap uoeUd) RT B I9DUOUII 
yop uQ ‘jefoid np adinba ajua[[z0xa ,| 1y)1nboe ,s op yUOp 
anpie snid ey ayoR} LV] DINOP SURS Sd IIUDAL ,| INS JoNUBDUOD 
aS B IANUNUOD ‘OOOT UP,| IP JUBUIASUZDOyY NP UOIINd9Xa | 
asod onb stjap samne sa] sno} guuop jury “«xnoad sap xiid 
9] Jauinb sed ou» wp quswanne ‘«jrNd0fqo,] ap aduRIsUOd» 
aInsly SUING op sjulod p[ Ud ISI[ BsnoWR} eR] INS 


JHIafqo,| ap souRJsUOD ["S 


c8l 


‘saqdoud $3] 
y9 sjuvyoduit sjutod say JaJ9}1a1 Op aN sINOWAp [I “UIe.y US 
UdIg JULUDIUILUL JUSIOS YWQY 2] JUPWUIZOUODS xneArI] sat anb 
udlg ‘sjuaWassipnedde sap JUdLIOU! SJHVSIUTLUpe SIOISSOp 
Sop INS apuoj JUdWIASUddaI UN Pp JUIOd ne asTwW | JoIpNIE,p 
ANA Ud (666 WaIssa] 10 ISOAPIg ‘o[dwioxe sed) neoing 
snsuag ‘S'fQ 2] Jed saXojdap siuvyodut syojjo saq 


SATTANINAAD SALTAOTNd LY AAIVININOS § °8 


‘anbiun a1sajens 31n0} & snatiadns yuowanbesuyul 
JOI9Av,S yWeLInod sidyjnwu saisayeNs sun ‘saouev}suOdIIO 
SOP SUSIOAIP BP] QUUOP JURI_ ‘osvUUOT[NUeYSE,| SsIIdwiod 
K*Q1QZ ap uaWasUa.0y 2] Inod jusuISURI[NUIIs sepoyIsUt 
sinaisnjd sanbydde satop uo,nb yesnod as [I ‘ayyo 
uq ‘Tessa.p snssadoid 9] Ja1ajgo0e nod snjd no sapoyyew 
xnop JusWoURI[NUIIS JoAesso.p oyogduia U ual aonb 190}0U 
V ‘Vx OP aannyjoagd aisaieys eB] Janyeads Inod «10-uo]eI9» 
UN — GQOT ¥ I9I.p ‘suOsIp — 11UA1g0,p rowed (Q661 USTY 
‘g]duroxa sed) JUSWII[[OANOUSI SIAR UOT[NULYOE,P SUWIOJ 
SNOS xNeID9dS S]UDWIISUIDAI $3D IIOAIDUOD Op EPI, TJ 


‘JUDWI[[ONPIAIPUL SUTLULX9 9119 IOADP 
yweuinod uonsanb ey ‘(sawsaysap sionsenb ‘ajduroxa sed) 
OQOOZ UL, Op JUSULASUDIDY NP SIO] UONRSI[RdO] op sowie,qoid 
$3] cIpnosei Inod aspoyjswu oun julod ne aNIW P'Z'L 


‘(uleyi99 sed jso Ud ,U UO SIeU ‘IOI sopnN a9 
quarelinod presipayy ap soguuop soy ‘ney snd suuonusw 
SUUOD) ~atatfNoned uoNUaye oUN eId}ISsoO9U OJ 
JOD ‘(NUDADI JIQIeJ & osleyoUurW sdnois un e jueUdedde 
sjuvjua ‘afduiexa ued) sanbrewstqoid suonejndod 
So] Jae Inod spoyyeur oun julod ne sm E'ZL 


(-aqins ey sed sotredde juatos s}uou 
-oNsIdoIUS sa] anb sind ‘juswasuases np sytyenb ve] ap uon 
-BOIJLIQA OP IBVUUOT[NULYII,| 9p SBd I] SUBP DWIWOD ‘sd}SI] 
Sop Jude pUadapuUT sasl[Ral 31}9 SATOP SeUUOT[NULYDE | 
op onsed oun.nb yeunod as [y) “‘uoweaedde .p o1suNnu 
op sed juawayjanqiqey jUdLOdW09 OU SJIVISIUTLUpR SIOISSOP 
Sop Sassoipe soy onbsind ‘saydyynu sayrun e s}UdUIdSO] Sd] 
JUDWIIDVITJJO 19}1e.] INod apoujawi oun julod ne aNIAV 77" 


“SOQUUO][NULYOEINS JUSIOS JIeISTUTUIpe 
JaIyoty a] suep sed juoinsty ou Inb sassoipe say aonb aos 
OP ‘SJNVIISIUILUPR SIOISSOP OP S}II]X9 STONPIAIPU SUIOU Op 
}9 SOSSOIPR .P SUILSTPWIL UN ISePUOS dap aseq SUIWUOD JUDWIID 
Boo Jostygn inod apoyjyew oun jurod ne ameayl [ZL 


‘satduiexa sanbyanb 1o10a u_q 10) Say Sapsloge og 
JUDIVIADP dII]IGesiej op xnevi9Uas soug{qoid say] “aruusoap 
eR] 91N0} Juepudd UONdNAIUI SURS dIAINSINOd as 19 QOOT UP. | 
op WWOWIsSUdddYyY Ne SdIB9IUI BNQ JUSIVIADP O[OT Uv. | 
B@ separ stesso siomueid sayz ‘stesso say anod sdwia} 
ap snid ap sasodsip “juewaratpnonied ‘ya sivssa .p s1quiou 
pueis snjd un e Jopgooid vipneyj [I ‘awsipesed nesanou un 
ININSUOD SJNLIISIUTLUPR SIOISSOP Sap INS YPUo] JUSWIDSUDIeI 
3] DWIIOD “JuRpuddad “jUaUTASUade1 ONbEYO JURAR SaSI]|PdI 


L8t 


someurunfeid stesso sap nod Wo} UareIoIg}jIp suds 
-UddaI SVO ‘aINJONNs eI ap ona ap jutod nq ‘aseuuoT[HURYsE 
Jed 1aj}g[dwi0d so] ap 1dd10JJa,S 19 SJHeNSIUTUUPe SIOISSOp 
sop ins yedap ne sapuoj xneidads syudwiasuadal sap Jasi[vd 
vIpNey [I ‘OLOT Ue,| ap JUsWIdsUDDayY Np uUoTsIAgd uq 


xnedads syusulasuadayeOCZ"L 


‘(Z’€ UOTDaS-snos PY] B yLIDep efap) yuRJOduI sWUe{qold 
uN }IeIajuasaidai spauUosiad s}USWIOUSIISUaI Sap U0T}99}0I1d 
RT ‘neaanou oq “(ZG UONIES RI B JUOUIOAILIQ aLIDEp 
J][9O V OIIL[IWIs UOSe] ap) SaAIssaoons sansea Jed sjnen 
-SIUTLUpe SIdIssop sop Jotedde e jUaIe1a}SISUOD XNBAPI) Sop 
yednyjd ey] ‘anne | @ JUDUIASUDDI UN ,p JURSILJSTIES «JUSUDYO 
-NVADYS» UN JAINSSB .P ONA Ud SoUIaTqoId sureyII9 dIpNOsal 
Inod sailessad9u JUDIVIIS UILIID} J] INS xNeARI} SOq “UOTIN 
-UvYd9-SNOS UN B SUIOW ne ‘ase}sIdap ap saT[ae1 SApoUIoUL 
op uonvordde,, aonb isure ‘ney snyd sayoap soatyenstu 
-Tpe sadej9 .p 1UdS J] WeIAQGO[SUA TAINS JT ‘sJeNsruIWUpe 
SIOIYOY Sa] SuUBP JUdWIANbIuN No JUdWIdSUadAI NP SIIIYSI $3] 
suep juowlanbrun saiadai seo sap ‘ajqissod np ainsou ey] suep 
‘jnole 39 SJNeNSIUTLUPR SIOISSOP So] ddA JUDWOLIeEdde saide 
‘guyenb ve] ap UOTVOIJLIQA Op sTeySUdd}sod UOT]HURYDE,| 
ane ueinod yedep ap jutod a] ‘aruusogsp ev] ap sinoo ne 
TAINS O1}9 WIAD JURIOdUWII adv\sIdap op UOT[HURYSE UA 


0007 UBT 
ap JUSUIaSUIIOY Np 3.1 ssesIdap sp UOT[WUeYIY = [*L 


"yney 
snjd uonsonb 9j9 sed e ua,u [I,nbsind ‘soguuonueul 3139 ,p 
duiod Pe] JUaTBA SUONRAIJOSGO xnop ‘sUIOWIURaNY “sopdnynw 
sjnoelqo sap Jasi[val op oNA Ud SJIyeSIUTLUpe sJoIssOp 
SOIINV SI] JOSI[NN & PIDALUL NvaINg snsudad a jenbe] daAe 
sgoons np JuoIpuadap saya anua,p siquiou onbsind ‘Q[Qz 
ap JUIUIasUd.ayY 2] Ins saireyusuatddns sapnie xne yuenb 
SdSIOgId SUOTJEPULLIWOSAI SOP dIILJ IP I[LOIJJIP 1S9 [J 


010g Ad LNAINASNAOdY NV SHAILV THe 
SHAIVINAINATdd AS SHCALA SAT 
INVNYAINOD SHONANOASNOD = *L 


“JOIOURULY 
ya onbisojoysAsd ona op jutod un.p oilessao9gu stew 
‘ganbst1 uontsodoid — Q [QZ ud sajueiOduT soTUIOUOdE Sop 
Jastjeai op synoawoid neaing snsuad 9] onb Jastxe yWesinod 
DIVIVSPN IIS9}VNS 9999 ‘SIP IeIA B ‘slojaynoy, ‘Aaaing 
AWUNWWOD UROLIOWY,. op outueIsoid np sstuenua,| 
Jed ang-jnod ‘sjJyensturuipe sioissop sa] 1aja[dwioo snod 
puvis JUSWUURSIJJNs UOT[MULYSE UN ,p UONONpojd ey] J29UeUTy 
Inod sailessaogu SpUO] Soy MWUd}QO.p J9dIOJJo,S vIpNeJ 
II ‘pre. snyd ne cgoz ap Jaidwioo e ‘ayafoid yuauraja7dwi09 
‘jonuue Yqy un jurod ne aoW & JOSIA WRIADP UC 
‘sjuouaysnfe xnv a0urjsIsal | JOPOIE ,.p eOULIOd Nud}Uod Np 
}9 DINJDANOD PL] ap aJUdUPvULIOd UOTRIOT[OWUR ,| F Ss<ansnfuod 
‘QIUUDDEP PB] SP SINOD Ne SazIBANO Ja sagjadei saouatgdxa 
Sod ‘(666[ Wals3aT 10 ISOASIg Jed aBesIAUd a1jQ [QUIS 


6661 Biqueoap ‘ejenbua,p senbiuyoo | 


inb aumuweisoid) sajuaj[aoxe efap sanbiydesZ0ulsp sapoyyout 
Sd] JoIOlowe & QUNSap JUsUPULIEd oUTUeIS0I1d UN sajuRINOD 
sojgnbua ,p swmweis01d 3] suep 191391UI ,p [BNUASSA 1S9 |] 
‘OLOT Op JUaWIasUd.ay 9] INod ainjaANOd ap sapnie 
S9[ JONUDOUOD OP JUSIAUOD [I NO IJOUTWA}9p op wIyOWIOd 
sajutofuos suonesado ,p a1uas 99 ‘ai]no U “dIIeIISUdDIOUI 
apoudd ve] JULINP SIDISSOpP $99 JOST]NN xno ap JUOMeULIAd 
Inb sjQHeNSIUIUIpe SIdISSOp Sap INVJOANOD ap sounder] 
Sd] INS SJUDWIOUSIAsUdaI Sap BITUINO] I[dWIOSNR WOIJa | ‘syaey 
-SIUTLUPR SJUSWIIISISIIUD Pp JOIYSIY uN ddaev JuoWtIedde 
un ev sgide sed apaooid uo | onb no sanessturupe asepuos 
op aseq oun yedap ap jutod snod suuoid uo, and 


SI.ALB}ISUID.1IIUI SJQIfqo xne 
sajuBInod sajgnbus,p suueid01d np asejdnoy_ = _¢"9 


(L661) UINGPOOM 
19 [Jayxotuusy Jed ayoap 3sa agiuaiedde aspoyjow sug 
‘Inof ve adAjojoi1d un Jonysuod yuarelinod ‘(666 |) SUeYZ 
yo UdSWIOY], ep xnao swWUIOD ‘xneAR saq ‘Iny,pino[ne 
Josyyn e aloes snjd dnoonvsq elas apoyo ey] 
“€L61 Op (Apmis yoieyy 10exq) 1Oexa JUOWIOTIedde .p apnid | 
op UdXKOUW ne gsi[eal a19 B ajoTId Iessa,"J “LWoOLIa}sod & uOTNeO 
-IJB1]S IP SJUSUINIYSUI UIWOD SIATIVIISIUTLUPR SITQVLIeA ap 
dAIOS 9S UO] oNb Ja SJeISIUTWUPR SJUSWIdI}SISdIUD XNv SqD 
Rl Op sJUdWIANsIZdIUS say juoWIONbHeUIE}sAs ouedde uo ,| 
aonb gsodoid yuo (986[) uaInayds ‘saguue sanbyenb v & I] 


1101.13}Ss0d 
B SajeV.ijs suoT[WUeYDI,p jusWIoIIeddy 79 


“Sassoipe Sop Inof e osTu 
a[duuts ev] aonb suostes saujne ,p inod ‘a0 3a — a[BI90$ gILINDaS 
Rl IP SdIIVIDIJOUSG SAP Sa[[Id ‘JUSUTIT[INIUSAY ‘39 SNUDADI 
OP SUONRIL[DEP So] INs JULINSIJ sassoipe soy Jed ‘ajduraxa 
Jed ‘agjgfduioo ong weunod soyVY,| 9p wpeo of suep 
SOSSOIPR ,P SIV JOYS np uoyesipnn,T ‘apduyynu asepuos 
op aseq ouN.p a}xaQ}U0N JI sULpP SJNeISIUTUpe SIdISsOp 
Sop JOSI[NN.p ONA Ud WOJJa un.p Joinyeu yedap op iurod 
3] one Weunod (SOY) Adaing AWUNWIWOD UROLIOWY TJ 


aseEpuUoOs ap Saseq Sap uOHRSsTIUQ 1°9 


‘Ioatue Ap suakour sanbyenb 110A “Way un.p 
UONRSI[LAI P] SIOA B]JoINJeU odej9 oUN sIquUas NvaINg snsudd 
np sajusuvutied saygnbus sap uoNewinsa | ap 19 UoNdadu05 
| Op ope}s nev SJyeISIUILUPe SJOISsSOp 9p UONONpPoONUI TJ 


SHLNVUNOD SALANONA.C ANNVADOUNd 
aT INVNYAONOD SHONANOASNOD 9 


‘$}e][NSaI SUOG Op JoUUOP JUSUIII[I9I 
wesnod tnb yoyya,p a1ud3 3] Inod (666 [) 10YD 19 JaIOX9[V 
Jay[nsuod ‘juasgid ve nbsnf gia v J ou afja,nb ajueyodun snd 
dnooneagq I1uaAap }Op sjoUNsIp sowwieis01d xnep $90 aU9 
(aantsod a1810uAs vb] 39) UONPUIPIOOD PT ‘UOSeJ 91N0} aq “seq 
snjd via}nosiIp Us UO SUID ‘neoINg sNsudD Np sajuRINOd 
sajgnbua .p surureis0id 9] JuestA suontsodoid sop e sorun 


JUBWESUSDI Jd S}I}ENJSIUILIPe SIBISSOG :UsINeYOS 


ag JUdANad [RUUdDEP JUDUASUIIII NP sped a] suLP Sj 
-BI]SIUTLUPe SIOISSOP ap UONPST[NN | JURUIBDUOD SdapI SAD 
“suOTOVSURI] Sop dINsoU B INOL e STL S9SVUDUW Op 19 
SOSSIIPL ,P IIJSISII UN ,P UOTJVEIO PT JNOOLGo Inod stOAe elap 
JUD[QUIIS SASSOIPR ,P SVL JOTYOI Np awUasAs 9] JOIONSW ,p 
oNA UD NedINg snsudD gj Jed stidanus xneary say] “aod 
RI IQuja Ud,P 39 SdIIVISUdOIOJUI SOUATIOR Soy JotjI[duts 
op uaXoul Uog un ang Weunod uoneindod ve] ap anbnsiye3s 
d)SI3d1 UN,p UOTRIIO PV] ‘sonbsa\uvsIs saguuOp op saseq 
Sop piesa] &@ oyqnd 9] JdAa[NOs yWesINod anb saartasel Soy 
gisyeyy ‘uoneindod op janied ansi3oa1 un ,_p UNPAID PT SIOA 
sed UN ,p JUDWII}SOJIUCLT ILIISE Ss |] “OLUUDDEp PI Ip siNOd ne 
NSS ep uoT[HUeYDE UN,p IAINs 9g] ‘ayduoxa sed ‘suolgpIsuoD 
“SOATILIISIUTLUpe SoQUUOP so] said .p s}UdWIdIQUIOUEpP sop 
‘SUOTIORSURI} SO] INS S9PUOJ ‘sJOoIIP sjUsUa\snfeI op sUa}sAs 
un e a9uue side sguur jusmatedde sae sayjanuue soguuop 
ap suaysAs un.p ‘ayqissod np ainsau eR] suep ‘Iassed yeIASp 
SJNCIISIUILUPR SIOISSOP S3] INS 9PUOJ JULINOD dIIe}ISUIOIOJUI 
owueiso1d 3] ‘ouIa} BuO] e ‘nol] owetmenb ug 


SUOTJIESUL.]] SZ] INS 9pUoJ BUIAJSAGf*S 


(L661 UINGPOOM 
JO [[eyoIuUUsy,) preOg dAJOsay [eIopey a] Jed jutod ne 
9ST ((JOS) SsouvUL JouUINsSUOD Jo AJAING) SINSJBUILOSUOD 
SOP SdOURUIJ SI] Ins B[qnop asepuos op aseq kB d}gnbus | 
ap Svd II SUP DUIS ‘ajURINOD aJgnbua,p sjofoid sIOAIP 
Inod yedgp op qutod ap IAJas Issne welinod aq ‘uone;ndod 
PR] op aag[dwios-tsenb no ajg[dwio0d siny9ANod vI Jast[eal op 
anb 1oin]{d ssguuop ap s}UsUIE[9 Sap NUS}UOD J] Jo}USWISNe .p 
yesas jedroutd Jnoafqo uos ‘vqy np [eyuswepuoj ydaou09 
ne JUIWIIeNUOD “sajuRINOD saygnbusa,p 3a saileysuss 
-IquI sajygnbus .p sonbissejo sowmueisoid say] yUSWI9}99IIP 
JoAndde .p sajqndaosns xneaey sop onb tsurte sjuepuod 
-9pul xnevAed) Sop sUOdWI09 UONTsOdold aya_ ‘ny ,pinolne 
Inof e ajo! op 19 NedANOU op JOUTWIeXa.p UO 91}9-InNEed 
Wess [I.nb sotpa1ojul SOANVISIUTWIpe SdgUUOp op sUOTIN 
-UBYO9 ,P S[QUIdsUd UN JURUIIDUOD asnoatjIquie snjd dnooneaq 
uontsodoid oun gnuLoj & (6/6) UaINayos ‘sue QZ vA IJ 


syHeysturupe 
SIIISSOp dp 9.1d9}UI aNbysyHe}s uoTWUReYyIyY = ¢°¢ 


(6861 
Jaye 30 eylezD) ated us asteas aia elap v e[I9 QUIUIOD 
‘AQ & Jauuolssajoid yUapsogjue .p NUNUOD UOT[NUYDE | 
‘gjduraxa ied ‘suosip ‘sadeja sayyed sed ‘uowafenpei3 
a9]Nd9X9 O19 OUOP IeIASP Jd JOUISeUIT,| WeLUNOd ou UO .Nb 
aouaned ap ja saoinossai ap snyd sJazIssao9u yeunod sdura} 
np [i ne juanjoas nb soanensturupe soyun sop sauedde 
B JULISISUOD DYOR) BT “allessaogu Jsa apses ud osIwW oun 
‘slojaynoy, “(Sinope issne ang-jnod seul ‘WSs PB 19 SUI. 
B) XNeIOpay SJVNSIUILUPe SOUgISAS Sone XNv NpUday? 3139 
yWeLNod [eurlpnysuo] UOT[HURYDE 199 ‘asATeUL DIQIWIOp UY 
‘(a]Jo10du19}) ajuTaIdWa onsUO] 
Sd] DUN JUSUIDAT}OJJO WesINpold uoNeNstUUpY AWINIIS 
eroog eT ap (adwueg AlosI_Y YIOAA SNonuNnUOD %1) 
%| B S[ouuotssajoid syuspsogiue .p NuNnUOS UOT[HULYIE | 


O8t 


B [CUIPNITZUO] UOTTHURYDE 199 op ase[dno9d gy ‘Wey U “sAed 
XNOP SOP SOATJLAI SaT[Ie} SO] QUUOP JUR}I9 ‘a B UOT[NURYIE 
un Jed jrelinped as ‘stup-syerq xne ‘nb “(p66 ] UPYIND-ISIA 
19 soXka7]) |], SNUOAAI Op SUONBIRIDEP Op YI & [eulpmusuo] 
uo][WuReYysa uN 991d eB epeUuRD onbNsneig ‘sdwosuo| 
sindaq ‘NSS un juapessod nb sauuosied say sajnoy 
Ins sonbrydeizoulap sjuswsustesual Sap yuaTUOD INb JOIYyoI 
‘UOneNSIUIUpY AWINdIS [eIN0S kB] Op JUSPMUNN Joyo ne 
yesotedde uo | anb ‘sayeostj S99UUOP AP SJUDWI9I}SISIIUI ,P 
[eUIpNysUO] UOT[MWURYSE o[duUIs UN JO9I0 Jed JgDUDUTOD 
yeunod neaing snsuag 9] ‘epeued np o[durexo,| JURAINS 
UW ‘SOAIISIUTLUPe SO9UUOP op xNeUIpNyIsUO] SUOT[MUeYIE 
Spuvis op Jo[quasse }RIADP UO ‘NdI] SUIGIXNEp UY 


SIAUBAYSIUTUIpe 
soguuop ap [eUuIpNyisuo] UoT[WUeYDI puely) 7S 


“uly 
snjd onbiydeis0as neaalu UN & S}USUIOUSTOSUdI Sap ITUd}GO 
JO SOINIOX9,.] sIpuaje yesnod uo ‘sarqruodsip spuoj soy 
39 sasinboe saguuop Sa] UOTas ‘aUBI] Op Ino UY ‘Zp UOTIOS 
PR] & VQUUOUSW sj}V1q So] Inod xnvj}0} sap ‘UOT[NURYDIE ,p 
opeys ne sulou ne “yqYy uN Ins sepuoj ‘a]januue uon 
-PUII}S9 | SIAINSINOd WeIASp Neaing snsudad JJ ‘1N0} JURAY 


Va Op sjenuue 
SJIVVAJSIUIUIPE S}UIUIIIYSISIIU SEP anAVg ['S 


“SOITVISUIIO}UL 
suonewnss sop sumueisoid ay Inod juawasarnonied 
‘QISTUUOTNIOAD JIBI}C.NS SUN ISIXO SOATILISIUTLUPe S99UUOP 
op uoNesI[NN | suraou0d Inb 99 us salreuUOTNIOASI SeIs01d 
op uoljestTeal ve] ‘anered assind vjao onb jexopeied issny 


AULV LISNHOUAINI 
NVAAIN NV SHONANOASNOD  “S 


‘9661 URE[DIN 
}9 JoyeD Joy[Nsuod ‘epeueD ne jUdWIASUade1 Np sIped 


9] SUBP SOATIVIISIUTLUPe SoQUUOP ap UONPRSITNN,| Ins 9}U9991 
opnje oun Inog ‘sajyuewodurt snyd say UO] ap ang JUe|quUIaS 
SOQUUOTIUDUUSNS Sd9pPI XNap Sz] ‘SIOJAINOT, (666 Wass] 
}9 ISOAOIg IIOA) STUP)-SIeI XNV SOATILIISIUTLUPe SoQUUOP Sop 
INS 9PUOJ JUSUIDSUdDaI [aNIUAAP UN INOd UTeLIA} 2] JoIedgId 
quarelinod QQOZ ue.| ap jUusUIasUd.dy ne soqvordde 
QYDIBYIAI Op Sdapi sane sasnaiquiou ap “JUdWaT[oINIeN 
"$]e][NSoI SUOG Op oUUOPp IAINs 9] aNb NVA UO | IS ‘IAT 
-nored uonuane oun JUOIa}LISU (JUAWasINOquIAaI Np uoTyed 
-1oue red) ygid un yuapuevuweap Inb 39 9use3 NUdADI JT INS 
JOU ,.p Ips Np yuatolyauaq Inb sjuvsepoep sa] “souuosiad 
$90 ap aseisidap ne sjanuassa sJUSWI9T9 Sop JUOIIS UOTI} 
-ULY9 ,P UONRIIJLIDA ap Jd NUTUOD yUoWIOLIedde ,p snssad01d 
So] ‘asevuswap juo Inb guses nusad1 a] Ins jOdUII.p 
JIPeio Np sallelolyauaq sop ang weunod ‘syy | op ssguuOp op 
saseq So] suep judINSTy Inb steul ‘feuusdep JUSWIdsUdO_I Np 
SIO] Ssanbuvur souuosied ap aIQUION “(SYI,[ ed sayjinodep 


621 


juatos ou sji,nb jueae owiguUI) UONeNSsIUMUpY AjLINDIS 
[e1oos ey Jed xnqj red stusuey ang Issne yuoreunod sye190s 
DLNIS PI IP SOATRIOIJ9UIQ Sd] ANS 19 SSIQUNUIDI SINO|[TALI} 
Sd] INS SJUDWIDUSTOSUdI SAT “10) JBOUDUTUIOD assind JUSWISTI 
-edde | onb urye ‘Sy, op sratpnoned say ins ateul Jory 
np sjanyiqey sjreNXe so] JUOWOT[oNsSUSUT SATOSOI NeoINg 
snsuag a] enb gpuewuodel iso [I ‘uawgsIogid snig 
‘xn op odiourid 9] uojes neoing 
snsudd a] Jed sayen ong juateinod 3a QOQOT sUUIOINR | 
ap ingep ne sovjd ud JUOIOS sollessod9U SY]. op sjnen 
-SIUILIPR SJUSWIONSISOIUS so] ‘adioutid ug ‘oJURSTJJNS 911 
-olid oun ap10998 IN] UO Is ‘WUdUapIdes ‘99 10 B66 JOQGa MA 
19 J9[IeS 19 CGT NCA 19 JOQqaAA “JaTIeg Jed stojy xnoap 
saXol duis efap spoyijew P| UOTAS JIeJ OQ WeLINOd 3e1q,| op 
NVOAIU Ne SaTessadgU SJUOUIAIQUIOUAP Sap a1eIPSUUUT LOND 
-IJLIQA BT “allejIsudo}sod usWexd JNO} ap SIO] asnayjaWIoId 
isd JUdLINOUOD SUIT YOY un,p uoynsexe,] ‘sowiaysAs 
sto @ apoyjau oun Jonbiydde Mmo;NoA sues sUIgIW 


1€77],] 9p NVIAIU NB yUdIINIUOD anIed VOY TTP 


‘sonbneurg,qoid jUsWIdIO1] 
-nonred JUOIJas JURINOD SOI} O][UeJ Op WIOU UN dak Safdn{nNwU 
SOSSOIPL ,P SLO SI] ‘NSS SI] SUBS “sNSIqUIe syeI[NSaI sap ane 
-jnod eiinpoid ‘xnaynop seo soy suep ‘39 afloyip sntd dnoo 
-Nb9q BIAS SJNVIISIUIWIPR SJUSWAISISdIUS sap juoWOLIedde | 
‘guyenb ey op UONROIJLIDA ap a1leyIsUdo\sod ajgnbua | e sdRI3 
snudjqo NSS Se] sues ‘oyyenb ayney ap aij JUDATOPp Sast[eal 
sjusuatiedde say sno} ‘syey[Nsai suog ap suUOp 9d) sWI9}sAs 
eB uoleWNsa , onb Inog ‘saidwiod sayqnop say SUIWITS & 
UO JUOP SJHLIISIUTLUPe S}USIUDISIZAIUS Sap SdWIeS|PUIe 9)S1] 
PR] & 19 Up JuoWIdold yUsWasUad_I Ne ‘ayI[enb e] ap uONed 
-IJUI9A op UOTMULYDE,| & JUaIeIPUOdSaLIOD SoUIa}SAS SION SI] 
‘(€661 SUCSITOAA 10 AYSALISP'Z,) SOUIQSAS SIOI] INS JURPUO] 9s 
Ud SUOTBUINSS sap oiInpold op JaXessa.p (BG66] USINIYIS 
‘gjdwioxe ied) sdwiajsuoy sindap spurwi0del 3s9 [J 


SIUI}SAS SIO.1} ANS JI|PUOJ UONVUISY [Zp 


"JUDWIDATIDOdSaI ‘1 QOT SIeUU 
Ud 19 YOOT sIquiasep us sjInpoid ang JUaAtop sjenbsoy 
‘JUDWIDIQUIOUSP-sSNOSs Np 3}dWIOd IUD} Bp BNA Ud SdgBIIIO9 
SUOTRUIISA say Inod jd neaing snsuddD Np sje1oyjo syusw 
-d1quiousp Sa Inod sasi[nn xnao anb saite[ NWO} SOWIQU So] 
INS JOINSIJ USATOP Svd dIjNe | Jd UN] SUPP SNU|}goO sje] NSOI 
Sd] ‘SIdBOTJJO JUDWUDUTATd JUDIOS SaINsoU $99 onb INog “sTaId 
-IJJO «SJUDWIdIQUIOUSp» sap UdAOLU Ne UOTPOIJLIA-3.UOS 
R] Op SULJ XNv QOOZ UL ,| Op JUDWIOSUDDNyY 9] JURINP Yay un 
INS S9pUuojJ DJUIANSAI UONPUINSO oUN sINpoOld (Z 19 soUIaISAS 
SIO]] INS 9PUOJ JUDWIDIQUIOUSP-SNOs Np UOTWeUISd OUN ITU 
-31q0 asstnd uo nb ays ap ‘aiyenb ey ap aireytsusoj}sod uon 
-POIJLIDA PT INnod sauuUOTse[as SUOT[HULYIE Say] Inod NS¢§ Se] 
I1U9}Q0 (] B JUDIsIsUOD SajyURLIOdUII SsapI XNaq  “sasnaiquioU 
JUOS JopuROda yIeLINOd uO] anb sayqryea sapnie sa 


sopnj9,p suoisodo1g Zp 


‘unoevyo Inod Anajeva op JusWgTS UN sIINpoId 
op OUOp ‘jURISIX JNeINSTUTUpe JOaqo UN & UOTRWIOJUT Pp 


6661 Biquacep ‘ajenbue,p senbiuyos | 


Jnosfgo un Jalja1 ap sudAouwl sap JOAnoN ap ‘atqissod 
Np dINsowW ek] sup ‘[aUassa jsd [] “saNe,p onb Jasiyeal 
B soploey snd jUsWUapIAg JUOs stWoIduI0D suTeLIaD 
‘9U-NBOANOU UN JURICUIOD SaT]MULJ SAP Sd]ULINOD SassoIpe 
xne $g00e,[ Isule yWeipusngo uo.nbsind ‘apuesis ‘inapea 
B] 39 JOsg] IS NvapIej 9] ‘IO] “su-nvaANouU sap sjusIed 
xne NSS so] JoAOAud INod uoNeNsturwpe 9y}00 Jed sastpnNn 
sa[ejsod sassaipe ,p sIaryoly soy UoNeNstuMpy AjLInoasg 
[BI90§ *$'Q BR] ap saidne s1ua}qgo yelnod uo, enb anbrpur 
oAg ‘Vy UN,p a[anjusAg UONNDEXa,| INS £66] ap od 
-devi uOs sued ‘S}NOD sap jd S]JUBUDAIAIUI SaNe XndIquIOU 
op aj3dwiod Iu) eipney jt, nbsind ‘syoyja,.p dnooneag viasixa 
suortsodold sao ap aJAna ud ast P| ‘ayqestjeas anbrond 
‘JULISIXO NvapILs J] sed resayUSWISNe ,U INnb UONNTOS 
QINI|[[IOW V1ODUd UN IBIAS ‘SONSNeIS JOgeT Jo neaing ‘SQ, 
np sstwuanua | Jed ‘aseugyd ap suaysAs Np S[aLSowLy xneL 
-R[PS SJUDWIIISIZOIUS XNv $QdOR | “JUSUTWIAPIA_ “s}USWINDOp 
$99 Ins JuaInSy nb sassaupe sopdnynur xne onp aynSiqure | 
aied opueis ud yeIOUIWIITS aJep 91100 op ynole.] “Vay 
uN,p ona ap jutod np asnanjondj san pesos o1ed op opotied 
IQUWIOP LI Op ayep P| JoINSI osey Ap ulye (epeueD nusady 
2P r-L NO SYI.1 8P Z-AA B[NULIOJ) aysed goon oun Jed 
Sol[duias UONLIQUNUISI Op SUONRIL[DEP SAP UONOIJIPOU P| 
‘JOST[eI B I[LOIJJIp Sar) JUWa|Geqold j1os e[90 aonb ust1g 
‘SISSOIPL Sd] JOIJLI9A op xnotoeid usAOU UN JUSTeILJO 
sajqnd soiguinu se] ‘Wo1oIns oq ‘ajygnbus.p yusueuwad 
oWWeIZOId UN suUep “JUOWdINATIDI[N ‘Ja JUSWIASUdDAI 9] 
JULINP SJUSUIAI}SISOIUS sap ase[dnoos np snbysnejs yuowiNny} 
-sut nb jue} ua InajeA Ing] Japgoxe nb snjd qreunod sossuinu 
$30 ap SANPIISIUIWIPe UONeSI[NN,| sp JUoWApuel a] aonb 
aiipaid ynod uo ‘sed yno} UY “Sd]UdI9I SUIOW SaIsOTOUYII} 
sop uopuege,| & sansnfuod o10dua sed jsa,U aJle[N{[90 
suoydgyai np uondope ,| ‘stuq-sieyq xne sulow nq “I1ua}qo 
Sa] ap outed ey] ourgui puenb yrerpnea e799 steul ‘sames0duia) 
SOIQUINU S99 dp NILA PI IPUdI WesLINod same[ny[ao souoyd 
-9[9] Sp JURSSIOIO O3eSN JT *(A1}S9119} BUSI) [BUUOTUSAUOD 
[enuaptses suoYdeya} op OJQWINU UN snUdAdI ap SUOTIeIR[DEp 
sop soguuop xne Jojnofe Issne a9-jned yeunod uC 
“Sa]JotuapIsal sed souaptag 
2]NO} ap jUOs du Inb sassoipe sap sed ds] SULP JOOIIP TAINS 
un }IeJoyoduios tnb sysoidde — ainayjrow ang-jned yo — one 
aun asodoid (166 [) Ag ‘uepusadsas ‘juaprIAg s[duaxe uN Iso 
‘TQ6[ Ua ey 919 B P[9O SUIWIOD ‘ayduexe Jed ‘nusAol op suon 
-BIR[IIP Sd] ANS JUDINSIZ Inb sayjanuUspIsel Sassoipe sop uO 
-u9}g0 "J ‘JueYyouRy s[qnop ke sada oun ,p 118k ;S [I UOUIS[[OI 
-NjWN “jULISIXd JHeNSIUTWUpe OUTAISAS UN B (OXOUUOD NeapIej 
3] 19) soguUOp op JUSUIETS UN JajNOle B a}SISUOD SoI[2 OUD ,P 
oun J “syoensturUpe saua}sAs sop sain sonbysneys soguuop 
ap syinpod say suodey sasnoiquiou ap Jarorfsuue jned uC 


UOneULIOJUI,p 

sul Sap & UONHeST[VN Ang] 1a.1019wWe ,p 

INA Ud SJUBJSIXI SJVB.AYSIUTUIpE SaUta}SASs 
Sap UOYLIIpOUl ap JUapade1d uN 139ID op Tp 


“SJIBIISTUTWUpe SOWQ}SAS Sop 
seo 9] Suep Jasuod ap uodsey 99309 II]qQuI9 Inod ‘sue stot) no 


JUBWSSUsIAL Jd SjI}euJSIUILUPE SIBISSOG :UsINeYOS 


XNop Sd] Sno} jusWIaNbIpotiad sajadai ‘asueyoe ,p SoUUUIIS 
-old sao aonb uaXouw AnaypIow un jI-yeine A ‘IO “(9861 
SUIWIIC]) SOUIQSAS Op soUId} Ud Jasuad jee} [I,nb yp e 
SUIWIOG “asv]s Ud S99QAOAUA SoUUOSIad say Inod Jajuasaidal 
yelinod asuvyoe,p o1ues a0 onb enbusneis uone;nuins 
RB] B Josuod op yyyns [J ‘Jot[dy[nu soy ap sressaogu 3S2 [I 
‘seo Ino] UW “STUP)-S]eIq XNv xNoIqUIOU Nod JO} JUOS d1UdS 
39 ap sadueyoe soy ‘s]uenbeyy UOS syNeNsTuNUpe souIsTU 
-e310 SdJ 39 NvaINg 9] BNUA.nb Isurle ‘epeueD onbnsijRI1¢ 
QP SUOISIAIP SASIBAIP Sd] OU s[oUUOTssajoid op s]UdU 
-OANOUW Sd] NO ‘epeuRD Nv UONENIIS P| B JUSWITIeNUOD “jUr} 
-10dul snjd s109Ud RIAs S9UIIDUOD SOUUSTULBIO Sap SUONRI 
-9d0 Sap SddIAJas Sa] Suep asuojold a8e}s US NeaIng snsuad 
Np sdAo[dwid ,p 1OAUd,| IIP-B-}S9,9 ‘ASIOAUI BSuLYIe "J 
‘sonbysijejs Suly Sop & UOTeSI[IN Ins] 
@ 19 SaQUUOp SINgJ B satqeortdde sasayjodAy soy Ins xnorogid 
SJUDULISSIOIIL[I9 SOP JOILJJO sJyeNstuTUUpe souIsTUesIO 
sap saXojduse sa] ‘Inoja1 UY ‘“satqissod juapual synesstu 
-ILUpe SoUa}sAS sina] anb UOTRULIOJUL,p SIDIAJOS Sap DUR} 
-1Odui! | IIstes & Japre Sa] ap yess sjyoefqo sap un J ‘sowstu 
-B310 SOINe .P 19 VSS BP] Op ‘SAI. op spuensturwupe sss1yory 
Sap sajqesuodsal souuosiad sap sapoted sayinoo ap inod 
neaing snsudd ne 98e}s Ud II]JIanooe kB Ja}SIsSuOD WeIINOd 
yofoid a] ‘apuow 9s] suep jnoyed op juRUdA ‘sJHeNSIUTWIpE 
SOWSTURSIO .p SUOTRIDdO Sap SddIAIAS Sap SeAO[duUD sUTea9 
e anbyeqqes 93u09 ap dsInog sUN JLIJO WeNod nesing 
snsudg I] ‘UONRIOOssy [eonsNeIS ULLIOWY ,| op (wieIs01d 
SMO][2J) SYDIOYSOI 9p SIOISINOg ap suTUeIZOId Ne ILINODII B 
PWeRIDSISUOD aseyd d][[aANOU 9999 JoIg[9I0R8 _p USAOU UL) 
"SOANRIISIUTLUpe SOQUUOP Sap UONRSITNN | op ‘ajoouse no 
‘g1URAIns aseud PJ & ‘aIsoleUR | DIAINsinod inod ‘1assed suo 
-op Snou ‘JIp JUDWIAINY “(€66] CASIO, 19 UsINIYyOS) «uoneuU 
-IOJUI ,P SOWIISAS UD SJLIISIUTLUPL SOUIQISAS» Sd] IOWIOJ 
-SUPI} B JO}SISUOD JeIADP (NEIANOU NO) Ja9eI JDAIqQO J 
“an[OAgI Iso anbods ay199 
‘sie, ‘sonbusneys suly sap & SJHe.NSIUTWUpe SIOISSOp sap UOT} 
-PSI[N | Op aNa][I9Nd ap 19 asseyo ap aseyd eI ap Ja[JaI 9] ISO 
aseryd 97199 ‘UOU NO dsNaINdYIeU HWOS aT[anQ ‘(ajUvISIUSPp 32) 
D109 IIOA ap UOSLJ 93199 ap BdUSNbgsUOdD FJ Sd «SSATIVIISIU 
-IUIpe SaguuOp Sap UOT}e}0[dxa» osnainoyjeul UOISsaidx9 | 
anb jUuoIpustjnos sunone.q ‘ayquiasud UOS sURpP dUIQ}SAS 
ne nb 19jn{d yusuUaNgO sjI,nb saguuop ap syinpoid xne nb 
juasuod ou JNeISIUTWUpe NvoINg Np INd1I9}xa,| B JUST[IeAe] 
nb sjauuotssayoid suatonsnyeys say ‘uaanos doly “soateNstU 
-llupe saguuop op uoresI[NN,p yofoid yno} ap 99 JUSWIITS 
un jUuoWes9 Jso uleuNY [ede np uONeIOI[oWR /T 


sao dua ,p sasuevypa sa] 
JUBSIA UOTV.19d009 ap S3}UI}UI,p UONeIOGRIY E_C'T'p 


“QYOIBUL UO }S9,U 91]Ne | TU 
uN,| lU}yq “SaQuUOP Sap aILINOVs P| op jenidaoued yo onbisAyd 
USTJUILUL J] SGO[SUS SOANLIISTUTLUPe SaQUUOP Op SOWIOUS 
soula}scs op Inof e anu} ve] ap nod aT “neaIng np saXojdwia 
So] oaae,nb tsure ‘orjqnd puvis np saiquiou soy jo sjueU 
-OAIOJUL SIOAIP 99AV INapUojoid ud UOISsNdsIp ap sadnois 


8Zl 


Sg] Jarfdyynu ja uotutdo ,p sasepuos sa] JArNssnod Issne ynej 
[] S@AeNSIUTWUpe sadUUOPp ap SIOIYSI Sas sno} e sanbrydde 
JUIIOS SJUdUa[Ze1 sad anb nod sairessaogu suonneoesd 
Sd] $9]N0} sipuaid jlop neaing snsuadg YT] ‘sayeosty saguuOp 
Sa] JudaTeIDads jno} JUaSIA INb saguUOP Sap [OAINS 3] 
JURSIPIOIUL IO] auN,p UoNdopr | & QUdH UO (GOGH USINOYIS 
JIOA) Saguur sinaisn{d v& A [I SaWaANodep SY] ,| ap seXojdura 
Sop Jed sastwuo0d suotjoRIjUl Soy ‘WeJ UA ‘safqeigu[NAa 
snjd ang,p sauuosdnos ‘surow np ‘no suonejusd) sasnoiq 
-wou snjd op e stuinos SuOp jUOs saXo[dua say fsoustu 
-0310 SAP S[ANPIAIPUL SIAIYOIJ Soy onb sasnaroaid snjd yuow 
-anbasulul JUOS SJNPNSIUILUpe s]USWASIZAIUS Pp ase[dnoo 
np juainsai nb saguuop ap saseq say aonb areuuodal ap 
juewodult 1s9 TT “Wy uN,p sgoons ne sfqesuadsrpul yUSWIgT9 
un }So SdgUUOP Sap UONDIIOId BI JOINSSY “SOATRIYSTUILUPe 
SOQUUOP OP UdIPILS Ip SUOTIOUOJ SOTJOANOU Sas ap aJULIZIIUI 
anied airey WeIASp WOJJa,p suas 90 ‘yIeJ uq ‘“aylnogs 
ap synisodsip xneaanou sey aanaidg | B ajewW Inod sousa}xa 
SINDIVOTJLIDA IP JOUIQVD UN, P SOIAIAS XN ILINODAI WeIAIP 
II ‘B] Joisor ua sed yop au [I sIeUr ‘(666 SAIVH 19 YAPIO) 
ANPIISIUILUPe OUISLIO .p sonbrydeisowep saguuop sas Inod 
QSLINIIS 19 JULAISAI $QOORV ,P JUDUSUUOITAUD UN 9919 B NvaINg 
SNSUdD J ‘JUSWMUIDDOY “sdguUOP op sIquIOU pueIs snid UN .p 
UOTIISINDSe [| SOA ITed ap JUDLIDJSOJIULLU BA SOATILISTUTLUPE 
saguuop sap anbrsXyd ayinoss ve] op uoneiolsuwe /J 


ajjenjdadaed ya anbisdyd aytandag ZT "fp 


‘asodsip [I JUOp SargIoUeUly 39 SOUIeUNY SIdINOSSdI 
So] O9AR JOWeN JUoWOUIZJd ynod sou jI,nb soanenstu 
-luupe saguuop ap snjd efap ireua}qo nesing 9d] “USUUUI909I 
e.nbsnf ‘anb muajnos wWesinod uo ‘yey uq “neoIng snsudg 
NP SOANVIISIUTLUPe SaguUOp sop oWUeIsOId 3] JUSWIdT[OU 
-UONIpeN sNay as anbne s[oejsqo ‘ausa}sAs 99 IUdINOS ap 
INA UD SOITLISUIOIOJUI SAUL Sd] JULINP SPU} Sap JoJaspnq 
ap SUSAOW So] SNO} Jed 1991OJJO S$ WeIAVP UO ‘sed JNO} UY 
"JUSUUaTes9 
SJUVLIOGUWI JUOS SOPUSPIAIP Sd] 39 S}QI9IUI Sd] Ins s}UOU 
-O1)SIBIIUD SO] SIU ‘QOOZT Uv, Inod s{qisnejd stwodwos 
un jUsWgINsse ajUasaidai Inb yedap ap jurod yuajaoxe uN 
1SO ‘WJ 919 & LID DUILUOD ‘a[BIDOS dILINDYS P] 19 UONLIDUNUIDI 
R[ INS SO9UUOP dp SJUSWANSIZIIUD Sd] SNO} op UOTUD}QO , J 
‘anbiuode[9 OWIOJ sNos ‘1d-xndd op UOT[MURYSS pueIs UN 
SUIOW NP NO ‘sagUUOP Sp SAMIEU SIOIYOI SI] SNO} I1Ud}GO ,p 
QPULLUWUODAI 1S9 [J “"NUDADI Op SdlIO39}e9 op d1QuIOU puis 
snd un oinjout A ,p lye SauleyUdUU[9 SdQUUOP Sap NUd}UOD J] 
JUSUZ[VUISIVW Ja}UOWSNe .p assodoid jUSWIa]e39 $9 |] °9 19 
¢ SUOTIONS XN UIO] SN{d S9pURLTWODII XNRUIPNISUO] SUOTIN 
-UBY99 XN IIISIIUI Sd] 39 DJUapadeid sguur | soINpoid suoy 
-BIR [IVP S3] IIU9}QO Issnv IeIAOP UG “SY],| Jed sastwsury 
soguuop xne gynole aj Wernod nudjuOod Ing] 39 souRIOd 
-WL.p snd ua snjd ap jyuarainbor ‘yreyxa | SuBp sasnyouUt og 
Jnod pie} don sayinpoid ‘saatpsey suonesiepoep Say “SUI.I 
op Ssdo[NonJed sap suoNeIe[Oap Sop IEW JOIYOI NP Weyxo 
UN JUSUIIIII[NSaI JUSNGO Neaing snsuad J] ‘696 sIndeq 
“nesatu jney snid ap saXo]duss .p 
uonedionied ev] oaae ‘ajuarayjip oyooidde oun juasixa 


LLY 


‘anbnijod ap syusugja sap juswodui0s inb ‘sajueyoduit 
snd suontsinboe soy ‘sjuejndexea saXo dud ,p UONUSAIIUT | 
jusWanbriun juayIssaoeu ‘ayeinpgooid 19 anbiuyse} ainyeu op 
‘sinofe sjnad say ‘neaing snsuad oj ed sanuaygo elap sayeo 
-SIJ SAQUUOP ap S}e[dw09 ssatyolj ap UONISINbov ,| WOs “Uo 
-910ut jad sed synole sap 10s ‘SOWIO} XNAP INQADI JUSTeI 
-Inod syj,| Jed saynpoid saguuop ap suontsinboe saqT 
(L661 Ag 
JIOA ‘sJUdUBUBIasUaI ap sn{d Inod) uoNe{ndod v] ap siatpno 
-ed sjuauses sap inod sanbiydeis093 sjuswoustosual 
SINS|[IOW ap JUdsstUINO} sjI,nb sored yuswajdunts snuajqo 
Ng DUIQUI JUSTeIADP SIOIYOIy suleyao ‘stojieg ‘sdussy 
a] suep stogid sjyusuow sap e onbiydeisoe3 uonesaise .p 
NVIAIU JIQIVJ UN & SJUDWIIUSIASUdI SUD OP IIUINOJ JUdAIOP 
SIDIYOY So] ‘nat] swetxnep uq ‘uoNe[ndod zy] ap «ajquiasud |» 
JUIIANOD ‘JUUIBATIDATJOD ‘Inb saaneNsiurupe soeguuop 
IP SIAIYOI Sap Ja91O ap IIdIOJJo,S WOP uo ‘nary JorWsId 
uq ‘soddAy xnap ap juos saouanbgsuod sa] ‘saguuop sap 
uortsinboe | euzadu0d Inb 30 uq "3814, ap Injao aonb uy snyd 
dnooneag uoneSar8e ,p neaaru uN B Sanuaigo ang IAAIOp 
anbrydeis0a8 Juowsov|dwia | Ins saguuop soy ‘JOINsIp red 
asednosep nesanou un ev Jopgooid inod ‘3714 ,| ap NedATU Ne 
SQQUUOP Sap ITUAIQO , Pp aUTessadgu 389 JI ‘SaomNOssal sap UOT 
-Iedai ev] Inog ‘sdura} a] suep Jatpnonsed yuswioU UN kB 19809 
anbrydeiz0a8 JUsWIaOR]| CUA | DINTOUI IssNe JOP ste ‘UOT 
-ejndod ev] ap jaydwioo juswWio1quioUsp UN dSIXxd JUDWUITNIS 
uou JUdWAasUdde1 UN,Nb JaUsITNOS op jURWOdUII 3S9 I] 
“SQSIA O19 JUSIVIASP (J1OURUTy Indde un 
19) sayqepuajap ja stdgid ayoIayoal ap sjda[qo sap 93S1x9 [I 
sjonbsaj nod sauiaysAs sa] spnag “(¢ UONDAS P| Be BQUUONUSUL 
sjouuosiod syUsWIaUSTasSUaI Sap UOTDA}01d BP] ap asayodAy | 
ap uonryora ‘ajduroxa red) janjdaosod ona op jutod un,p 
asnolosuep ong yelinod saguuop sap sos ud uoNTsInboe ,p 
anbriyod oun ‘inae ,.p o1euIW09 sed ynej ou [I ‘uepuedag 
‘aulaysAS ap aiuas 90 asod aonb gyyenb ap sawelqoid 
So] aIsyeur ‘oureyoud Jnoofgo un ang WeIlAap (presipeyy) 
SQUISIPUI SoUUOSIOd XNe SWOJJO XNVOIPSW SUIOS Op soul 
-WUvIdOId Sap SIOISsOp xne 9}0]Id $godoR ,| 9p UOTIUDIGO TJ 
‘XNvIIPI] JUDWIIISISOIUS ,p 
SOUIgSAS OP puvIs snjd s1O9Ud dIQUIOU UN ¥B $Qd90R ILOAR Pp 
nesing snsuad ne sted yuo ajanjoe oinoy | @ saXojdap 
SUOJJO XNIIQUIOU dP ‘(6 G6 [) WeIsSa’T 19 ISOADIg WUAasOdxd | 
SWIUWIOD “NSS uN JUapassod nb sauuosiad say sano} 
Ins sonbrydeisowlap saguuop op s}USWIETa SoIINe ,p 19 98k | 
JUIIUOD JOTYyoIy a] onbsind ‘amessaogu uontsinboe .p aiues 
np juewodut yuUIAIaT[NoVIed sduraxo uN ysd (WSS) uONeN 
“SIUTLUPY AILINdag [eIDNO ke] ap “WUepmuUINN JorYyo!y No “(NSS) 
Joquiny Aqtinsas [e1s0g np ajqduroo uoneorydde ,| yueuajqo 
ud neaing snsuad 9] Jed yusuWadeaI ITQuI9 JUapedeld JT 
‘(VCa) SHHeNsIUMUpR SIOISsOp 
Sd] INS 9puo} JUsUIASUdd—I UN potd Ins d1yJ0UN INOd JasITNHN 
S23] JUSUIWIOD JURUTWIA}Ep Ud Jo SagUUOp sap juLIaNboe 
Ud OIOT BP JUoWAasud.dy Np syneiedoid soy Jassois01d 
auey Inod (q1eJ & | UO 19) QUOT UL, OP JUSWIASUD.ay Np uOTs 
-8990 ,| ap Jowjoid yuanbgsuos sed yeIASp UG “ddUdDPIOUIOS 
aun sed jsa,U OL6| ep [eUUd.ap JUSUIaSUddaI NP dgUUP | 


666] Siqusaoep ‘ajenbuse,p senbiuyoe | 


JULINP 696] BouuR | Inod sarjdwias snuaaal ap suoNee[IEp 
Sof sade .p nuajgo aja We Neaing snsuaD nv sttusuey & SY. | 
anb (a]LJ Jayseyy [eNplArpuy) sJatpnonsed sap suonesejsap sap 
OLUL JBIYOY Np Wweyxe Jorueid 9] onb yey aj ‘suonvordwios 
sosnoiquiou ap na v K [I,S sWgJy ‘JUSUIASUad—I Np JUSWIOUI 
NV IJISUDJUL,S XNVJUSUIDUIOANOS SauUIsIuULSIO sane sap 
uoneioge][oo ve] aonb juayUOW sagssed saouatiedxa saq 


ssguuop ap uonIsINbIyW [Tp 


“UONCULIOJUL,P IDINOS DUIUUOD UONRST][NN ANZ] JayIOeJ ap 
INA UD SJULISIXS SJILIJSIUILUPR SOUUQ]SAs Sop UONRITJIPOW op 
juapegoeid UN ,p UNPAID PI 19 SaAO] dua, p SASULYOE Sa] JULSTA 
uoneiadoos ap sajuajud,p uonriogeys,| ‘uonesITnN Ino] 
B SOATL[II UOTINI}OId Sp SdINSOU SAP JUSWUADIOJUAI 9] ‘SOAN 
-PIISIUILUpe SaauUOp ap sayjUeNb sopueis ap uoNIsinbor | 
JIOARS B ‘satIosayvo anenb usa sogdnois juos saAnoR 
S90 B JULND IDI Sav} SUONRAIOSGO SIT ‘OI OZ ap JUdUIASUdN 
-OyY NP UOISIADIC Ud SdTJONIUDAY S9IATIOV .P BIUUDDEp ouN,p 
«IOAUD,P Anod» J] kIBS QYOT UP,] OP JUdIBSUDDEy IT 


snssad0.1d 3] JUBUAIIUOD SUORAIISGQ: [fp 


(Tp UONdeS) 
nusjuod np 12 ([‘~ UwONdeSs) snssad0i1d np saloseyeo 
So] suep sdgssejo juos suontsodoid sayz ‘stug-sieiq 
SOP QOOT Ue,| op JUaWIaSUaZ0y Np UONeIedgid Be] op cuped 
3] SUBP SOANLIISIUIWIPe SaQUUOP ap SIOIYOI Sa] ANS Janjooyyjo 
RB oYyoIoyoo! ap xneaed op suontsodoid soureyso yW10ap 
UOTDES dJUDSaId BT] “SJNLNSIUTLUPe SIDISSOP Sap Ins 9puoj 
JUSUASUIIOI UN ,p JuLOd ne asTWI BI B SdIlessadgU BOUaPIAI 
3]N0} Op jUOS aYdIOYDE1 ep xXNeARI] XnNeIquOoU 3q 


0007 NV. Tad INGINASNYOda 
AT LNVNYAONOD SNOILLISOdOUd = “Ph 


‘onbusneis e] ap xneuso xneaing sa| studwi05 
A ‘saguuop ap sinajonpoid sap aoanod 9] jUdWI9ULIOUd 
JUOIINPSl ‘9YdILW UO B S[Nd[Vd sap J9}Nd9Xa,p a[Iqissod 
RI & 39 DOUDLINOUOD P| B sdansnfuod ‘Inb sanbruyse} saino| 
-[IOUL 9109S Pp B DOURSSIeU JUOIBUUOP SaguUOPp sap UONeS 
-I[N9J ap sagsi[eiguas suoneoydde saqT (p66) anbusneis 
op yeuoNeusajuy inNsUy,| wWestpeid a, swUUO0D ‘ajdwioxa 
Jed) sastyewiojne uodsej ap sanuajqo jUaANos — saguuop 
op gesnyy uonesi[yne: ey e aovjd snjd ua snjd ap eiaj 
(anbisse[o JUSUIAaSUIDOI UN ,p SEO J] SUP SLILUOD) SaguUOP op 
ISNIIQUO JOJ 9}D9][09 VI {JUISIGINUOD IS SOLIBUDOS $99 IS 
“QUIPUIOp 99 SuRp 
piejei un vlasnooe o1fqnd inajoas ay anbronb — sanbijqnd 
SUONLIISIUIWIPE Say Ied SUIQUI ‘saloe}ISqo Sap SWIWWOD sndsod 
snjd jUOJas dU XNdIPIse} [NOVO Op UOTINIEXA,| 19 SIOIYIIY 
S013 SQJ} Op JUdUA}IeN a] anb vIaTyIUsIS [NO[ed ap sajuessind 
Snjd 19 sdasna}NOd SUIOU SAPOISUI Sap B $Qd90R "J “UOTN[OAY 
9}199 SP SOLOW DOIOJ LI VIDS QYOIRW 9 ‘9OUL[GWIOSIVIA 
91NO} UOTAS ‘JUsISYOO 3NO} UN JURUIOJ sayUepuddepiojUl 
SO[QUIILAOD Op Sarquiasusd sap Jed sagov{ duds JUOIIS (966 


JUBWESUBDSI Ja S}I}ENISIUIIPe SIBISSOG :UaINeYOS 


I[GIVYIS SULP SUILUOD) SddTOSI SUOTJBLUTSA Sa] ‘UaANOS snyd 
ua snjd aq ‘aqiadns vias ayeqo]s aytjenb ey stew ‘suonewinsa 
SOP JUOJOS s]UDWOUSIasUaI $90 ap Uednid vy] ‘xneuOIsal 
SJUSUIDUSIASUSI IP UOISO[dXd J[qQuILIgA aUN kv PIOJSISSe 
UO NO ‘«SaQUUOP IP JURISIOSII» 9PUOW NedANOU UN suUep 
SUONUS SNON “INdI9}xa,] v.nb anbysneis ve] op xneuss 
xnevaing sap ules ne udiq Issne ‘uoIsel ayned sed uon 
-PUIN]S9 | Op Sed I] SUBP JUOWAIaT[NOIWIed ‘sonbiydde say ap 39 
(DIS) onbrydesso0g3 uoNeULIOJUI ,p sauaysAs Sap SaIOITaWe 
S[OIOISO] XNV SQDOV IIOAR .p aplovj snjd ua snd ap esas I] 
‘JNOD ANZ] op asnvo & USAIN I1U9}q0 1eIINOd dU UO | 
anb sjuswioustasual sop osinpoid inod sayeiedsip saoinos 
Sop JOUIQUIOD op UdAOUW UN JOANOI) ap sie ‘saguUOp sap 
Jauedde ,p sed jsd,U s}USWIaSISaIUS sap aseydnoo np [Rus 
-epuoj jnoalgo J anb ‘(L661 19 €661 ‘e[dwoxe red) Jopyur 
}9 UDINIYOS WeJ UO ,| BUIWIOD ‘a}dWIOd vIPUaI as UO ‘adURS 
-SIOIO 99}99 B JUDWIIJQT[eIeg ‘anbysiye}s ana ap jurod np ajues 
-Iejsnes snd ua snjd op uodej oun.p ‘99 Ja ‘sagaud sastid 
-91]U9 Sap B JURUdJIedde saguUOp ap saTquidsud spueIs op 
SUOSIRUIQUIOD Sa] BIdT]dH[NW UE “sanbruydse} $99 ap ayjaysoe 
QpurIs SII] & UONLUILIDSSIP PI & JUSWI[QRIqUIDSIeIA VIN 
-noge saguuop sap Inapuojoid us uoNPIo]dx9 ,| nod «usw 
-ONOSUd» "TJ ‘epeuryd onbysneis v& ‘sone aqua ‘ey eye] 
op je neaing snsudd “SF, Ne JapPyUIM [['q ap uonoeIp 
R] SNOS ‘JUOIAINSINOd ds sjUdUAISIZIIUD Sap advydnoo np 
suIeWIOP 2] Sup seisoJd sa] onb asoddns uo ‘pres9 129 Y 


sanbiuys9} sais0lg p'¢ 


‘OL0Z Anod yqy un soredgid assind neaing snsuag a] anb 
Inod ‘«juvudjureU» sajdope 10s UONPRISIsg] BP] onb WeIpney 
[l Wuoanbgsuoo seg ‘sjyneredgid xneaey soy Jaynoexo & srewel 
o919-Jnod VIDALUY ,U NvIINg Z| ‘UOUIS ‘Yqy Np uonsoanb vy] 
Ins judyouad as Inb sinayssayo sap UONRIOQRI[OD PI JULISIXS 
lO] oun Jaydope Inv} [I ‘seo 1no} UY “aIUas 99 ap JUDUASUDIOI 
NO} 19]NI9X9 Pp JURA NOI] ILOAR JOP Inb 9d1919xX9 ‘SSANLSIU 
-IUIpe SAQUUOP Sap INs gseq JUSASUSOAI UN Pp $1d90U0d Soy 
Ins queyiod orqnd yegap un JastuesIO .P UOISDDO | WeIOUUOP 
IO] Op o1U93 99 op uONeoT[dde usd astw PY 19 UONRIOQRII J 

“Vy UN JasiTeal ap IaAesso WeAaap 
Neaing SNsuad JJ IS I[Qvus}NOSUI jIeIIS UOTENIS d][9} ouN ._p 
UINUICUL J] ‘IO “"NVIING I] IdAv JUIIOQL][OD SWUSTURSIO Sd] 
anb yURaBIX9 JIIPISISI] 91X9} UNONL 9]SIX9,U [I “ININSIA Ud 1S9 
anbuysneijs e] ns 10'T ek] NO ‘epeued ne uOoNeniis ev] e JUOWIII 
-IBIUOD ‘SIOJ9}NO} SIIWINOJ IN] So] B Sasodstp JUOS saUUsTUeSIO 
sane .p is aonb saanensturupe saguuop op I0Aadd01 nod 
au nesing 9] ‘wed v ast SYy,| ‘ajanjoe oinay | y ‘nesing 
9] SOAR JUDIOGL]JOD XNeIUSWIOUIOANOS souistuRSIO SIOAIP 
anb Juvasixa sJe[sisg] $o1x9} xNeaAnou ap Jaydope weipney 
IL Way un e Japgoo.id assind neaing snsua_ a anb inog 


SIJUUOP XN¥ $9Ide,| JUBUAIDUOD SUOTBAIpPIsSuUOD ¢°¢ 


“OUPENIUDAY 91199 asATeue UdIG & 
(L661) 1891124 ‘L661 OP JUSWIANSIZaIUS Sap ade[dnoo 9] Ans 
J[VUONVUIOIUL DOUdIOJUOD P| B 9OUOUOLd v [I,Nb sNWAaANO ,p 
SINODSIP J] SUBC] “JUOPIOU! puvIS sues Nal] vINe spauUOsiod 
SJUSUISUSIOSUaI Sap UOTIA}OId PY B WOIP NP «UONRIOIA» 99}99 


re Pe 


anb ja uone}sajoid ounone ye A ,u [I,nb ajqei{quiasie1A SUIOWW 
-uvau jsa [] ‘uotutdo Ine] ap a3duio9 sed suuan ou uo nb 
steul ‘oapt.| @ uasoddo,s uoneindod ve] ap soiquioul sap 
aWaIXIs uN Nb yweunod as JI ‘stug-sieyq Xne ‘ayouRAdI UY 
‘gidaoov uatq 110] sa }daou09 
aj enb juanbrpur sjyeynsai say ‘aignbus a99 snod ‘juasgid 
ve nbsne (666 epeued onbnsneis) ajanbua | ap suonsanb 
SOUILIIDO B sIpUOda! ap Naty Ne a}1eI91 Bp JIISSOP Ino] op 
NO [BOSI} JOISSOP INI] 9p UONI[NSUOD | JASTIOIN ,p IISTOYS 
juaAnod sjuepuodal sa] ayyonbe] inod ‘argroueuly gylanogs 
RB] Ins aJgnbuyq uos ap aipeo a] suep soudtiadxa | studanue 
efap & epeueg anbnsieis ‘Wey uq ‘arsayens aonb yur) ua 
IPOYIOW PI IP dast[vsguas UOTOURS PI B PITNOGe sase[dnod 
ap aoa snjd ua snjd op siquiou un e janpels sinodeal 
aj aonb sasuad ap ayqeuuosies a[quias [I ‘(L66]) UsInayos 
Jed saguitidxa saj[ao JUOP ‘SdAIOSAI SOUTRLIIO QId[eIY 
(6661) Jasuls Jed 19 (6661) SAPD (8661) YOO 
39 sayey sed ‘ajdwioxea sed ‘satjqnd ‘neaing snsuag np xnao 
JUSUTWUPIOU *XNeAeT Sane Xxnoiquiou ap Jed sIAINs 13 (S86 
UdIINIYIS) SRG] Ue SajUasaid 919 UO S}UdWIONSISIIUS Sap 
ase] dnoo np 31x9]U09 9] Suep spouUOSJod s}USUAUSIASUdI Sap 
uoNda}01d BI Ins spMig | ap syey[NsaI s1oTWaId sa] “JUSUaSUID 
-1 UN dIINpold ap ANA Ud S9dINOS SdSIOAIP op JUBUDAOId sagu 
-UOPp ap sose{dnod say Ins soUapIoOUr oUN JUOINe syouUOsiod 
SJUSUIUSIISUdI SAP UOND}01d P] B SAANLIAI SUONLIPISUOD 
So] ‘VAY uN,p seo a] suep ‘juowajsajiuvyy “spouuosiad 
SJUSWIIUSIASUdI SOP U0T]ID9}01d BI JOINSSe B URSIA SA}UTeY 
-U09 sap B sInafnsse JUOS SIaTYyOI sod aNUa sose[dnood soy 
19 SJNVISIUILUPR SIDIYOY Op 9991p UONRST[NN | “Ns ustg 


sjauuos.iod s}UsWIIUSIISUIaI 
Sap yadsal aj JUBUIIDUOD SUORIIPISUOD 7" 


‘LL6‘0 =9 B Vassed 3sa JUdIOIJJa09 
np Ingea ey ‘sayueloqe juaressivied sajuepuodsa0s 
sInaea Sa] aonb sored suojued 69] sep oyenb ap uoneuIWITS 
sady ‘9p6‘0 = d & [esa JeIa sJduIIs UOIe[AaII09 Op yUdTO 
-1JJ209 J ‘uoNeindod ap suonoafoid xne sajai0d Usd} 
-IOJ JUDILID SJNLIISIUTLUPE SIOISSOp Sap ase{dnoo sed snuajqo 
uojued Jed sjuswaiquiousp szy ‘Wey U “VWqy un Josieal 
op sed j1e39,u Jnoefqo | onbsind ‘ajuestejsnes jus ULO} 
919 & SJNVSIUILUPR SIIISSOP OP SIDIYIJ SOP UOSTRUIQUIOD FJ B 
90R18 onua}qo uoneindod ap ainwaanod eT 166] & SeeHod 
-31 139 966] US NeoINg snsudad 2] Jed saljqeia uojUed Jed 
sonbiydeisowep suonoafoid xne ynonoauuog np sagjdnoo 
SOQUUOP So] gIedWi0d & UO ‘UOTBNIVAS INI] Bp sUTy XNY 

8661 9P INQgp 
NB SI9IO 919 SNO} JUO SIOIYSIJ SAD “NoYOoUUOD Np asevugyd 
ap suOoT}e}soid sap 19 SNUSADI AP SUONRIL[OAP Sap SIIIYOIY 
Soy] aonb Isule ‘squUOMUdUISNS SIOIYOI] XNAIP So] IIOARS ¥ 
‘We1q,[ OP NVIAIU NV SdI[[Ianda1 sxguUUOp op SIATYoIy ayeNb ev 
(6861 O7ef) SJUSUIIIISISAIUD Sap asejdnoo ap saystjiqeqoid 
sonbiuyse} ap uoneorydde | ins apuoj as “(6661) “[[09 32 
IY AA Jed yap “Wosjo Jaanou aq ‘sayqissod sainf say squuon 
-d9[9S JUaIe}a ayjonbe] saide.p ayst] oun osINpoid ap ona 
Ud SOUIQISAS XN9pP Sa] a]Ua SayduIOd sarqnop sep WeUrWUI[S 
‘QIAND .p-ureul ap dnoonvaq juvasixa snssaooid un ied 


SLI 


‘Ja INDIO B SA[NOIYIA Sap 1d S1NDIOI[9 Sap JUSWIISISOIUD , P 
SISIYOL Sap WeAIBS aS JnoNosuUOD 9] “ueAvIedny 
‘ye1q un nod jorued YqyY uN Ja1oOgeIAI ,_p a[lovJ Wesas [I UIOd 
jonb e anuow sororexa,| ‘suIoWURaN “yy un peld ins 
a]owW ap sed ye} ,U XNBARI] S99 op Jdafgo J anb sg[quia ,_p 
JausI[NOs ap juLWoOduIT jsa [J ‘sainf sap UOTDITIS op BUIISAS 
3] Joroljawe inod sorqnd sjnensturmUpe SIaIssop Soy Jost] 
-11N,p ONA Ud IeI_ 199 Jed SQUUOISSTUIWIOD XNBALI] SOP JUDA 
-L199P (666 [) USINIYDS 19 MOITN ‘SUY AA ‘SoUOUd ONE ,P 
juouUdIA Inb xneiguas syutod say juaNsniI jnoyoouUoOD 
np 1e14,] Inod juawwi9091 saesi[eal sapnja soureyaD 

: “IQUDWISNL .P ISSId JU UONLULIOJUT | 
ap InayeA ev] anb sioye assteqg JuvAP QYdIUL 9] INS Ja4US INod 
Joked & «fewitutt» xd 9] ‘sinonof xneaanou xneiquiou ap 
JUO19}CWIOD UONPULIOJUT | 9p SOLNSNpur sounof say ‘sIaIssop 
ap onud} ap sanbruo.nde[9 sopoyJouW Sap a[eIPUOW UONNOASI 
RI ap nua} ajdulo_d (966 SdUdTOS Jo AWapeoy [eUONeN) 
yoINUOD We] uN elap isda sanbnsieis suly sop e soaatid 
SOINOS S390 ap UONIIO[dxa | 19 UOISUedx9d | op JUdWIapIdel 
qusuusid (joueords.p souleyo op souvudAoid ud suIgW 
‘g]dwiaxa ied) saguue sanbjenb e A jt uonsanb juawayynu 
11819 ,U [I JUOP ‘saguUOp ap sagatid saoinos say] ‘saywordxo 
ang,p sajqudaosns saguuop ap sajquuasus sjuvHOdUII .p JUSUL 
-a[e39 JUapassod sanbruoydgyai saranbua say suep sastjeroads 
SOUISTULSIO SJ] 19 ISSLUL OP SUNdyIeUL Np saystyetseds sa] 


SagUUOp ap SouLIOUd SzJquiasuy ss [" 


‘uoneindod ap aljjiyo np UONdUOJ Ud xneJEpej 
opie .p sowuueisoid sap on ne juawafjonuue siredgi 
JUOS SIP][OP op Spe QOZ onbseid ‘yajjyo uq “neoiIng 
snsudd np sodouowl 9] 19}s9]U0d & $]e}Iq SIOAIP So] Nop 
unone Sues JUATOW SUOTUaAGNS op XneIapay soureIZOId 
XNV SPIS9IUI SIDIOULULJ SJHVIOUL Sd] 19 SoTRISPa} SaIANOR 
SOUILIIIO Op dy[Iqesuodsal ev] ap Woysuey sq] ‘sJUOWNSIS 
-a1ua,p sowiaisks soidoid sina] ap jueAJOS os Ud sfored 
Vd sep paid ins o1jowW aynop unone sues justeNod 3a 
(2661 Yordnystgq) asudoal Jos JUNpIsas onbeyo onb Jainsse .s 
QP SUOSILI SOUUO dP ]UO S}eIq SIDAIP SOP SJUSWIOUIOANOS 
SO] “UIBOLIWe [eIOpay INd}99s np ANdII9Ixe,] B sanbisseyo 
SJUDUIASUIDAI SAT aonb SUONNIOS SAN ,.P JABRSTAUD ,P JUd}OUL 
-Jod ‘SosWBULIOJU! JUDWIDIOUD ‘AINSIDAUS BpURIS Op USUI 
-OISISIIUI Pp SOUIAISAS SAP B YSI[RIQUS SQOOR | 19 SJUDUIII] 
-S1301U9 Sap adeydnoo np anbruyse} ey anb ureyao 389 [J 


SHUSHHLOdAH ‘€ 


‘jauuOTeJado ana op jurod un,p siqestei9uUod 1sa JdaNu09 
a] onb ayuow dhg op apoyjow PY ‘[IeIap ud snjd saipnie 
aN9,P WoJaU sjoodse sas ap sIquioU IS OWI (L661 
oh) VAY UN dANa Ud dW op UdAOW UN JUdWD}Q,dWI09 
asodxa aXg ‘neaing snsuad ne gjuasoid ve jt.nb ywoddei 
JUI|[IOXO | Suep ‘a{dulaxd Ig “JUWIISUdDAI [9] UN JOST[eII 
yeanod uo suaAour sjanb sed sourwajap ev iny,pinofne 
JoAtue ud Inod sjeinsei suog op JauUOp sed yesnod ou 
Vay un. nb «1aanoid» e yedap ne jUesIA dIQIUIOp 91990 ‘sue 
Sop [IJ NV BYdIOYOOI BP] Op UO] ap JUdWISURYD 9] JoUUONUSUI 


6661 siquiasep ‘ajenbua,p senbiuyoe | 


ap JULLOMUIT SIOJaINO} 189 [J “(VS GG] UsINdYoS) sunaypie We] 
919 e [I .nbsind ‘juasaid ve nbsnf uainayos ja Aaayy ,p spore 
Jatweid np uoneorqgnd vy sindap uonenyis ev] ap uoNNIOAg, | 
ap gy[leiap gsodxa.[ tol azatnsinod ap aynut ysa I] 
“QUIVULOP 29 sURp 
SoIAInsInod 3119 JUdIeADP Sapnyid sap anb je] 9] ANs JULISISUT 
SINIING SI] ‘[PNUSPIJUOD eR] B 39 sfouUOsIad sjUaUIAUSIAS 
-UdI Sap UOTIDA}01d eT] e UONUAe ,.p dnoonevag Issnev ap10s9R 
uontsodoid ve] ‘uonsanb ey] JaAa[nos e assnod juo suonovel 
SOUIvUIOO IS DWIQW ‘VWQY uN dsAND ua amow ap sed 
juosododd ou s[J “sue JSUIA JIOA *XIp suep Wy un Jastyeas 
ap dfIqissod x] JaIpNid,p JUapUvUTUODEI sInaine sas anb 
Wey ne ua) uontsodold ey] ap jueyodur snqjd a] yoadse J 
(666[ 34g ISSN ILOA) JOPOWWUOSIR Ud,s 
op “SUIOW Np ‘no Ja]UOULINS Say ap sudXou! sap Jasodo.d ap 
}2 9}X9]UOD INI] SUBP SO9UUOTJUDU Sdssa[qie} soy Joov{d op 
JUS}OULIOd UONRNSIUTLUPY AILINDIS [RIDOS PI ap SIOIYSI sap 
sdei onbiuyja adnoiz 9] 19 9e1 RP] INS saguUOp Sap 9gI[Ieep 
uowexe uos onb Isure ‘(766 24g) L66I Ua Ag Jed sast[eal 
XNVARI} SOJT “WOIOINS 9q ‘[BUUDSSP JUSUIASUDDAI NP SIO] 
g[jonjoe oiney | & Sagiquiougp-snos suoneindod sourez199 
op uoneAlosgo.p dweyd a JoO1fsue.p Issne yWeMoU! 
-Iod [J ‘sue xIp say] sno} anb yuourwanbeyy snd uonejndod 
ap [eqo[s a1jjtyo un oinpoid op Issne sivu ‘[euudoeap 
JUSWIISUdDAI NP Nvapsej 9] 19 NOD J] S1INPal op jUdWa[NIS 
uou jeoWLIEd yedeap ne ssodoid Yqy a] anb soreg {jafoid 
9] ArInsinod ronbinod ‘suonewuty sao Quuop juRIq 
‘SO]]9O1 Sa|JoNUapIseal sassoupep anb r9In|d 
sgje}sod sassaipe.p Jasodsip op uej ne jo synensturupe 
SIQISSOP S23] SUBP JUSINSTJ Inb dowd BE] Ns saguUOP sap aytyenb 
RP] & Juan ‘anbodg,| e astupe ‘uontsodold e] ap sassalqiey 
Sop oun ‘J ‘UodseJ INE OUN,p d9zTeI] ONQ ULIADP JUSUWIISOT 
np uonsenb ey ‘uontsodoid ey ap sowia) xny ‘jaloid 
np sireuuoAiquia yoodse | ap afduroxa inayjiow 3] ajnop 
SUBS }S9 STUP)-S1RIq Sop JUeINOD UONR[Ndod ap jUdWIasUdI_eI 
ne jUdWeTaT[eIed YstyeaI ySa Inb JUSWIESO] Np UsUIasUdd—I 
3[ JURUIZNUOD UOTIsSOdsIp dunone sud ye ,u UO Nb ye} aT 
(8661 JOqoM 19 JOTIES $L66] WUIYIE 19 “OUdIOJ 
‘eyleZD ‘C661 NEA 10 “JoqaMA ‘JapIes) guLIyUOS 1U0,] 
8661 UD 19 C66] US SINIIeIOQeT[OD Sas 9 JapIVS Jed sorqnd 
soporte say ‘anbisse[o JusuIasuUdoaI UN B BdRIB daAIASqO 
uone[ndod ve] ap %¢6 ap snjd jusurayau yeIUANOD gsodoid 
Vdu a enb juareAoagid sj] “saguuop sap apnygjdwioo 
e[ op Jainsse.s inod uonendod ap sayjyryo soy 19311109 
op NA Ud dIIessad9U jIRJOS BseUUOT[MURYOS.p one] 
no suw40j sun,nb asoddns sinofno} yuo st ‘Wey UA “owes 
-reduit anbronb ‘auuog ios Yqy Np en1J9AN09 Pe] anb 30 
B JUaIepudne s uoNIsodoid ey ap sinayne so] ‘uepusdadg 
‘uonendod ap aileuuoArquid yUdWaIquiOUap UN nb 
snjd dnoonvag ‘«nua}U0d ap d1gNeU Ud» ‘ajuasaidal WY 3 
anb uontsodoid ve] suep asestaua ay9 stewie vu [I ‘StoJo]no} 
SVdy un Jand9ax9,p anjouuied inod sjnesturUpe SoueisAs 
xne sjuduasueYyd sureyiad Jayodde .p aqissod yelas [I,s 
Issne JUdIepULLAp 9s SINayNe say “JUdWaT[aNIed no UW 
-d19I]UD ‘sQooR JUDZTeS9] Vlap Wear NeoIng snsusD *$' 
3] sponbxne xnood & Sd}TUII] 11879 SJNVSIUTLUPe SIOISSOp Sap 


JUBWWBSUBDS Je Sji}euJSIUILUIPE SYBISSOG :UaINeYoS 


uolesi[yn | ‘Isa snd tnd ‘anbissejo yuawWasuadel uN Ud 
-a1g{dwiod anb 101n]d yuawaTjaned J1a0",duia1 ap uahouw uN 
Jayosayoal B }eISISUOD UONIsOdold 399 ap 9]9 JUDSUZ]9 J 


(uononpery) ‘uonerndod 
RP] Op «AIeUUOAIGUId» JUdWIASUadeI UN I1Ud1qGO 
Inod (SHH) soedlaAlag uvuIny{ pure yyeoH “S'Q 
Sop JoeNsturupe sJaryoy ne,nb tsure ‘asewuoys ap 
suonrisoid sa] 19 uoIsuad ap snudAdal Sa] ‘sorteyes 
SO] ANS SJUDUIIIISISIIUD XNV (SY]) VIAIIS BNusady 
[eulaIUT “S'Q] Np sayeosly saguuop say Jaydnoo 
ap sudsXoul so] JaIpnia.p JUsIepuruUIOdaI UOTE 
-OUNWIWOD PI] Op SInayne sof ‘JUDUTATR]UDWUePUO-F 


‘epeurd onbusneis op ‘slON snoq ap ja saAa‘J uyor 
op XNVAvI] sop JuoWIWWP}OU WeIdsur.s uoTIsodold eT (7861 
uainayos 31a AdaTY) UORIOOSsSY [BONsHeIS UPOTIOWY | 
aP ZR6I IP Ia[quasse | B SIOJ dIQIWIOId ev] Inod onbiyqnd 
anpudal a39 & sIUA-sieIq xne jatied WqQY un.p sap, 

: ‘sJoluUold ap swojja sing] 
ap suosa] Sasnoiquiou op 1311) jnad uo ‘suloOWURaN “XneAPd} 
SIND] IP SJeI[NSSI So] JUSWID}DOIIP JasodsueN ap sIIOIJIpP 
}SO [I ‘JUSISUDII NP UOTRSITeaI BI] pUd}-snos nb [eID0s 
I]UOD Z[ JOP ‘sUOSe] SaIjNe Pp UdIG dp JUSNSUNSIP Ua,s 
J9 epeuey gj onb no stup7-sje7q say anb syed snd dnooneaq 
jUos sked sao sUMUIOD ‘sIOJaINOT, ‘(6661 WNT {6861 Wypoy 
‘L86] UsInayog 19 ouIqee ‘¢g6[ Udsuas ‘a[duiaxa ed) 
ago1owe uaiq efap iso 19 QL SaguUe So] JUeINpP gINGep 
B SJNVISIUTLIPe SIOISSOp sap INS Sapuoj s}UdWasSUddII 
op uoneiogels,, ‘suasadoina sed sinaisnjd sueq 


Vda Ad WIVNISIYO 
NOILISOdOUd VT Ad ALXHINOD °C 


‘sanbrydessolyqiq saouclgyal op 
alas aun Jed arains 1sa aq “Soyuoud sap uowexs un puaid 
-UI09 ‘SUOISN[OUOD XNv I9AIASOI ‘Q UONDES BT “({ UONDIES) 
sluy-sIe1q XN O[OZ op JUoWasUd.0y Np uONeoyIueyld ey 39 
‘(9 uo19as) SajuviInoos sajgnbua .p suwiessold 9] ‘(¢ UOTDas) 
IUdA B oIuUdDap ke] INOd saileysUsoIJO\UI sanbrydei3 
-OWAp SUOTIRUINSS Pp sUTUUIeIBOId 9] ‘(fp UOTJOAS) STUP-sIeIq 
XNv QOOZ UR, ap JUdUASUa.OY 2] IIOARS B ‘souTeUOp anenb 
suep suontsodoid sap pusidwio9 spore | ap 91891 FT “Vay 
uN .p a[euuoNeiado si[IQusiej ve] op oped a] JUassedap 
inb- sawetqoid say jyurutaoU0d sasayjodAy sanbyanb 
‘© UOT}IOAS BT 19 YY YI Ans sjamxaquos syuswsusTIasudI 
SUILIIO WUINOJ Z UOTIOAS BT *([ UOT}|OES) UONONpPO. UI | URIS 
aigtuaid eB] ‘suoNdas JINY Ud 9sIAIP ISO B[OIIe JUaSaId JT 

“sayuvaseINODUS JUOS 
Iuaav .p saanoedsiad say anb Jswuyye ynad uo ‘(Nod s[qrey B 
ANDNeULIOJUT JUSU}TIVI] 9[ 19 SJUSWI9N}SISAIUS Sap asvj{dnoo 
J] SUID) sasnayiod saisojouYyse} ap siquiou pues snid 
un.p jurod ne asi ey & dvs ‘Ja sipnejdde ang.p Jua}W9W 
‘soja spinoy ap xd ne sayoduial ‘sgoons xnoiquiou 
ap ‘Jueynog ‘UeWIADN INI] PANO a1Odua sed JUO,.U YWqYy 
3] JURUIZOUOD Soap! Sa] ‘PION np snbuswry ua sulow nq 


vLl 


“WOd [ov Muainayos :anbiuo dala JaLUNOD “W'S ‘TOETT VA ‘VUpurxay ‘proy Joujjny ZOP] ‘JIC ‘aNINSUy ULgI YL ‘UsINSYdS ZI 


‘gnuuodal yIe]9 Jaery Jed sasodoid uones 
-IWOpUvI PR] Ins sapuoj dANLIUSSaIda1 apoyIeW | onb sTUS) 
-nos nd v uo] anb — (¢p6 [) ZIIMINY 19 UasuRH op Jueyodul 
SQN] QfOe | 19 SUIWAG op asuajap P| Jed onb tsure ‘(GE6]) 
sueyyns ied gdndde — (pe6[) URWASN op oforue | op uo) 
-eorqnd ey] ap anied e,nb juawiesAa jsd,U 99 ‘aydwioxa Veg 
“Vx Sa] Qus0U09 
Inb 99 ud Inayne 199 ap JuoUWIepUadgpuT oidsul.s (9661) 
uainayos onb sipue} 4ip yuoweidoid aseuuol[nueyos , | 
ap 3sa inb 99 nod (9461) UYNY 2119 (861) esnoyT[eg ‘press 
100 Y ‘sonbiynuaros suONNOARI Sap s]eI9UaS SINQeU RI Ip 199 
-UdUIWIOD INod oped ap gsuas anop sues WIE [J “syNeNsTU 
-ILUP® SIOISSOP Sd] INS YPUOJ JUDUIISUIDII OP SWLIOJ UTeLIOO 
oun Jastyeas Inod stnbal sjusWIasuLYO Sa] 9}X9}U09 ANZ] suBp 
JONUS OP UOG IRIS [I ‘s[eJap soy suBp JaNUS,p JUPAY 
‘(066 UsInayos) sue xip v A [I ajanbua, p sanbiuysa] suep 
arqnd sponse un ev nol e ast ap no ajins ap ‘ayos onbyenb 
Ud ‘W9S TJ “(P66l ULYIND-I[STq 10 SoA) epeued ne uonenys 
PR] D0Ae oTaT[esed uN j][QeI9 stew ‘stUP-syeI XNe UONeNIS P| 
ins yuaweyedrourd ood TJ “(P66 WINgpeg 19 AayJors OA 
‘sourejuawgddns s}uswioustesual sop nod) synensturupe 
SIMISSOP SAP INS gpuoj JUsWIdSUdde1 ap suOT}Isodold soy 
INS «JUIOd» J] JUSWIDALIG dIIVJ B VSIA QpOR Juasaid aT 
‘OXTUU JISaIVS oun 1a\dope ,p yo nyd stew “uow 
-9SU9d0I Bp S9guUOp ap anbissvjd 9199][09 PT JUWA}Q,dUI0D 
Jourulys sed ou op jUopUPUIODA (786 UdINAYIS 319 ADATY 
‘gduroxa red) sasnaniquie snid soy (YY) syoensturupe 
SIOISSOP SI] INS 9pUOJ JUSWIASUdDOI OP SOUTeOLIQUIe-p1OU 
suontsodoid sap oun .| op sinayne soy WIQWI ‘yIeJ UY “oYyoRI 
Rl Op gxa[du109 eI ap 19 gWAOUY,| op asned eB ed ane ,p 
JO SJULISIXS SJIPINSIUTWUPR SIAISSOp Sap siN}eU k] Op osneo 
e wed oun .p — slup)-sie1q xne Iu epeued ne Iu sed J 1S9,U 
BIO ‘aUOD Ig *(366] AOW]OFY 19 USSWIOUL, {T1661 BLISIAW 


i 


‘g]duroxe sed) saanensiuruipe saguuop sap Jed juowajaried 
NO JUSWId}Q[dWIod sagovi dural 919 JUO SaT[aUUONIPe USUI 
-9SUdd9I Ap saguUOp say ‘sanbrpsiou sed sureyia9 sued 
"(p66 Aossoudy ‘oydwiaxe sed) 1a19g]9908 ,s DUIQU 
JIOA ‘aJAInsinod as ajquies souRpUa} 97300 39 sanbnsneys 
SUI] SOP B SJNLIISIUTLUPR SIDISSOP SOP UONI[NSUOD PY aIT]IO’J 
ISSN JUO SIOISSOP Op 9NUd} VI ap 19 oNHNeULOJUI JUDIE 
Np suIeWIOp ZJ SULP SajNuUS sone _p 19 sanbiyqnd suonenstu 
-lupe so] Jed sasiyeai sausoid soy ‘soumeqoid xneoanou 
OP SITOSNS JUO SIS “SJORSIUILUPR SJoIssop xnev anbyeuigysAs 
sgoov | onbysneis ey ap [eUad nvaing ne guuop quo Inb 
(epeurd np onbiysiyejs P| INS 107] B] SUMLUOD) SIO] SaTJaANou ap 
aidope quo sked xnoiquiou ap ‘sduwia) np [J ne ‘stojayno J, 
“JOSI[N Soy 
OP 19 SJIVIISIUTLUPR SISISSOP XNV SId9v IIOAL .P ILOYJIP JUDA 
-nos yey [I nbsind sarynsnl yey ayooidde ayjag ‘(ajanbua, p 
sanbiuyoay, suep sajydope juowoseiguas one,p onuny 
-uod Inb aanoadssod) sorgtpnonsed suonevordde sas ins onb 
1OjnN|d ‘Iaery op spoyjow ve] op onbuewisyyeu yUsWpuoj 
3] INs jnoUNs god JUO sINdtaI[N xneaey say “USWT[oIMIeN 
‘(L661 ZIOM 39 UOSUYOL) O68 OP USISAArOU JUDUIASUIIEI NP 
SOQUUOP XNe SNUdADI Sp SUONRIL[DAP Op SUOT[HUBYSE ,p JUSU 
-ouedde | & agt] 919 We — (B61 AsnouT[ag) Joery gjedde v | 
UILUOD ‘JRJUASaIdo1 BseUUOT[HULYSE | — BsvUUOT[NULYIE ,p 
SOUIOPOW sapoyjJeUI sop uONONpoNut,, onb squias I] 
‘ajanbua_p sanbiuyraJ. anadi e| satjqnd 939 & ayjonbry] 
juvinp a[29 anb apoed ourgu ey] said nod ke ‘yp quo 
-d1NNe — SdQUUR SAIQIWIIP CZ Sd] NI] Na jUO sTaeI saiso1d sap 
yednyd vy] 1s surgur ‘sdura} a] Suep UO] ZaSse d}UOWAI USUI 
-9SUDDAI 9] Jo]NDEXe INOd XneJUSWISUIIANOS sJNesSIUTUpe 
SIOISSOP SANE .P 19 XNBOSIJ SIOISSOP sap uOTRsSITNN,T 


NOILONGOUINI ‘T 


“Sole }ISUIOIOIUL 


suoneuinss jo sajgnbua ‘sjauuosiod sjuauousiasual sop uoloaj01d ‘syuoWoNsisolua sap osejdnoD :sq1O SLOW 


“UONESNLULIOJUL | 


op 312,| sUBP Ose]URALP BdUOJUD,s UO.| INb sinsow Be oNbNSeIs BP] Ip [eUIO NvdING NP IOI NP UOTINTOAY, | JUSWIIAITIQ 
OUTWILX9 UO ‘UYU “S]UDWIDSISdIUD Sap ade[dNod op sguUONda}IOd S]AIDIBO] Sap Jo NOD aI qQIey B oNbHAeULIOJUT JUDD} IeL) NP 
Q[O1 J] Issne dUSI[NOS UG ‘sjouUOsod sjUsWIDUSTAasUdI Sop UONIA}01d ev] aAgrnos anb suonsanb sap usurexa | e aJUROdUIT 
sovid oun aplo90v UD “JUOUISIQUIOUSP-SNOS NP dINSOUI PT 1d SOIILIISUIOIDIUL SUOTBUINSS Soy ‘sajUvINOD sajgnbus soy 
stidwos A ‘stup)-s}e1q Sop jUdUIASUdO—EI NR s91D0sse sanbuysyejs souUeIsoOid op sUTWILS dUN 93NO} aTUD SUAT] SUTeLIOO IITqQeI9 
uo 19 ayosayseI op ued uN WUYSp UO ‘sing ‘epeuRD ne JUOWIOZET[NONNIed ‘snaTTIe Wey 919 efep ve nb 99 e areduo9 saz UO 39 
JneNsturupe JUdUIASUd.eI Op OUISIpesed NeIANOU UN IULEp Ip NA ud stU(-s}eIq xne sastfeai saisoid sa] a1puojordde zassev 
uodey op JoUTWeXa Jed BoUDWTWUOD UG ‘sIU)-sIeIq Xnk 39 EpeUD Ne ssp spuesd snjd op asod uontsuen oya0 ‘ayomue juasgud 
9] Suep asiogid 9] UO SWIWIOD “a[[aNUSSsO oINSOW SUN INY ,prNofne IUdASpP INod anyjoag v aiTOSsad9N aINsoU oUN “yedgp ne 
yreqa Inb jusWIasUdd0I ap suONvoT[dde sa] suep synestuTLUpe SJoIssOp op UONesI[NN | ‘susadoine sXked xnoiquiou ap sueq 


aWwoasay 


iINGTYNAHOS ZL 


JUIWIISUIIIGA Jd SJHCASTUMUPe SIIISSOG 


Zl 


epeuey anbijsiejs 
p8l-eL} ‘dd ‘Zz ,u ‘Sz 1OA 
6661 eiqwacosp ‘ajanbua.p sanbiuyos | 


_ aa i gaat 


7 ye is : > anes ma 
ys, po aoa aan ; gman J 


rie. ook tecaeee a lined to agai ree 
: Pabet Sev Gepeent o@ ae tue ep asp outer? 
ae pnb TAs OO) Soy 6S 294 fice 6 (le 
Wise ia) ee. | se Wwe ( Pies A Qs Cay ey 
oan | Tyiyew Di Vp fet Pl © BAN (fare4ig Z i709 2 Uy 


, cK} TA A vie ia aula , Fi mF 5 Coles 

Ps Gaew@ Arr law Qe, 1X4 owt arene ¢4 
So 4 j (RAPE fra 
eo re “Uy, A275 — ee i, 
Pw Pr im, aa Aes , Lu roe) 
: 5 5 14 f Pe | ( ‘ S01 a) 

a. a ee ne Pears tine - : , a | " hd : go? 
a Figen WR eel: WEES Pes MAYES . Bf “ahaa : ib Doe WO 

7 , A ee | : a oe iv 

te : e ‘ “~ 
= <a" > Qs ° : j oe | TP As i $ q A 


FOSaly Ta Seats) ae 7 “ inthe nye 
met owes p> ’ : 
RA) adi de? 4 Ot “ome 


, 4 
rs 
Bary ryYrRA AT 
, wis 
0a aa [rey on 


” wan  “erdy oP 
res Sp Fe atest es oy Sul: ews 

© eaaaaT & [Tay av hae Pa 

xf ; splines ale ee Ta 

a ; 
PIU Ph umd Pree Ne Ge Byeaneiee che ih, par ftekyey Senn Chaps | te 

LE 44 1S WOUND Qeicwes wary | re 


1 rt @ | iat vv? ae ar! 
Oh SRB HOn os plan 0 
j ‘ta - > 
pe es i | Oe a) = if i 
> gs POPs: @) Cay 4 Wee é aut Tare a. 
hija ae ‘7 iv Pai MPs 1 Ores ime > 
ae LW OTF a. Ce ae oy) OR gal al 
: 7 OA" : 
e Leet } 
aatted 1 y,) a = — —— 


pot wy ye ee guise or oe 4 
« ‘R211 Alas £2" Elin ea ante + Cwlanice 

naN aye prprneaplcs 
“4 Be VY Tae}. t Se EL ee ed er 
aang, 8 UR Cay URE Di oo et ee 
alla ailetilads - m . 

4 . Tie ae B asd Vie ors 

ae a al i £ 


uy: aloo cane 4 ai a ag jam — fy Ahr Sep 
a O-Gae 7 ¢;* 


m ; pm) 1 . an oe psy ane - 
ca laall aeadenale ee Se hee ef en ee ss 
aA ot AAW SISA GD Ada EP Pond o~ 1° 


: a ars eae 


‘OC/P661/E “P66T Tide ‘CT-[1 OK 
MON UOISSMWIUIOD [eINsNeIS dy} JO UOISsas JeIOadg ay] Jo Uodoy 


(~661) TIONNOD TVIOOS GNV OIWONOO” SNOLLVN G&LLINA. 


‘(WAY"S29°99' 666 [/SJUOWUINIOP 
/S}81S/310"399UN' MMM) PADDY “AOQAN( ‘UOISIAIG [RONSNEIS “6661 
op Jatugid uolssnosip ey inod sgredgid suonestunwiwiod (6661) 


ddOudnd xOsd NOISSINIWNOD OINONOOY SNOILLVN GaELINA. 


“QUIOJUT JUDUINIOG 
8661 21g0}00 ‘WaIskS SULIOWUOPY WeIsOIg pue SuruUeld 
aye1od10D s ,epeurD sonsneis (48661) VAVNVO ANOLLSILV.LS 


“anZoyeyeo ne AL X-6ES-Z] ‘Ou 
epeurd onbrsneis 866] 2190190 ‘uOnIPA sWaIsIoly, ‘ajponb vj 
JUDUAIIUOD SAI1A1IAAIP SAUBIT “(L8661) WAWNWVO ANOILSILVLS 


“QUIOJUT JUDUINIOG *L 66] PIQUIDAOU ‘epeULD sonsneis 1e 
juourdojaadg saoinosay uewiny (L661) VAaVNVO SNOLLSLLVLS 


ez anbiyijod op januewW °7661 


[HAR ‘oISO[OpoyJauI eB] J9 SagQUUOP Sap dytTeNb ey] Ins sinajesipyN 
So] JouOJUT B URSIA onbAYOg (7661) VAWNVO ANOLLSILV.LS 


LZ} 


"266 BIquia.ap ‘soNsNeIS [e100 SuIsN YyoIeasoy 
JO JUDUIZOUBAPY 9Y] UO BpeURD sonsneis pue [louNdD Yoiessay 
SONIULUINF{ Puke SddUdIOS [eIo0g ay} Jo dnoIDy SuryloM Julos 
ay} Jo Woday [euly (8661) VAVNVO ANOLLSLLV.LS 19 OHSS 


‘TZI-SI I ‘epeued onbnsneig ‘sawarscs 

Ja Sapoylaw - uoynwusofui] vp saauuop saq ‘G6 wmisoduks 
“[1ANIAY “UONBIO[[Y SOINOSIY JO SWI9[GO1g (S661) AW'L HLINS 

EST -Spl ‘OI ‘adoung sof 

UOISSIMMUOD INUOUOIT SUOIIDN panuy ayl fo Dusnor ]BIUNSIVIC 
‘JoUJaIUT ay UO SuTysT{gnd aseq eIRq (6661) (NM “THAGOd 

“AOTLAA UYOL SYIOXK MON °C17]0NCO Ssarodg pun Juawainsvayp 

Kaaing (L661) (SPA) “G ‘NIMARL 1° “N ‘ZYVAHOS “OD 
‘OddId “a ‘MNT OP “W “SNITIOO “d “UAWAIE “TT OYA AT 

“IT9-LI9 “€ “6 ‘sousuDIS jm 

fo Jousnor ‘Aysnpul UOMINSUOD dy) JO UONIAT[OD & 0} UONRoTTdde 
— uBisop Aaains [eIOL “(€661) “d ‘NIMAUML 1° “S ‘AYOVNIT 

'99-6f “UOISSAS sua DE Y] 

ap sajov ‘anbysijvjs ap joUoIoUAAIU] ININSU],] ap UNay|Ng ‘snsusd 

au) JO NesiNg 9} UI Spiepur}s [eONsNeIs pue sJO1I9 }UIWIOINSeOU 

7BIep JO uoNeneads oy) JO} soinpsooid Jo uOoNeziIpiepuris 
(L961) “T “MANZLId 1° “NM “ZLIMYNH “HW ‘NASNVH 


6661 aiquieoap ‘ajanbua,p senbiuyos | 


‘TZ ‘pg ‘anbisipig ap ajpuoypusajuy anaay “wWo\sks 
[RONSHEIS ANOAIJa UR JO sONsUOeIeYD (9661) ‘d'l ‘IOATISA 


‘LVLSOUNA Jed grqnd ‘sonsneig 
Ur AITTEND “86G6I/EO ‘SoNsHeIg uesdong Jo uNe|INg ONL ‘VWOIS 
Issne IIOA ‘“sINOqWIOXNT ‘LVLSONNA Jed sayqiuodsip juos 


SNIDG 866I UOtuNg: e] Inod sgiedgid sapoNTY (8661) LV.LSOUNA 


AOTAN UYOL OX MON “PLy-LSp “yoNG 
SSAIOLd Pup Juawmainsvay Kaaing “uoyeIsa\UT pue s}daou0o 
uowmaaosdut ssaooid pue yuowlomnsvaw AdAINS (2661) °S ‘O ‘OddId 


“ROTM, UYOL SYIOK MON °OTZ-661 ‘AI7ONG ssado0ig 
pup juawainspayw Aaaing “MdIAIOAO ue :AyTenb Adains pue 


Spoyjoul UONdeT[09 Be (L661) WW “SNITTOO #9 “A “MNT 9P 


99-LS ‘I ‘S] ‘sousupis jo1ouf{C fo jousnor ‘Ayyenb Aodains 
Jo uontUyep ay) SuIpusIxg (6661) “M ‘SAMAS 1° “W ‘SNITTOO 


“AOTIAA UYOL 2YIOX MON 
‘ZTS-1OS ‘CyonG ssaroig puv juawmasinsvayp Kaaing “saiouose 
Jeonsneys feuoneu je soonovid papusww0se] pue ‘soul[apins 


‘sprepurys ‘sarorjod Aiyend (L661) ‘W ‘HOUV 8 “WW ‘ADCATIOO 


6661 diquiaidas ‘eaauayH 
‘LI (ON Jodeg Bunion, ‘eIepeyapy [Roses UO UOISsag FIOM 
AOA/NN ‘suetonsneig uvadoing Jo soualaJuoD 666[ 2] Inod 
giedaid afanry ‘suasAs vyep-LJOUI Pajefal pue eyep-vIOUT [Loses 
JO MOIAJOAO UL :]X9]U0D Ul BIep-eIOW [ROISNeIS (6661) A ‘OMAOY 


aIHd VAOOITALa 


“satin san suonsessns 
SINd] ep gstetoads 1n9jo9{ UN 39 INasIAgI a] onb ourgUI 
op ‘solleyUsWIWOD xnaId9I1d sina] ap epeueD anbnysnei¢ 
B SONSI[OO XNdIQUIOU SdS IJOIONIOWIOI B UST} INajnNe J 


SINGHNGD Yanda 


“9]UL}[NSAI UOTPULIOJUI | op dyyenb ey] op 
OSEIULALP IOIONOS ds INv] [I ‘UONPIZIIUI,p Souped op udXouL 
ne sagutquios snjd ua snjd ap juos saguuop sa] anb sored 
‘uljuq “10-saq]a0 B yuaIOddes as Inb apminoexa,p suonsanb 
Sd] JoIg3 Nvj [I ‘SOANeINSIUTUIpe SodUUOp xne 9dI| stojied 
‘sajeulpnysuo] saygnbua say Inod juvssipuess 1Q19}UI,[ 
NA ‘sdoINoOs soo ap Inied eB saguUOp sap sinqiuye sop 
sanbyeulaisks sapmia samne .p Janjoojjo vipnes [I ‘soanen 
-SIUILIpe SdgUUOP Sap anid9v sourWOdUII | ap nus} adwi0Dd 
‘oseuUoT[NnueYsE | & Ssafqeindwit uoU sINdLIa sop oINsoUl 
PI 19 BJONUOS J] JoIOI[aWe s109Ud ynod UO ‘apNIoeXa,| Ip 
yso nb a0 Inog ‘aityenb ey op uoNsas ve] JQOI[OWIe 19 NNSg uN 
suep oyenb ap idaouoo 9] Joutynead ynad uo “usar | VY 
‘sonbusneis 
syinpoid sap uoneuojul,, mmyoua e aysisuod inb 
ashTeUL | Sp [e]USUIPUO] [OI Np Lor UONsanb sed yso.u [1 1q 
“UONBULIOJUL | IP IOUSIYOO PJ JOIJLIA B 19 UONRIaIdIOIUI ,p 
aiyiqissod vy] Jd1O1faue v ‘apex | JOYLIVA B ‘aoudUTIEd 


eR] JomuoOU! eB ITAJas yeAnod asdyeur., aonb guuonucw 
SUOAR SNON “NSq UN suep asdyeuR., op dourWOduUIT.| 
JQ0IOJUBI ap Issne jouttad aisiejo uondasuo0s ayjag 
‘ag]qesuadsiput jso [Ieavd} Ins] satfanbsoy 
Inod suosrei $d] nopNs ja sameyUsug[dur09 no safqueduwi0s 
JUOS NSg Np saANoe soy dinsowi afyenb suep saAojdua 
xne dsIpusiduio0d xno sey ‘suadt] sao uns ueAnddes ua 
‘qnod UO ‘NSq Np UldS NV UONPULIOJ Op SaITAIOR SOP oped 9] 
sueq ‘aiyenb ey op uonsas ev] & JUeNGINUOD s]UDWIZT ,.p 9.0 
®@ NSq un.p ures ne soyedround saytanoe sinatsnyid Jat] ap 
youtsod ayyenb e] ap a1d1e[9 UoIdaou0d 97199 ‘sINaTIe eg 
‘guyenb ve] op suoIsusWIp sone 
SJ 19 BPNINOeXd | OUD SafqeyTAguI stuIOIdUIOD sap UONsanb 
eR] Ja[saI jnod uo ‘InayesI[WN | 9p ona op yurod np ayyenb ey] 
Jasesiaua.p uedesso uq ‘ayeipiowtid uonesgpisuos oun .p 
sed duigui W138 Ss OU [I ‘SsINd}esI[IN XnNoIquIOU op INO ‘*s.1Nd} 
-eSI[IIN Sap SUIOSaq Sa] sed jIeJsNes ou o[Nas oI]9 Be UOTeUL 
-IOJul | op opnynoexe | ‘ajUeLOduII nb uarg “sudTONsNeIs sap 
UONCWIOJU! | OP OpNIWOeXd ,p d][9UUONUSAUOD UOOU BI Op 
31X9]U0D J IISIL]S B SINE 9.1NUS PeSIA soe JUasaid aT 


NOISNTONOO ‘OL 


NOISnssiG 


uOISsNysIp 
ap solanew 
ua sewou 
ya anbyWOd 


UOSIEJAI] 


ea ap sawayskS 


sanbiysiels 
sjuaweublasuay 


sa@@uuop 
“ElRW 


senbysneys: 
seauuog 


sawa}sks 
xne ja sapoyjauw 
xne juenb SewJON 


anuajuoo ne 
juenb SoWwJON 


suneyesijyn 
$9] ane 
uosielq 


dJANGO Ud BSI 
18 UuoI}daou0D 


anbiiiod 


synsaivsiiin 
S371 DSAV 

NOSISVI1 
sinajesi (ii) 


S@P UOOBONEY 


SAWYON 
15 SSGOHLIAW 


SLYOddV¥ 


ewwesboid 
Np sejeweieg 


ewweiboid 
@| ins suoddey 


saywoud 
Sap JUBWASS!|qe}3 


ERLSEINED) 
NOILVOISINW1d 


NS@ NN SNVG SLIIWNO V1 3G NOILSSS 


“SOUIBUUNY SAdINOSSal Sap BUaISAS-Snos uN zB yUeNb sydoidde 
QUN INS s}USUIOUSTaSUdI Sap Inod (766 |) epeuRD onbusneis 
ZAINSUOD “SUPJSJILS JUDLOS SJUdI]O sap SuTOsaq Say onb nod 
auyenb ve] ap SUOISUDUIIP Sa] $9j]NO} 19193 op JURWOdUIT so 


enbijsije}s ep neaing un suep seeuuOp sap syijenb e| ap uoNseb e7 :euo|syoRsG OLL 


[I nb syUdIOSUOD JUDIOS SAWIQ}SAS-sNoOs sa] onb Jalpnonied ua 
Ne} IT “NSq So] soej SIIvJ JUDAIOp sfanbxne sijap Sa] JAI] 
ap sajqedvo sjuayeadyod Ja sganout ‘ssuLIoj UaIq sgAo,dwia ,p 
sduia}_ 3no} ua juasodsip NSq se] anb inod snssap 
-I9 SJLIO9P SOWIIISAS-SNOS Sd] IPVOUS SOUTBUINY SIdINOSSOl 
Sap dua}sAs-snos un, nb JasesIAUd SUOLIADP SNON “UONeW 
-IOJUI,| Op ayyenb ey ap xnaronos syuajaduiod saXodwia 
sop ied saginosxe ang JUdAIOp onbysneis ap sowuress 
-oid sap sasevyd say soinoy ‘anbysneis op soumueisold 
Sap UOTeNTeAY | ap 32 aSATeUR | ap ‘UONdaoU09 FB] ap s}oadse 
xneiquiou ap inod juawiasnl np 39 astadx9 | ap ne} [I ‘NA 
SUOAR | SNOU SUILUOD ‘souT[dIosIp sasIaAIp Sup s}Ud}edWIOd 
SINIICALI] BP Ipl]OS sIped uN,p JUsWaWOJ JUOpuadeap 
NSq So] ‘sautaysAs-snos sao sno} suep jusnof saXojduia 
say onb [etonio afoi ay sed ayuasaid ou ouWUeIseIp 97] 
‘Iqoadsai e saatidoidde sowio0u 
Sg] 1a sanbnijod say Ins [eiguas snsudsuod uN,p JUSS 
-sijqej9,| @ Jodionsed juaatop NSg ne soulydiosip sa] sano} 
op sjuvjuasgidal sap ‘xno aud .p wednyid ev] ap oinyeu ve] op 
nud} a}dwioo ‘yWej u_ ‘so[jouUONestuesIO SayUN sep sed yuUOS 
dU SOUIQ}SAS-SNOS SIT “NSq UN suep azjenb ev] ap uoNsas P| 
R sallessaoeu sayedioutid suonouoj no souraysAs-snos burs 
Sd] o1]US SUOTIRTAI Sap Ndiade uN suUOp | SWIWRIZeIP aT 
“SJUDLUASSSIAUI SININ xne jueNnb 
SUOISIOOP Sd] JURITIOVJ OUOP ‘aTeIQUaS UOTROTFIULTd eT 
JULNQII}JUOD SJUSWISUSIOSUAI SOP INOUNS stew ‘UeINOD TAINS 
N S[IUIsse SJUSWISUSTASUaI Sop JUSWII[NIs UOU UOTDIIIpP 
RI & yUaInooId gyenb ev] op SUOISUSLIIP SASIOAIP SO] INs 
SIDING SI|[VAIAIUL B UOTIAIIP P] B Sajuasaid swTUeIsOId ap 
syoddel soq “UONPULIOJUL | Op UOISNIJIp ap ouprdei ey] ap 19 
apnqyoexa | op sInayestpHN xne ajdwi09 aipual yUdATOp nb 
SOWWLISOI Sd] JUOS Id “UOIJEULIOJUL ,| OP BOUdIDYOO ap 19 
apnjinodexa .p s1sap np uoNeNyeagd osgtuaid oun yUaNNsUOD 
soguUuOp sop asdjeuR.| Jo UOTeENeAg,| ‘souUeISOId sap 
dIped dj sue “ANA ap sjutod sno} e gyI[enb ev] Ans JUOIONTJUI 
Inb sagire[og SUOISIDap sep daipudid jo stuoOIdWI0d sap 
SIV] JUDATOP SOWMULISOIA Soy ‘saTeIQUds SIOINDOIIP SoUsT| 
yo sonbrijod xne 3a sayureyUOd XNe JUSWISWOJUOD ‘s1UTJap 
}S9 sjinpoid sap gyyenb ey onb onbnysiye}s op souueis01d 
Sop NedAIU Ne 3sd,9 ‘ayTenb ey Ins neoing 9] yow anb 
jusooe | aod nag ‘soumwesISOId sap syioddel ap awiaysXs 
-SNOS 9| 1S9 ‘SIPULOU J] UOU STRUT ‘SUISTURISU JOTWIAp IT 
‘NSd 
NP UONIIIIp ayney eI op sjuvjUasaidal sop ed sguNsse ag 
Issne JOP UOT}SAS BS “NSq Np seguuop sap uoNRIeId1a\UI ,p 
SMIIqissod ev] ap 19 DII[IQIssao0v | OP JURUILUIAJOp Ind}9vJ 
jedioutid np wse,s [J ‘Japgooe A 39 NS Np saouuop ap 
SUONDI[[OO So] Jargdai Inod urosaq UO SINsyesT[N soy WWOp 
SOQUUOPLIOU! SOP UOSIRIAT] RP] 19 UOTSOS eB] PucIdWOd eIaD 
“SINdeSI[AN XNV UOTEUWOJUL | IP UOSIRIAT] BP] JULUIBDUOD 
xneigugs sauiaisXs say sovyd ud JOU 3d ‘SAOLNOOIIP sous] 
Sa] 39 sanbyIYod sz] W]qQeie UOISNJJIp ap aWa}sAs-snos J] 
‘NS Np uonoslip ayney ve] op sjuRjUas 
-91da1 ap asodwios uonses ap 9ytw09 un Jed 9193 3S9 |] 
“SOUMWULISOId Sa] SUBP UONPUIOJUL | op sayeurdo uoIsNyjIp 
op oupidel ey] v 19 spnynoexa,| e,nb swigu ap ‘anbysneis 


691 


ap sunpoid sap uonereidsiaqqut ,p ayt[iqissod v] B19 BDUaIaYOO 
PR] &@ Jaluassd sa ouWiajsAs-snos a] ‘sastpyn sowaysds 
Sa] 39 Sanbruysa) say JUeUIZDUOD souIOU Say anb Isure 
‘uOTIRJUSUINOOP FP] B Ja NUDUOD ne JueNb souOU sa] sLIdu0S 
A ‘anbusneys ap sourtuvisoid sap dJANd0 Ud dSIUI BR] 39 UO] 
-daouod PR] JUassisai Inb saoLnoaIIp sausl] soy 39 sanbytyod 
S9] I] QuIa SOULIOU Sap ja Sanbruyde} Sap BUISAS-SNOSs JT 
‘anbnsiyeis ap sowueis0id sap sajuesodwio09 
Sop sjJOBXd s}]NOD say JUeWaJUdI sno sap sywodde 
ap sUa}sAs SpPI]OS UN, Pp UOTOUOJ Ud JUSUUAId as JUDWIDOURUIY 
ap eeu usa suOIsIO9p SAT ‘NS Np uoNdep ainey 
R] Op ayw09 2] Jed gstasodns jsa [] ‘sonbusneis syinpoid 
Sap VoUdIQYOO PR] 39 UONIaIdIO}UI,p sy[Iqissod eR] ‘aiITIG 
-ISS900B | INS JUDWIDJDOIIP Issne oN]JUr [I ‘OINONNSeIJUL,p 
SOUUILISOId Sap plesd,[ & JUSWIDOUPUTJ OP SUOISIZaP sas 
ap astwianus | Jeg ‘onbnsiyejs op sowuueisoid sap uoreu 
-IOJUL | OP UOISNJIp op aupides ey 19 apnynoexa | ‘AousuTed 
RP] INS sa}daIIp suoIssnojodal sop ev ‘dnoo np ‘Ja sowed 
-old say sno} inod sanoawresed say yqeie [J ‘sowmuueis01d 
xne juenb div] & SJUDWASSNSSAUI Soy NO SUOONPsl Sd] SUTLU 
-Inep uoNneoriueyd op yeraugs oua}SAs-snos 9] ‘soumUeIs0Id 
SOP SASSIIQIVJ SAP 12 SOdIOJ SAP SOUIOJUT sdoURSsIeUUOD 
}2 suoneNyeAd sap onb swgUI ap ‘sinajesI[WN say JoAr 
UOSIRI] Op sUaISAS NP JURUDAOId UONPULOJUL | op qed y 
‘NSq np sunposd 
sap sousuniod ey e wen e inb 99 Ud jUReUTIAIEp sIO1 
un onof |] ‘saytao1d say ins sjlasuod sap anb sure ‘syuemnos 
suinpoid sap assaisnf ey Ins Ja snagid jo sjanjoe UONRWOJUI 
Ud SUIOSAQ S9] ANS SJUDWIDUSIOSUdI SAP SULIIJUdI [J] “SINazes 
-I[Qn,p sodnois xnedroutid sas oaae JOeJUOS Ud JoINaWap 
op NSq ne juoyowsed mb sowsturssw ap aiigs ey] ua 
DSISUOD SINDICSI[NN SI] SAV UOSTLI] 9p DWIQ}SAs-sNos JT 
‘NSd 
un suep 9y1[enb ey] op uoNses ap [loredde un,p sawiaysAs-snos 
no sajuesoduwios sayedioutid buro say uv} SUTUIOD SUOIEp 
-Isuod snou aonb 90 suoasesap snou ‘uOTdas 9199 sueq 
‘Ionqiuos A no xneigugs sowiagysAs sap JasIyNN JUSATOp 
SOWUMULISOI So] ‘SOUUISTUBIOU SOIINL ,.P plesd,| YW “SoInsow 
sap 1a}00dsai no aipuaid yop NSq np ulas ne anbnsneis ap 
SOWULISOId sap UNDCYD ‘SOUISTURISLU S9O Op SUTe}IIO INOg 
‘NSq un suep ouyenb ev] ap uoNsas PY & Sayan say ‘stave o]0U 
B ‘WuOs INnb souUIstuRdSUI Sop IUTJap SUOAR snouU ‘ayTeNb e| 
dP SUOISUSLUIP Sap SUNILYD op USWULXd | SP Bped a] sue] 


XNVYANAD SHNSINVOAN °6 


‘sajgnbue 
soyediouid say suep aseuuojeja.p sjuowiajsnfe sap sour} 
-10dwi J op no uonejndod x] ap uoneuinsa,| suep asporied 
op UlJ Ud INdd,] sp ‘xneuoNeuU sajdwio0d sap sJonpIsel 
INd19,[ Ip tAtns a] ‘aydusoxe sed ‘ainjout yned uo ‘a1103 
-9189 dIVIUJOp 990 sued ‘saettqnd saguuop sa] suep saoual 
-9YOOUI sop sduRWOduI | ap Ja BDUaNbealy ey] ap ‘soygnbua 
Sop MANDO Ud STU BP] 19 UONdaUOD RB] INOd s{MNoO Ja sanbiu 
-YOd} SOUIQUI SOP UONRSI[IN,P NVIAIU NP Jd BdUd)SIX9,| OP 


6661 eiqwecap ‘ajenbua,p senbiuyos | 


‘SadA} UONBOIJISSE]D AP SOWIQISAS AP Jd SITQRLILA OP DOUAIOTOI 
Op SOIped Sop UONKSI[NN,p NVIAIU NP 3a DOUd)SIXO,[ OP 
UBV_S [] ‘SNSSap-19 s}OAp sJUdWUEI9 SIO] xne JUepUodsaLIOD 
SOINSOU IP SO[QUIdSUD SpULIS SIO1) IUJap yned UO ‘so]UdI 
-9Y09 JUOS saguUOP Sa] ANsowW s]janb suvp JonyeAg inog 
“S9QUUOP Sap SanbIJO}SIYy SUOISIADI Sop & JOUdU 
juaAnad jo sdwia} np asessed 9] daar nb sayqndaoied juos ou 
SQOUDIQYOOUI SOUILIAD “S9QUUOP ap Sa}sATeUR Sd] Jd SOUIAIX 
sinayesi[yn say Jed sgadpnos souaiayoo ap sauejqoid 
So] Ins oanied apuris ud JuoWlesa ssodai aousl9yoo 
Rl op asAjeue J ‘Jaljqnd ve saguuop sop uoNvoHuUeYINe ,| 
Op NO UOISNJJIP JURAL UDWILXD UN.P dIPed a] SUBP SddUdI 
-9}JIp say Janbijdxa us no saysoiddei say ‘saoinos sasJaArp 
OP SO9UUOP SI J9]UOIJUOS JUSANOS Inv] [] “saTetdads 39 sos10} 
-elo[dxa snjd juos saytanor sone .q ‘soyferoduisa} suosies 
-edul0d Sa] Ja}1[19eJ Ud Inod saguuop sap UOTesITRUUOSIesap 
RI ‘sofqely snjd ajoUOd ap xnve}0} sap ote} ud Inod suon 
-PLUNSO Sop d8P[Ld J] NO asvUUOTeIg | ‘xNeUOTIeU Sd}dUU0d sd] 
SUBP SOQUUOP ap UONPIZIIU! | QUOD ‘dUT]NOI ap 3a Satjon 
-IQeY SOUANOV SAP JUOS SdPAIOV SoUTeVII ‘UORIS9IUL, | 
auiz9U09 Inb 39 UY “sddINOS SaJUdIDJJIP Bp saouUOp ap 
UOLISIUL ,[ 19 UOSIVILACUWIOD BJ ANS JUDIOV | JOW 39 DATILIUD} 
3[[9} SUN .P s}e][NsaI So] Ins aod JuSUWIEIP OWISIO.N ey] “anby 
-SI}B]S Op SoWUvISOId sap BIANDO UD ISIW eB] Bp NO UONda|d 
-U0D BI OP SIO] JUASSI[S 9S DU S2dUdIDYOOUT sap anb Ja}IA9,p 
SUO}UD) SNOU ‘s]UdUa[a satUdId XNap sap sed oI] sue 
‘sajygnbua sa] sono} e nb swigu ap 
‘guatpnoied ajygnbus oun ,p sadeja sa] sayno} e yuanbryjdde_.s 
SJUDWINSIe sdd sno], “sagUUOP Sd] SUBP SYROd xNRJ ap 
sed ye A.u [I.nb 99 & onqgiuos ‘uoNendUw.,| ap 19 UOISIASI 
RB] op sodeja xnv ynouns ‘ajanbus oun _p yuswi9}Ie ap sadeia 
SOSIDAIP xe Sdua}sAS Jd sanbruyse} SOWIQUI Sap UOTeSTTNN, | 
onb ‘asuodal be] suep sino xne sajqenquye saoudiajjIp 
$3] DINPei op Joutiod saygnbus sasIaaIp suep Sal[[lonoel 
WUOS soTquieA soulguI say puenb sagsod jusuwanbej 
snjd sa] suonsanb xne sinosai a anb {(Issne suostes sazyne .p 
Inod unuwiwoo ansisei un asin uo) saguuOp say suep 
SOOUSIOYOOU! Pp JUSUIeIIUD,.U ajygnbua,p sdureyd s]UdIOJJIP 
soy aonb 19}1A9,p Jouad sastidanusa sap sgidne saguow 
saygnbua sa] Inod sastidanusa sap unWWO0d osIso1 UN.p 
uonestyn | onb ‘ajdwiaxo .p a eB ‘suouuonueyy “JdofqGo 
yoo Op uloye | & JUONGINUOD saguUOP ap JUSWIIIeN} 
OP 38 9}99][09 ap suNUTUOD sawa}sAs 39 sanbruyse} ‘asepuos 
op saseq op uONeRSI[NN | 9 UONRIOGRIS TJ “SWUWOJIUN dA 
SOIULJap JUOS JoINnsoU & sayWUeNb say puenb swaw saauuop 
OP SddINOS Sa] aU SadUdIYOoUT ,p sed oureUS,U dINSOU 
ap snssad01d 9] aonb AueIes & ISIA JUDUIQ[9 OWIQIXNep J] 
‘sag}dope sowiiou soy UOoTas 
assej os SaquuOp sap UOHONpold ve] anb nod souwwess01d 
Sap say[iqesuodsai sa] Juasstulyap inb sanbniyod sap ynej 
[I ‘e ua A [I puenb ‘sayeuoneusajul souIOU xne SOWIOJUOD 
UOS sagidope SOULIOU Sd] IS JURIJLIDA UD RJ 9S [PUOTRUIOIUT 
ued 2] Ins uostereduiod ey ‘sayqeuea saediouid soy 
$a}no} ev yuenbrydde ,s sadA} suoyeorjisseyo op Saula}sAs se] 19 
XNeUOTLU Sa}duI0d sap dUIQ}SAS I] SUILUOD SaIPBd Sop JULST] 
-1n ud Jo Juejdope ud juoUATJoNIIQey sALUe A UC ‘Soa aU 


SNUUOD SUdI] Sop UO JOWUITYSA B SayURNb say 3a ‘(aIIe[OOS 
Jaissop un suep aonb uonrjndod ey] ap yuaurasuades uN suep 
UONVOIJIUBIS SUQUI BI B KUOTONAISUI,P NVIATU» J] ‘ajduraxe 
Jed ‘anb yey inb 99) auigUi PR] 3S9 SISO[OUTWIA) BR] ‘AWIOJ 
-IUN }SO DINSOW LI Ip BIQIO vy ‘souUUeIZOId sa] sno} suep 
‘ISUIY ‘oInsoul NSq a onb sasiyetoads sjalns say sno} ap 
piesa | & SadA} SUOTIBOIJISSPI[D Sap 19 SaTqeLeA Sap ‘s}daou09 
Sop ‘saiped sap Jasi[yn jo JaIoge[a pioqe.p yney I] 

“syuowigy9 xnediourd 
S101] JUDUIZDUOD NS g UN,p UIs Nv 9dUaI9YOO P| Op uOT}sad 
ap S[NNO soT ‘[PuONRUIIIUT NKAAIU NB ddUaIEYOO FY 19 Sdu9} 
op souN sasioAIp & jueyoddes as saguUOp ap sjUeUIgT9 
SOWIQUI S23] dIJUI BOUdIDYOS P| ‘sduId} op dun sWIQUI BI B 
juvyIOddel 3s S9QUUOP AP SJUDWIZ[9 SIOAIP BIQUD BOUDIOYOO 
RB] puajus uo ‘sanbysnejs saguUOp sap aoUudI9YOO Ieg 


AONAAAHOD °8 


"SOIUINOJ ASATLUR | 9p 19 SOQUUOPR}OUI 
Sap yenbepe s19}9eIVD J] 19 DIITIN | ANS sinayesi[yN sap uoyoe 
-O]9I BI IIUI}QO 19 BdAJOSqo ISd Snssap-1d sasodoid anbytjod 
RB] dINsouw sffanb suep JOUMUIA}Ep Ne} [I ‘UONPULIOJUI,| Op 
UOT}EIDIGIO{UL ,P VI[IQIssod v] ap sgodons 9] Janyeas INog 
“UL0Saq 
B IndesI[NN,| Op ssquuOp Sop UONesS[NAIp a[duus el op 
ejop-ne ea Inb NSg Np ei[Iqesuodsal oun 3s9 JUSWOUISOSIP 
DOAB SOQUUOP SOP UOTIRSI[NN,| & dTess9ogU UOTCULIOJUL | 
Janbrunuu109 19 JUSTOSO UO B SdaSI[NN a9 JUSALOP SaguUUOp 
Sa] $9]no} onb asessow oJ Jassed aie “InajesipNn | sonbnpe 
B OSIA SOQUUOpPRISU Sp UONROTUNWIWIOD BT “INdIesITNN | 
awie[oe1 anb 30 anb snyd osrey ud WeJADP NSq 2] — aJenb ey] 
op UOISUSWIp a[Nes ve] & WOddes sed ang-jnad 1s9,9 39 — UOT) 
-PULIOJUL | Op UONRIDIdIIIUI,p dII[IGIssod ke] op neoalu NY 
“‘suoneol[dxa sop JouUOp Ja SagUUOPp sas 
ap SUOTILIDICI{UI SOSTRANCUL Sd] JOINJOI ‘SAARI SO SO] SUBP 
{IeIAOP NS 2 ‘UoWAsIaauy ‘aisnf ang,p seouvyo soo} op 
ev o1fqnd np uonejzeididjul,p nedalu Jomueid 9] ‘seipsw xne 
JUISSIIPR ,S SIITVJUIWUIUOD SI] IS NOUNS jo ‘ISULY “S9[NOTYDA 
sasessoul xnediouud say ins soire}USUIW09 op sgusedwio0soe 
ang WelAosp sasauuop op ajueyodut uorsnyyip onbeyo 
‘SagUUOp So] JUSWIA}OOIIP ajoidiajut NSgq 2 onb yespney 
[I ‘nal] Jatusop ug ‘onbytyod e] wWoagid anb 30 anb saguuop 
ap snd wesipusiduios adAy saguuopejyewW ap aseq a}00 
"NSq Np saauuop ap suoNsa|[0od sap sunoeys op uoNdiosap 
Bl B DTESSIO9U UOLVULIOJUI | JUPLIOJUDI SOQUUOpR}EU Op 
IDISOIUI VSL OUN JIVIAS JUDLUSTO DWIIIXNep FJ “WeINe aJa,nb 
ULIOJ BP] 19 JONS[NAIP & UONVULIOJUI | SA9QUUOP Op UOISNIJIp 
anbeyos snod jreto0agid anbrtjod ayag ‘saguuop say Jo}91d 
-19]UI Inod ULOSaq qUO S|I JUOP VSeq OP UONLUIOJUI,| SINd} 
-est[n xne Jonbrunuww0o e juesta onbyyiyod oun uo y1e19} 
-SISUOD JUDWIZTP JoIWIaId JT “sJUDUIEI9 S101) Ins 1aAndde .s ap 
SUOIOSSNS SNOU ‘UONPWLIOJUL | op UONPISIdID\UI ,p dII[IGIssod 
RB] Ud aJstsUOd INb ayI[enb ev] ap UOISUSWIp eI Joes INOg 
‘sonbysyeis saguuop so] 
Jajygidiajut sed sinofno} erinod ou inayestpyn | ‘MowenNny 


anbiysiejs ap neeing un suep seauuOp sap syjenb e| ap uoNseb e7 :euojsyoRsg exon 


‘outajut uosief un suep sed uo ja ANayesT[NN | ap ansury] vy] 
SULP UONPULIOJUL, | 9p JaNDIUNWIWUOD Sp J9dIOJJO,S NOP NS 
XT “ABolO Ne} P|] op dagfal apqisusyaiduio0d 3.yg Wop sonby 
-SIJEIS S9QUUOP Sd] JURIIL[I9 UOTBULIOJUT | onb apusjaig 
‘Cp UOIDAS P] B SAQOUOUD SUONRIAPISUOD xne s1puodsa109 
JUDIVIADP SPNINIOVXI,] IP SAINSIW SIT “BOUdIOYOO PR] ANS B 
UOTIOIS P] & IAPIOGK LIAS SUNUILUOD S[IINO Sap 19 SOpoOy OU 
Sop uonestynn J ‘apnioexa | Ins |p UONdas PR] e UONSoNb 
1SO [I 1UOP UONddDUOD ap sIONRU UD SUOISIOSp ap aiuas 
J] elINpeN sanbruyssj sap uoNdiuosap eT “aufIqissaooe ,| Ins 
Q UOT}DAS BI B WOOP 389 [I DWILIOD ‘ayqruodsip UOTBULIOJUL | 
Jorgdal ap sinajesipun xne juanouttad inb sauraysAs say anod 
sjueWOdui juswayesa JUOS s}daqUO0d say 19 SUOTIROIJISSeID 
SI] ‘SOTRUONPUIAIUT Jd SaTBUOTJBU SOWIOU XN SdLIOJUOD 
JUOS S$}dadUO0d Say 19 SUOTILOIJISSRID SA] DINSAU o[[onb suep 
Iyjqeja,p sowed juse1Adp saguUOpr}SW soy ‘ono Uq 
‘(QIULAINS UOIINAS P] IIOA) SAQUUOP Sap BdUaIOYOS Pe] ated 
QpuvIS Ud ISSNe JUSUTULID}ap sast[n sjusoel-snos sydaouo09 
9 SUOIIPOIJISSe[D SAT “ayenb eI op suOTsUdIP Sane .p 
}9 SOLIOS9IC SION Sdd dIUD Sd}O.ND SUOTIRIAI Sap v A I] 
‘(7661 BpeurD 
anbysieis) sayfrerap snd sjofns ap sajst] sap aynole ynad uo 
‘S1L1039}BO SIO ap OUNILYOD SUC] “JUSWISUIIOSIP 9oAe Saanb 
-1[dde 1a saanjoalqo ‘sanbiynuatos juUste}9 SogsI[NnN sopoyyoul 
SQ] IS ‘OSINS BS B ‘IaNTeAs Jnod INayesI[NN | — opmyydexa | op 
InayedIpul ane uN jsa sanbiuyse} sap uonduuosap ev] ‘apniy 
-OBX9 | OP SUOISUDUIP So] $9}N0} op [IyoId uN UNO} assind 
uO ,| onb died Sd [I DUIWIOD “(syeI[NSaI Sa] SUBP oURIJUOD 
IIOAB INOd) sa[qeIj JOS syeI[NseI sa_ sInsow ajjonb suep 
JIOARS Ja (Saast[nn Justos sagtidoidde sanbndjeue sopoyyeul 
sop onb nod) dastjyn uonenyeadg,p apoyjow vy] ‘(surosaq 
sing] @ Woddei red aousurjziad ey Jonyead ua ,p ULJe) SaINsoUr 
SJUSUUZTS Sd] STEUUOD JUSAIOP sINayestyHN say onb sey 
}S9 [J “SNUd}QO sj}e}[NSaI Sd] 19 DaST[N apoio eB] ‘soInsoul 
SJUSUIZT9 SJ Ins JUOWdATONdsSaI yUdWIOd salI039}e9 SION 
S90 ‘Sols UY ‘SO9UUOP Sap opNqoeXd,| Op Soinsoul soy (9 
19 SOQUUOP Sap JUSIATQUIdSSBI Sp 19 9199T]0O9 op sanbruysay 
Sd] (q ‘SAQUUOP Sap aseq PI B SUOTLOTJISSLID Sa] 39 S}da0U0d 
SQ] (B :S1IOS9}VO SapuvIS SION] Us sadnoIBal Jsa sanbysneis 
SOQUUOP Sdp UOISUdYSIGUIOD PI B SILESSIO9U UONBULIOJUL TT 
“SOOUUOPRISW Op UONBOIUNWIUOD P| INS JUOW]edrould 
ayod uonrieidiaqut .p aijiqissod ve] ap uoNnses ey ‘saguuop 
-RJQUI SOP NO UOTLULIOJUILJOUI RP] Op SaQUUOP So Ins uON 
-PULIOJUL | a[[adde ug ‘sanbysneis saguuop say Jo}9Id19} UI 
udiq Juossind sinajestjyn say onb inod sjuswaustasuss 
Op JUSUIWeSIfJJNs IUINOJ op nud} sa NSq ea lonbinod 
189.) “SANLSOU INITBA DUN ITOAR JUdANAd jd INITeA OUNONe 
U0 .U SIZART] Op sIpUdidu0d yUdAned no aipudidwo0s sed 
UdAnod au sInajesipyN say aonb sanbysneis soguuop sa] 


NOILVLAYdaaHINI.G ALITLAISSOd °*L 


"NSq suleliso 
2P G2M SOUS Sa] JULISIA U2 10 (6661) O¥AOG ‘(6661) 


ZOF 


[Yopog SUeP NS q SUIL1I9D JUDAIAS 9S JUOP UOSIRIAT] Op 39 ons 
-oyeye9 ap sauaisAs sap suondtiosap sap JaAno jnad uC 
“sInayestfiyn say sed soutudxe yuswisiqi uoneqgoidde ,p 
SdSVUSIOUIS] Op no sajuresd ap ‘suoNsassns op ‘sorle]USU 
-UW09 ap (9 113k ,S IN| [I NO ‘UOSTRIAT] BP SAUUQISAS NO SIOIAIOS 
‘syinpoid sap ev quenb sinajestpon sap uonoRysyes op s1sap 
3] Ins saygnbua,p (q ‘sauasks sap sajyursodwiod sasioAIp 
Sop UONeSI[IN | Ins soaseuojne sonbysneis ap (ev ITUDA 
-old jnad sinajesi[yn sap uoNovoNal eT ‘saguUOp sap 911] 
-Iqissaooe | ap sosnf xnedtoutid say quos sjt nbsind uosiesAqy 
ap 19 aNSOTeIV ap soWia}sAs sap sInajest[yN soy uasuod 
anb 90 o0Aes onbyeutaisds o1QIULU Op JUSWINTOSQe INV} |] 
“S[AMUISS9 JUOS SINIII SI][O} 
ap aiyiqissod vy juasinpai inb ayyenb ey] ap aouvinsse.p 
Saua}sAs SAT ‘“apmnoexa,| Ins ood tnb ayya0 e,nb oinjd 
DJIGIssaoov | Ans aod tnb uoNdes vy & Jojed udp sploap 
SUOAR SNOU ‘UOSIRIAT] BP] Op ddvj9,[ B Nal] IMOAR,pP satqu 
-dadsns JUOS SINILID S9]]JO} 9p SUIWUOD “suoydyya) ne sauuoOp 
ang judAnad s}UdWdUsIASUdI SIRANRUL ap 19 satTqnd ong nod 
XNvII Qe] SAP UOISIOA asTeANeU BI ‘sonbruoNoe[a saquuop 
ap saseq Soy suep sasieyo ag JUdAned sjudWIdUSIASUaI 
sTeANeUl ap ‘snssacoid np adej9 siaIWap aya0 Y ‘sinajesiyyn 
xne onbysneis op sounuessoid sop uoneuLojur,| URIZySUe 
Ud SSI] 9S dU Ina suNone nb 99 & JOTIIOA Ine} [] 
‘wed ane .p ‘sajuejstxo saguuop sap nied e uoneUl 
-IOJUI Pp SOpueWAap Sop UONNIEXa | 30 ‘Wed ouN.p ‘saguUOp 
SO[OANOU SP JUSWIOITLN VJ 39 9}D9T[09 PB] US SdIqi{Inbs UsTq 
JUOS NSq Np sooinossal say anb aos ud aie} 19 saguUOp 
sop aousurjied ke] Ins uoNeULIOJUI,p asnatogid soINoOS 
QUN IUINOJ ‘d}]IGIssaoor J AOANOWOId ynad anbytyod af[ay 
aUup) ‘sayetoads sapuewap ap jo Sal[Iviep sJUsWOUsIOSUaI 
ap ‘s}inpoid surey99 ap piesa9,| & SINOD Sap JUSWIIANODAI 
3] 19 o1[qnd jaIg}UI Pp seq OP SAUUOP SOUIe}IOD B SII] SURS 
DIIQissaoow | aUS sIquInbe un Iyquie Wop xud sap yusU 
-assi[qeid,.p onbrytjod oup ‘sinayesiyin sap s[aei SUIOSaq Sd] 
anleuuod op ieloyoedura snou vjao onb sored aqeiteynos 
uonnyos oun snyjd uou sed duIgUI 3S9,U 9D ‘a[qvasesIAUa 
uolnyos sun sed jsa,u sajfanuajod saguuop say $ojno} eB 
SUOTIOINSII SUBS SQd9R DIQIT] I ‘sn{d aq “saaITWT] JUDINEWAp 
SOOINOSSAI SI] ‘JUdBIL | OP 1UO NSq Sd IS OUIVJAY “UOISNIFIP 
ve] wse1 inb xtid sap juowasstjqeia.p onbiijod ey] iso 
UONCULIOJUL | SP SU[IGIssoooe | op yURWOdUT Joodse u 
‘NS Op ‘segy[reqep snyd yuowrayjoniqey ‘sopentur 
SOQUUOP OP SIdINOS XNv IOAUAI J] JOBeINODUD,p ‘Naty v A [I,$ 
‘19 SOQUUOP SOP BdINOS SUILUOD NUUODAI aNg,p JUBINSS Ss Ud 
NO} SUONLSTULTIO Sd[[9} Op DdAv JeLIRUOLIEd Op SUOISLIIO SO] 
Jisies JOP NSq 9] ‘UINWIIXeU UOs B JOS SAQUUOP xNe $3098 || 
anb inog ‘NSq np suy xne.nb sul sanne,p ev juesI{yn 
S9] Ud NO SJUDWIOUSIASUdI SNe .p B JULISEIUI Soy Ud NSg Np 
SoQuUOp xnv INa][eA oUN NO 9}x9}UN09 UN JoNofe yUdAned no 
SOQUUOP SOP SINdINGLSIp sud JUWaTduIIS I1Se JUdANod 
SUOT]ESIURSIO SOD ‘NSq 2 Jed aynpoid uoNeULOjur,] & 
an1ode SyIT[IQIssaoov ,| op 389 Inb ao Anod juvyoduit syoi un 
quonol ‘gatid 1naqdas 3] suep anb orjqnd Inajoas 3] suep jue) 
‘NSq Op Ino1191xa | & SUOTESTULSIO Say ‘sntd Us snjd aq 


666| aiquiedap ‘ajanbue,p senbiuyoo | 


‘ror sed suojapioqge ,u snou 
anb stew ‘(ajduiaxa red 966] epeurg onbnsneis 19 HSYO 
3] JIOA) NSq Sinaisnid saagje1 yuo nb stap syuvwoduit ,p 
SIQUIOU SUILIIIO UN JUISOd SAQUUOPOIOIU Sap B SIDI" IIOAR 
JUSALOp IND saqsAyeue sap sJotpnonied surosaq sa] ‘uoNeU 
-1OJul Ud dI]qnd np sulosaq xne oipuodai ap yuanuNUOS 
youJoIUT 39 sanbiyqnd sanbayjoryqiq sa] ‘setpawi saj aonb a0 e 
JOT[I9A NOP NSg YF ‘atsofouyoay aynvy & UOTI[IGINO} 99 sue 
‘JO9IIP UD NO JOWIDJUT ANS sopqissaooe JUaIOS say[a,.nb ‘NSq 
SOP UONLULIOJUL,P UOSILIAT] 9p SAWIA}SAs Sap INdO0d Ne ang,p 
JUINUTUOD JDdJIP US S9QUUOP ap Saseq SY] ‘SULOSdq SUIeIIS 
JUOJSNRS WOY-do ho anenbsip ins sanbruonseya syinposd 
so] aonb sioje ‘sinayestyyn xneiquiou ap sed gsud a10ous 
jueyinod ainswiep soUIdwW sap JOUUONUSAUOD UOSIPIAT] 
op oulgshs a] ‘yUatA Inb aporad ey inod sawiaysAs sya} 
op sISgIIALId 9aNUd Pp JUIOd 9] JUDUIOUILIAO BIAS [I SUOSIRIAT] 
OP SOWIIISAS Sd] JOUOJSURI] OP UII] UD JSd JOUIDJUT 

“ayoo.d 
JIUSAR UN SUP BNSOTeIO ap SoWaysAs Soy DIpUsd yWeIAAp 
anb d10A PY 189.9 ‘sagIBgIUI 39 soTfouUONredo JUsWOUTETd 
aiooue sed juos au sajuesoduios sao ‘NSq xnoiquiou 
op suRp ‘IS DWIJA “SaXOUUOD saguUOpPeIsU Sop ja S]USW 
-OUBIOSUdI SOP B Sa[quiquias sual] Sap s1pudidWOd Issne 
juoaned ‘epeued onbrsiyeig ap seo a] suep sauuaippuvo 
sanbijsyvj1g ‘yUIAJUT 9S UOS INS aUasaId NNSq a] anb 
sanbysnejs sx] ‘ssguuopejeul xnv ja sagi[iejap snjd saguuop 
ap sooinos xne ja saxouUOd s}inpoid sap anso[e}eo ap 
SdgNUd xNv SUdT] Sop JTUINO] ynad ‘epeueD onbuysueis ap seo 
J] suep ‘uaipyonG aT ‘sejqtuodsip jusway[aanou saguuop 
Sd] $9]NO} sagouoUUP jUOS Janbs] suep NSq Np uoIsnyjIp op 
[A1dIJJO DWUSTURIDU BY ‘saNUS_,p sjuIod sane xnep ap Ned 
B gfqiuodsip uONeULIOJUT.| dVeUUOD Jned UO ‘dsATSNeYXa 
19 d9IN}JONNS sa9UUOP ap ddINOS ‘ansojeed oI ued V 
‘sgooe 110ae A quassind Nsq 
Np INdLI9}X9 | B S9YdIOYSEI Sap 1UOJ Inb sinayestpyn say anb 
99 B SIQIULL Op Soua}x9 sonbrydessorpqiq sauiaisAs Sa] DBAv 
$9]UDJUD SAP dIN[OUOD JUSUNTOSge IOP NSq Np snsojeie9d 
Y] JUSWIVIPSWILUT SN[NOA UOPWOJUL,] JOPURUTUIOD 49 
JOUIO}UT Ins onsoTeIed ne sgoodv OAR ynod UGC ‘ansoy[eIed op 
dWa}SA$ UN,p a[anuassa ajURsOdWIOS ane sun Isa NS Np 
aslooid SISO[OUIWID} B] SUBS ON[NOA UOTPULIOJUL | JUDANON 
sinayest]un say anbnp uskow ne sninesoy} oy ‘uoNRUW 
-IOJUL | Op sanbysti9}9e1e9 saj J9ANON) nod uO sayjenbso] 
SUEP SAQUUOPr}9UI Op Saseq xne sal] ‘anbruos9a[9 UOISIOA 
Ud NO soUILIdUII UOTSIOA Ud ‘sanbysize}s s}iInpoid sap yOoIIp 
ud Sansoyeyeo xne sovjd es apgo v snol ve sivwel onbsoid 
eyo ,u Inb guitidut oansojejeo [ouuONIpey ay “‘uowepides 
JUSN[OAY UOSILIAT] AP 19 aNBoTeIeO ap soulaisAs soy ‘sanbis 
-oJOUYde} sjUsWASURYD XNdIquUIOU sap nud} adWOD 
‘oqins JouUOp 
A.p 1nq 2 suep 19-xndd op UOTRSI[NN,| NO UOSTeIAT, Op 
}9 aNSO]eIed ap saurgysAs xnv JueNb Inoyesi[oN | op UOTILY 
-SeS ap aIZap 9] Jonjeas IoAnod yop uo ‘ulyU ‘(QWIWIeIS 
-o1d np ‘seo surveyed suep ‘no neoaing np) satidoidde 
UOSIRIAT] Op SauaisAs sap ye} onbysieis op swwess01d 
oenbeys onb uonesiynn,, 3 nesaingq np onsojeied ap 


SOLUQISAS SO] SULP SddSIOA JUOS INb sauTWIvISOId sap sonbn 
-SRIS SOQUUOP SOP dINANOD PI Sdai98 JUaTOs aonb Issne 
ney [] ‘SInaqesipon xnv yUdUUdTAUOD INb suolyejUasaid sap 
suep UONNGLSIP asp xneued op UdKOU! Ne UONPWOJUI,| & 
$godoe JUNUUOP INb UOSTRIAT] Op xNvI9UaS SoUIaIsAS Sap Ine} 
[I ‘sing ‘Jo19d91 sa] ap 19 sayqruodsip saguuop sa] aneuU0DS 
op sinajestN xne yUseuLIEd Inb sgisayul usatq ansoyeywd op 
xneiguas SoUa}sAs Sap ploge ,p invj |] ‘syoodse xnedriouud 
anenb ins 19110d suOp OP a}TIQIssaooR ,| op UONSES LT 
“neaing Np anso[eyed ap sousajysAs say suep 
JUIANOI) ds sanbysyes syinpoid say onb Jainssv ,s ap 39 sad 
-oldde uosieiall ap sauaysAs sa] JIstoyo ap yuowlayedrourd 
WSe Ss [I ‘auUeISOId Np NedAlU NY ‘NeaINg Np a[eY99,| B 
UOSIRIAT] OP SOWAISAS Sap Jo UOISNJIp ap sanbrtjod sap sed 
A[QLIP JUSWISIL] ISO SI[IQIssaooe ,'T ‘[IVAVI] op JUDUIOUUOI 
-IAUO INI] SUBP Ja}OdUII ,| 19 JoIadal BT ‘9ISIX9 UONPUIOJUL | 
anb IoAes JudAnad sinaqest[yN soy ayjanbey oaae ay[IOv] 
PB] PUDJUD UO ‘UONPUOJUL,| 9p a}[IQIssadov Jeg “sayin sayy 
sed juos Ina] ou sgooe sed uO ,U s{I sfanbxne no ameautied 
as sed juaanod ou ‘sd1adai ap soyqedeour juos ‘jual0Us1 
sinayesijan say anb sonbysneis syuswiausiasusl say] 


ALIMAISSHOOV =°9 


“QI[IOAINS O19 WeIASP 19-Sa][I9 ap 1adsai J] 39 ‘SIdIAIS 
sjo1 ap e Janbidde.s juoreiAop souiou saq “juel[o ne 
UOTCULIOJUI | IP (UOSIIAT] NO) UONLOTUNUIUIOD BI 19 dIIe[D 
apuewisp sun .p uondadsal ev] annua gjnoog sduia} np uoNdUOJ 
Ud JUOWI[GeUusAUOD dP9INSOW ag jnod UONULIOJUL,| 
op UOISNJJIP op auprides vy ‘soquuOp op UOTORNXa,p Sast[eU 
-uosiad sad1Alos sap Juarjo Inb souuuessoid xne yuend) 

“UOTIN[OS dINIT[IouW VT SInof[no} sed 
4so,U JUaWopIdel snjd of — pad ins astwi ang Wop ajgnbua 
a][eanou oun ajenbry v ayipides ve] JOUIWIAJ9p op yUdoOULIOd 
Inb sinajovj sone,p ins 1oAndde,s stojajyno} Wop uoIs 
-njjIp op supides ey op uonejaidiaqut J ‘soualgyol op ajep 
RB] Saide UOINDaxXa UOS B 39 ‘aJgnbusa ouN.p pard ins astw Pv] 
B19 UONKOTIULId ve] eB yUeND NesINg Np dyzANdadaI P| WNpeNn 
DINSIU DNID “SIeI[NSEI SAP UOISNJJIP op ayep eT 39 aJgnbua | 
JQUSUL OP UOISINa9p kT sUS gNOD9,s Inb sdura} og] Jed 
Jainsoul as jnad uoIsnjjIp op oupide. ey ‘saygnbus sayjoanou 
Sa] jo sayeroads sajygnbua say ouraou0s Inb 990 uy 

‘Jourlunlys jnod uoNeUIT}sd | onb sastostaoid saguuop 
Sa] SUBP aIqISIAgId No ajadai steiq INO} Jo[Ad9p UOSe] SUUQUI 
R] ap nod UG ‘SUOISIASI Sap UOT}EIUSTIO | 19 DOUROdUIT | 
Side p UONPUOJUL,| Sp 9pNINdeXI,| 19 UOISNIJIP op oI 
-1dei e] aus stuoidui09 np aousutyod ev] Janyeag sioye nod 
UOC ‘SJNIUTJEP 12 SASTADI SOIJJIYD sap quarfqnd sind sastos 
-IAoId saguuop Sap ploge .p Juasnjjip sourweis01d sureya9 
uowapides snjd soasnjjip jualos saguuop sa] aonb nog 
‘QUIO] Suo] snd e sanagid uOIsnJJIp ap saiep sap 
SJUSUIISULYD SO] JI[[IOAINS JUDUIITLSO INV} |] ‘UONLULIOJUT | 
ap UOISNIJIp ap ouprides ve] op souewojiod vy] op ounsow oun 
anjysuoo sanagid uolsnjjIp ap sayep sap yoadsal a] “syQ49 UI 
soidoid sina] suep UOISNJJIp RP] Joprejoi ud no uOTeOITqnd 


enbisije}s ep neaing un suep sesuuOp sap syyenb e| ep uoNseb e7 :eucjsyoRIG 991 


oun Ins jusWINpUI Janyur sed juarelunod ou sagssaigqul 
soried sa] jnouns jo UIOIUI,| @ ouT[dIosip oun yerne A 
[I ‘soueyye Sing] Jaytueyd ap sdwia} a] JuUsTeIne sinajest[yn 
So] IsuLy ‘aouRAr| & Sdula}3uo] sagouOUUR O1]Q JUDIeIAOP 
suoneoygnd saredioutid sap uolsnjjiIp op soajep so] 
‘soinsaw sane .p ins soAndde,s 
SLOJ9INO} Wop supides ve] ap uONsasd eT ‘oupidel ap saneul 
ua snagid sjnoafqo sap ajulone., B@ JUOW[QeIgpIsuod 
JUINGINUOS (Zp UOT}DES PB] ILOA) DIANIO Ud ISTWI BT Bp Isa INb 
20 Inod snssap-1d sayloap SdiNsau So] ‘auUgUU aq “stenjyda< 
-U09 SIWIOIdWOD sap JUSUAITIOI[dx9 a}du09 JURUD) Ud UONeU 
-IOJUI | Op UOISNIIp op oyprides ey saigs JUOWIN[OSGe JUdAIOp 
NS S92] ‘opninoexe,| Inod guuonusul 939 & [I DWWOD 
‘sed Ie] 9] OU NSq 2] IS OWI ‘UONPULIOJUI | ap UOISNJIp 
ap aupidei ey yuouIa}aIIp JonyeAg ‘aInop uNone sues uaanod 
sinayesljon say ‘apmnoexe, | RB UoWoNeNnUOD ‘nowed 
ned un IMUas se] JUOIIS AS SISO[OUYIA LI OP S}aJJo Soy 
anb aoied saylos $9jno} ap SsadtAsas sap dureyo 9] Ans I1U9}qo 
B JUOIANIIGEY S S[I NO BINSIUW B Jd AN] Ne JUDD Ge{quUIaSTeIA 
jUOIajUsWISNe ayipides ey e jUeNb sinajesi[NN sap sajusne 
SY] “OWNXS INdUdT OP sed So JOAQTOI Inod sowUIRIs 
-O1d Sd] Sno} SUeP JOT[IOAINS Jo QJORJUI dINaWIEp aT[e,nb 
Inod aguuop apoied oun Ins said ap aJAtns yrespneys [t.nb 
queyodurt onbystisgjoesed oun Jso UONPULIOJUL | Op UOISNJJIP 
op supides ey jueynog ‘JouUONIpuOoU! JNoefgo un juanb 
-9su09 Jed sed 3sd,U UOTRULIOJUI | op opidel snjd uorsnjyIp 
dup) *S}]NOD Say INs Ja — {10} snjd sajovxe suIOW saguUOp 
Sap MOAR .p onb pie} snjd stew sajoexa snjd saguuop sop 
JIOAR Pp a[Qeiajoid [I-1s9 — opnyoexe,| B yUeNb stuo0IduI0S 
So] Ins JUSANOS apuoj as Inb uoNdsou0d ap uUOIsSIOap 
aun js sarjlueyd UONeWIOJUI,| Op UOIsNjIp op supides 
RP] ‘NA JUOUIITeS9 SUOAR,, SNOU sWUOD ‘sanbrunuwuw0s 
WUOs INI_ Inb sjUsWIAUSTIOSUdI SIOIUIOP xNe JUAdssIsedl 
sIndyesi[yn sa] affonbey] saae sypidei ey uoTas Jo ougWIOUsYd 
np oinsow vl ap sduanbelj ey uoTas ‘aarasqo ouguOUsYd 
NP UONIOAY,| UOTaS atIvA UONsoNb ay90 & asuodal BT {aT 
Q[[9-]-oINSUIEp UOTeULIOJUI | Ssdura} ap uatquios juepued 
— UONPCULIOJUL | Op 9oUdUTVIOd B] UOTAS dIUTJap 3S9 sEsNIJIp 
og WOp UOTeWOJUI | afjonbe] e ayprides ey ‘nA suOAR | 
snou sWWOD “Jay[Nsuod ev] JUsANed sinayest[NN sq no 
JUSULOU 9] 39 BWOddeI as UONPUIOJUI | aJJonbe] e soUsIEJoI 
ap epoliad ev] op uly e] NO soUDIEJaI Op JUIOd 3] aUS soINp 
R[ PUdJUS UO ‘UONCULIOJUL,| Op UOISNJJIp op oypidel seg 


NOILVWYOANI.T 
4d NOISNAAIG Ad ALIGIdVa  *S 


“apnqynoexd | 
INS SJUDUIOUSTISUdI OP SINAILSI[NN XNV UOTOTUNUIWUOD PT] 
INS SUOISIOSId SOP ZAIDANOI) SNOA ‘UONULIOJUL | op UONRIOId 
-19]UL Pp dyTIqissod ev] Ans 7 UOTOES BT WY ‘NSq Np uoNselIp 
B] & 19 SaIped sao quasifn mb sjanprarpur souuesSoid 
xne so[qn saguuop sap J1ua}qo Issne jnad uo ‘assaipe .p 
dI]SIS9I UN NO sastidanue sap ansiso1 uN sWIUOD ‘aygnbua ,_p 
soiped xnedioutid sap oinyaanoo ke] epniqey,p swi0d 


SOL 


dI]N391 UOSv] op JuvINsaW uU_ ‘sajgnbua souleyso suep 
saasod yuos as tnb saqnorjip sa] Ins no sjuepuodai say zoyo 
s]UvINOD xNRaANOU sa] Ins xna1ogid UONses op sjudWIOUs 
-I9SUdI SAP JUaNGO UO ‘saTqe{quas Sajgnbud sa] suep ossuodas 
ap xne} sap saduepud) sa] said ap yins uo puenb ‘ajdwoxe 
Jeg ‘neaing np a[ayoe,| & S]O ApNyOeXa Pp SINdJeoIpuUI Sap 
Jajo.NUOS jnad uo aTJonbe] ap ised ev sseq oUN JUDWIaTesa 
JUSNINSUOD S}USWIDUSIOSUdI SIT “AapnNynoeXd,| op uoneN] 
-PAQ,] ap aIoONos as NSq eg] enb ainsse.s uo ‘soumueisoid 
Sa] Sno} Inod apninoexea,| ap sjoodse anenb sao ins sjusw 
-dUSTOSUaI Sop “WINUUTUTU ne ‘ye A [I,nb a81xo uo nb sored 
step ‘aygnbusa .p uondaouod RY ap sio] sjaniiqey stuoidwio0s 
Sap nua) ajdwioo astid ag Wop Inb uoNsas op uOIsID9p oun 
JUOS OPNI}OVXI | IP DINSOW LI SUP INSIAUT B SUOJJa SIT 


“sapqeieduiod saligs sane .p 39 
S]P][NSII SI] JIJUD SAJULLIOCUIT S2DUDIDYOOUI Sap JOAIIOI 
Issne jnad uQ ‘aauUOp s[qelIvA oun Inod sasnadwony 
SUOTIRUINSS Sap & o1INpUOD jnad astduwI0d [eu JUSUIZ] 
-eiguas uonsenb oun ‘ajdwiexa ieg ‘uoNdadsuOdIID DAR 
S9ST[IN a9 JUSATOP s}eI[NSaI soy aonb yWeJ Inb 30 ‘aygnbua 
oun ,p Jornonsed yoadse un,p piesa] e suoneordwos 
Sap no o0Ae A Jnad | ‘ajanbus,p siei[nsei sap soual 
-9Y09 ap No spmNnoexd.p davis oWg[gold ane NOL “p 


‘sgigpuod uou xnr} soy 
anb sjuawioustiasual op snjd 31udjgo ,.p juowaTjaniiqey 
juayeulsod are} Ina_ uojas saigpuod uonendut ,p 
xne} say no ssuodeal-uou ap xne} sa ‘(sastidaua.p 
ssamiysuod suonrindod sop ywednid ey owwo0d) 
sonbineawiAse suoneindod say inog ‘«saanbiiqey» 
SdsuUOp sp SagsodwWi0d jUOS SUONPUII]SA Sd] sINsoUW 
gjjonb suep sonbipur.p yse,s [J ‘sanbiogy} suoneur 
-I1Sd sap sasejusoinod sa] no asuodgi-uou ap xne} sag 


“saqordxa 
sodAj-sinalla sop sagusedwiosor UuOU SUOT}BWIISS Sa] 
Inod soaneuxoidde sodAj-sino1d $3] JOALISp B JULAIIS 
Sapoyjeul soy onb swWIQUI ap ‘sg[d SUORUINSA Sap ple39,| 
@ UONUA OP SJUDIDIJJo09 soz no sadA}j-sInaua so] 
Jasiogid yeIpNe] [] ‘SasI[4N 939 UO SsUOT[MURYDE Sap NO 
S¥O Sd] SURP BSeUUOT[NULYSE Pp INdUId,| op UONeNeAY,T °Z 


‘(uone[ndod vy] ap saj[aroljyo suoneuinse sap 39 
SasvUusU Sap sgidne aygnbus oun ,p saat Ja suOTTHURYDE 
sap Ins sagpuoj uoneindod ev] ap suonewnsa sap 
aud y1e99 | ‘ajdwiexe sed) ayqid uonendod ev] ap sajyuep 
-uadgpul SUOTIRUIT]SA Sap B JUSWIDANLILAWIOD Same[OsIL 
suo][Queyos Jed ajygnbus oun,p uoneasasqo .p dureyo 
3] NO (9xas ZI 19 98R.] UOTAS NO sOUIAOId Jed UOT] 
-ndod e] ap yusurasuaoal un ,p dureyd 9] ‘aydwiexe sed) 
uonendod oun, p aysi] eB] Jassaup & asta Inb yUsUIasSUddII 
UN .P dINWIANOD PI ‘(SIANOR .p Ina}des Jed sastudanus 
Sop d1)SISaI uN ‘ajdurexe Jed) ajsi] Ins asevuUOT[HURYDE | 
Janfeag aiey.[t.nb op io0jnoa ynoad eyag ‘soqur} 
-Iodui suoneindod-snos xne ja ajquiasua uos suep 
uoneindod re] ev yuenb ‘ayqto uonejndod oun e yodde1 
Jed ajgnbus | op uoneaAsasqo .p duieyo np uonenyeas,J “| 


666] eiquiaoep ‘ajenbus,p senbiuyos | 


"SNOSSAP-19 SUOLIDA J] SNOU SUTUOD ‘SUOTRUIT}SA Sap 
uoNRIaIdig\UI Pp apiqissod ey JdOlawIe .p ulye sajuRoOdut 
snjd no saysea snjd sajygnbua,p seo a] suep saaiynsnl 
ang judAnad sagiiviap snjd suonenjeag sep no suonenyt 
-BAQ Sone. (766 BPeURD onbnsneis) saygnbus say s9yno} 
OP dIpPvo I] SULP IDI9PISUOD B OpNINOeXd,| Op UONENIeAg,p 
xnediouud sinayoas onenb tor suosodoid snon ‘suoneur 
-1]S9 sap ej UO | nb 99 ap 19 suTeIZOId Np souRVOdUII | 
ap joIpusdap apnjqoexd,.| Op UONeNeAY,p Sainsoul sap 
uoneonstydos ev] 39 onpudya,| ‘aJapour ay nod surwi0g 

"Sg SUOTJBUIT}SS 
SOUILLIDO B SINDICIIPUL SO] SIPUIANSaI NO suoneUINsd,p a]qei 
-9pIsuod sIQUIOU UN ,p opnjoex9 | Juanbrpur tnb sanbugues 
SOPOYISW Sap JarOgKIE yne} [I lonbinod 3sa,cd ‘saqusJejjIp 
SUONLUINSS Pp SITU sap wnpoid ayanbus onbeys aonb suou 
-UOT]UDU ‘sINaT[Ie Jeg ‘aygnbus anbeyo ev juanbiyddes tnb 
sjuryoduit snd soy sInayeorpUul Soy IIsTOYd yneJ [J “ayJouuoN 
-USUIPH[NUL 3S9 OpNjOeXA | ‘AUUOTUDUL 939 B [I SUTLIOD 

‘a3gnbud .p SINOD Ud SAQUUOP Sap IOUSISUOD JUDSANOS 
ynevj [lt opnyyoexa,| Jomnsoui inod onbsind uondaouos 
P| Op JUSUIOW Ne IIOA A SUOADP SNou ‘Nal] JaIWIap ua suojIed 
Ud SNOU IS DWIQ|Y {algnbus,| 9p SJANAO Ud SST BI BP 39 UOT} 
-da9u0d B] op sinod nev spnqoexa | B sapiodoR souPLIOdUIT, | 
op nud} a}dwi09 sajoexa yUOS saguUOp sa] aInsowW ojanb 
suep — UONPUWIOJUL,| OP OpNyyoexd,| op uOT}eNTeAY,| 1S 
ajgnbua .p snssaooid np oajueyodun sseyd owaision ey 


apnjzjoexa,| ap uoHENEAg ¢"p 


‘SINILIDI[IN sa[apoul soy Inod uoneJapisuosd 
ud slid a139 JURINe 3NO} JUSAIOp suOTeIadoO sap jUSWIOU 
np Xtoyd ne jd s}NOd xne Sal] s}UdUBUSTasUdI sot onb 
SUOSIODIg “‘sjouUUONeiedoO saleuUOT}ses Soy JUdIgINboI anb 
soguuop sop aried ounyjul oun nb onjyysuos ou apnjqoexe || 
B JUDW}OOIIp yueLIOddeI 9s UONRULIOJUI | ‘NpUd}US UDI g 

‘I0-XN9O Op UONUDIUT | & UOTULIOJUI .p 
SOULS SP NO IJANAO Ud SIU P| B adionsed yuede seXojdusa 
sop sgidne yey a] saide saguoul sapni9.p sail] sjyuouoUs 
-I9SUdI OP IISe,S SIOJajno} ynod [J “(seo Jomudid a] suep 
onb juswapidel issne assej as e[ao aonb airessaogu sed 3sa,u 
[IS SUIQUI) SJANIO Ud ISIU BP] JULINP S9USISUOD 9139 JUDATOP 
SJUDWIDUSTOSUDI SP ‘IOIUD BT “A[QPOW JJ JOIOI[SUWIe ,P Ng Z| 
suep [ouuoneiedo urd 9] Ins saat] suodey Sa] Jo souretqoid 
sap sasod juo ayapoul np s}oedsv sureyso Is ‘nagid anb [a3 
g)Nd9Xxd 939 B Jepoul 9] Is dnod saide Janyeags inod uonew 
-IOJUL | OP INV] [I ‘sIng ‘sinod us js aygnbus | anb yuepued 
SI[IOJIP SuoTeNIIs soy Jost0d Inod no 1y gf Joysnfel 
Inod snjnoa sjuswioustesuel soy JUoUUNNGO sjI jonbnp 
unyoddo sduia} ua UONPULIOJUI Pp dUUQ}SAS UN Pp UTOSdq JUO 
soireuuonses so ‘sodoid 30 Y “dJANSO Ud ISIUL B] Op SINOD 
ne juouuaramns inb sauayqoud say jaor sdu9) us 1aS109 ap 
}9 JOT[I9AINs op yUoNoUWLIEd nb syusWIOUSIISUaI Sop PIOgR .p 
ine} [J “IANO us ast eT] ap odej9,[ B SoITessoo9gU JOS 
s]USWIaUSIasUaI ap sadA} xnap ‘uONses BP] Op ona ap jurod 
nq ‘suoneoiyduros sap s110ae A sinofno} ynad [1 ‘(a~dwoxe 
Jed ‘ayyenb ey ap souvinsse,p snssaooid say) oJAnoo 
Ud ISIU SP SINIIO Sd] d1JUOD B[QpOW UOg UN ¥& SoaJUSIYUI 


suonsaj}o1d sal s1s[RJY “OJANBO UD ASI PY] Op JUOWIOW 
NE BSOIPSU IIIQAV,S SlOJajno} ynad sfapour uog up 


91ANIO UD ISI, Zp 


“€'p UONDeS BI B UOTsoNb vas 
Ud [J ‘OPNINdeXa | Ip SOUSISYUI SUONNLAY So] :JI9pIsuod 
Be yoodse SUIQIANDU UN dSI[ BT Op ated sed je] ON 
‘anbryeid ua 39 d1109} UD SUOTJeIBPISUOD Sad ap diqiinbe 
Ud ISI BT JONSNI][! (C661) UML] 39 DOvUTT 19 (S661) 
yiwwg ‘ajyduiod ua std juos sinajovj xnedtourd say onb 
o10s ud yteJ IND 39 JUoWaSN! UN 1901aXx9,.p Jawad Inb sipeo 
UN SIOJa}NO} ININSUOD S]UDSWUZII,P dISI] BN0D ‘uoNdsaou09 
op odinbg,, ap saiquiout sop juawesnf a] ins osodal 
ajgnbus,.p sanbruyse} sap ao10J eB] ‘aydw09 ap uly uq “apryos 
yso aJgnbua .p uondaouod vy] onb yuawWa}OJ aIQsINs ‘UOISIOSp 
dINI{ [IO eB] sIpusid op yUOWIgOI0J sed youLad ou JoJapIsUuOd 
So] Op Wey gf onb ya aJgnbus,p uondaouod xv] ap suors 
-USUWIIp So] $9]No} sed JUSqo]SUd ,U S{I,S Wg ‘s}oodse JINY 
S99 Ins gydued JUoUASNATIEsS 1sa,s UO,] onb sanaid ey 


“sojuepuodsall0d SoA} 
-991109 soinsau sep Jonbijdde 3a saguuop sap dula}xa 
JO QUIDJUL BOUdIDYOO RI IP Sa[QMUOD sap kB IOpZ001g ‘8 


“soguUOp Sop USUI 
-ULI] NP 19 9}99T]09 ve] ap saseyd sa] sajnoi e syyenb vy] 
op souvinsse .p snssad01d ap aiissaogu PB] JoIpmia uaIg *L 


‘sajuenbueul saguuop Say 9A 
Josodui09 & 19 asuodas-uoU ap sed sa] Said op JJAINS B 
‘gsuodal v] JasvinoouUs B JURSIA SaInsoU sap sJonbyddy ‘9 


‘sdura} op apotied oun ins saguuop ep suosieiedui0s 
Sa] 19 asuodal ev] Op Neapse} oI ‘sINOD say ‘UOISNIJIp 
op supider ey ‘apnyoexe.] Ins aoueprour iney aonb 
QUIQUI Op ‘UOTIBUINSA Pp Jo BSeUUOT[HULYSE ,p SIIIWBU UD 
suondo sa] Jalapisuoo ‘xneiguas stuoidwioo say Inog ‘¢ 


"S99BPSIAUD BSEPUOS ap Saseq sap 
uaXoul ne afqid uonendod ej ap ainyaAnod RP] JoneAq “p 


‘ajgnbua | ap sonbudjeur jo syn 
-duosap sjnoalgo sa] oipuloye & aJ1JjNs JUSATOp sogsod 
suonsenb sa] ‘soireuuonsanb 3a suonsanb sa] Iressa. 
® alow 19 sagsod suonsanb sap osunovyd Joynsnge “¢ 


“SONU $a}d9T][O9 
So] JOA B Jo JUepUodeI Np Neapse] JJ oIINpel kv 
IDI SIA UG “SO9UUOP SAT[OANOU ap 9}99T[09 B] UNUITUTU 
nv o1Inpel op ulje ‘satqiuodsip synesturuupe siorssop 
Sa] NO sajuRistxa saguuop sa] studuios A ‘saguuop 
IP SOANLUIAITE S9dINOS Soa] JUSWIWOI[dx9 JaJgpIsuoD ‘7 


‘ajduioo ua std 939 JUSUITWURSTJJNS JUO STUIOIGUWIOD Soy 
anb JaNUOU! sTOjajNo} ynvj [J “saneuesed sap uoNouUoj 
ua suondo,p siquiou np jo swurelsoid np sour) 
-10duwI [| op JUOIpUadep sUONeIAPISUOD $99 Op [IeIEp op 
neaatu gj Ja uoNeordde .p dureys a] ‘uondaouod vy] op 
aseud Pp] JuvINp JuUepUuoda Np Neapiej 9] 19 UONRWOJUI 
ap uOoIsnijIp op oypides ey ‘synod soy ‘apnynoexa | 
anus stuo1dwi0d say sno} JUSW9OI[dxa JOIgpIsuog “| 


enbisieys ep neeing un suep seeuUOp Sap 9syyenb e| ap uON}seb e7 :euojsyoRg p9l 


‘syoadsv qiny ins juaweyediound ay10d uondaouos vy anb 
suolassns snoN ‘uoNdaouod PR] ap aseyd PR] JuUvINp a}dWI095 
ud sud jUaIOS UONPULIOJUL,| Op opnynoexd,| ap sjoadse 
sJUaIg}JIp say enb anod sasestAud Wop uo, aonb uonses 
ap orgneu ua suonsenb sayediourd sap saureyad IdAg[O1 
I0I SUO[NOA SNON “(jsue ¢Z Ud UONsanb ze] ap sien JUoW 
-ulepuoge & andal ajuasaid ey) aanbua,p sanbruyse} say ns 
S}l199 sap ja[qo,] 1S9,9 — suoNdaouod sainaT]IowW! so] JUQUUOP 
mnb ajygnbua ,p sanbruyoe} soy S1LId9ap ap 1dr sed y18e ,s dU [J 

‘QUUOP INALISJUI XN} UN & DINSLI9JUI JOS ou JURWOdUIT 
adnois-snos un,p ainaanoo ey aonb sues ‘siogid [eqos 
SINWOANOS op XNv} UN JASIA Jnad JUSWdSUd.AI ap BJQpoOul UL) 
‘IULJap NVIAIU UN & INatajur sed jos ou Inb asuodal ap xne}y 
un Jasoddns ja [e1outaoid neaalu ne guUOp [Inas uN _p edap 
ud 0s Inb uoNBvUINSs oyedioutid vs ap piesa] & aseUUOT[N 
-ULY99,| IP UONLULA IP JUDIOIJJOOO UN DIPUIOe & IOSIA 
jnod sasepuos sed aygnbua oun ‘ajduroxa Jeg ‘SuOISUOWIIp 
yo suoneuyss sayedioutid say ausaou0d Inb 39 ua sulOW 
np ‘apnyyoexe.p sasayjoddy sap no sajqio sap saais9jul 
JUSANOS jUOS satjonbsay_ suep ajygnbus.p sonbiuyse) sap 
uondaouod ve] ap adej9.| ap aqpnsai [] “xneigues sanouresied 
SOP INDIIDIUL,.| B SINOD sJUdIAIJIP B spNyoexa.p xneaaluU 
op aianeul ua suondo sasidAIp say snssadoid 30 suep 
JOBESIAUD Ne] |] “UepUuodsl Np Neapej np ja sallejaspnq 
SQUILIUOD SOP UONOIUOJ UD UONRWUOJUI,, Op UOISNJJIp 
ap ouprdes ev] Ja opnqnoexa,| aUS nat{IW aysnf a] JOANON 
ap aresso uo ‘uoNdaou0d eI ap sped a] sued ‘soguUOp 
xne juenb safqio apnyoexa.p xneaalu sap ‘uondaouos 
Rl Op Ingep J] JURA ‘IOSIOgQId Op JaAeSSd.p B[NUL OUIQUI 
no a] qtssoduit yresas jt ‘aygnbua ,p surureis01d 1no} ap soe} 
‘soarylueid uou jo sagtiueyd ‘saskyeue sap 39 SUOTIBUIT]SA Sop 
anoydnjnu ey ap nua} ajduioo ‘yey aq ‘aseuUO][NUeYDE ,| 
B gfquindull UOU INdIIa,p sayqvig]o} xnedAIU Sop UOsoNb 
er] snjd uou sed yuapioge ,u saneureied say] ‘ansea xnoru ne 
OINOWAp «$a}dexXd» SaguuOp Jed puajus uo nb 90 sreur ‘suon 
-PUINSS Sap (STATOR Pp Ind}oas a] 19 onbiydeis0e9s UOIsEI 
eR, ‘ojduioxa sed) n[noa [Ieyap op Nedalu of Jo JOWNSS e& 
sgijuenb sayedioutid saj judAnos yuanbriput sj “saguuop sop 
apnjyoexa | auII9NU0N INb 99 Ud SaTqId ap jUusWAT[aNIIqey sed 
JUDSSIULJOp oU OWIUIRISOId op xneIgues soNoUeIed Soy 


uoyndssu0g [Pp 


‘UONeNIVA, | 19 IANO Ud VSTWI RT ‘UONdaOUON BT :a}gnbua | 
ap sadeje sayedioutid ston sap sinoo ne saguuop sop apn} 
-1]08X9 | Op Joinsse Ss JUDWIIOT[NOIWed Jno} eIPNe} [I ‘SoQUI 
-eled Sao ap aiped a] sued ‘JUOIasodsIp s|I JUOP sdoiNos 
-SOl op dQNeUI Ud SoaTjQWIeIed say Ja XNeIQUaS SJnoalqo 
SINd] ‘saIndexe JUOIEs INb sowueIsOId soy JUSUTUOOp 
sououtjied ey] nod uonsonb ai & [I Op snssad0id say] 


AGALILIVXa Pp 


col 


“UdIg JUDUUOTIOUOJ SaytoLd sap 
JUDLUISSI[ GLIA, P 19 SJUDI[O S9] O9AP UOSTRI] ap Snssaod01d sas 
anb jUSWIeIA JUDTUOUL oN | B souUUR oUN,p SoUItULISOId 
sas & owiodde NSq 2] anb sjaei syuoWasuURYd So] ‘UIJUq 
‘assaid vy ed stidai quos sji,s nowns ‘sjusuIIed 
yuos NSq np syinpoid say ‘ayqisi] uonejuasoid oun 
suep asdyeur .p syey[Nsol sop uoTeoT[gnd JuswaJaT[Nsal v A [I 
puenb onb sawtyye ynod uo ‘aje1guas uodsey aq ‘sayuoutziod 
UOS SaguUOp soy onb yudWOUTe}I90 aQUOW SITGnd 3919}UI .p 
suonsonb sajuryoduit .p juapronya nb NSg Np saguuop sap 
Ins s9puoj asAyeur .p s}e}[Nsal xneaanou sap Jorgnd ap 3a 
Jo[VUSIS Op We] VJ “UOISNyUOoD ke stojred Ja}I10d 3a oxoTdwio0s 
ang ined uonesi[yn | Ins xud sap sousproul | “uepuaday 
‘JOUIOIUT INS SJUSLUNIOP So] JUSWUULIOU ‘s}INIVIS SIOIAIOS 
Sap 12 syinpoid sap UOTeST[NN | op UOTOUOJ Ud saINsoU ae 
Issne JUdANAd JQIQIUI ,.P XNVIAIU SY] ‘SAQUUOP Sap sousUTIEd 
PB] OP JUROUIVAUOD Jd JODIIP INDJLOIPUI UN JUOS UONPWOJUL,pP 
SOdIAIOS Op 12 syINpoid ap saqudA sa] ‘sanbisayeys suots 
-109p SojUROdUWI,p Ins snjJul yUO sanbysiye}s saguUOp So] 
anb sjuvouleauos sajduraxa sop Jed Ja uoTORIsIyes Op gId0p 
Ing] INS s}UdI]D sop sgidne sgudW sasepuos sap s}ei[Nsel 
S23] UOTIS ‘aIIeJ JSa Ud INb UuONRSITNN,[ UOTEs sa}UsUTZIAd 
jUOs saguuop soy onb juUsuUI9}90IIp JaAnoId Jnad UO ‘sing 
“SUONEN[LAD $99 OP Sj}e}[NSBI SOP BOUdPIOUT ,| Jon[eAag 
ned uo 39 outueId01d anbeyo ap saguuop sep sousutyod P| 
ap onbipotied uonenyeag no v A [I,nb danaid ey aiey jnod uo 
‘souIweIsOi1d sap ona op julod nq ‘“sowstuRd9UU S[9} op UOT} 
-NO9X9,| OP JUDUSIOUID}] SUONI[NSUOD Sap NO suOTIeIIqITap 
sap swoddei sa] ‘sonbrysneis soguuop ud sUuTOsSaq Sino] kB 
juapuodal s]I JUOP SUOSE] Sd] JURADO Ud 39 SJUBUDAIOIUI,P 
no sjudljd ap sednois xnedioutid sap unovys juawenby 
-PUI9}SAS JURIPN}9 UI UONR}[NSUOD ap SOLUSTURDLU Sap UNL 
-1jdde .p dwieyo 9] Jonyeag ynod uo ‘aydwiexea seg ‘avd ua 
JUOS SNSsap-19 S}lIOap snssado.1d sa] aonb yUaQUOU doUSprIOUI 
Ina] ap ‘sainsoul sap sed uouts ‘sayduiexe sap sed sagAndde 
juos Inb sgsi{yn srotpnonsed saustuvsgur sap suondiuosap 
sop ‘pioge .q ‘aousutjied ve] ap yso Inb 30 Inod souruojiod 
eR] op soinsowu ap sadd} xnedioutd xnap aystxa I] 


soeulojied Be] apiaAINS f'¢ 


“OUUeISOId Np s[quIdsUd | B JUDLUIDA 
-Qeiedwioo ane | 8 sauUe oUN.p sJUatasULYO ap ned v A II 
‘syley So] Sued “ed ane ,p ‘oseq op ourweIsOld np sojuoU 
-eullad saouastxe sayedioutd xne aipuodai ap ayssao9u 
RP] 10 ‘ued ouN,p ‘SUONRIOI[OWIe Pp Ja SJUDUASULYO ap UIOSaq 
3] aU sIqt{Inbs un yuRssI{qeia Ud SayOLd soy SUTUIA}9p 
UO “(Q866l epeURD onbnsneig) sonbysneis sounory] 
soyedioutd say Jo]Quiod ap nq 9] SUP [eapsj JUDUIOUIOANOS 
np sasguuop op sinajyestyn xnediound sap jusweouruly 
Np 19 USTNOS Np ArUa}qoO B JURSTA sonbIpolied sad1dIEXxa sap 
ied ai9[dwi09 3so uoNeolIueld ap afoA9 a] tonbinod 3sa,.9 


6661 Biquasvep ‘ajenbua,p senbiuyoe | 


“QUIOIUL UONRIDAJJeal vl Op udsXow ne IIUdNG0.p ajqissod 
yso Inb 99 JURBPIOXa SadINOSsal Sap JUDUATJaNIIGQLy ajIssao9u 
SOQUUOP OP 9}99][09 Op SOANLIIUI So]ULOdUIT,p JUdWIdOUP| 
JY] ‘SIULISIXS SOMMULISOId Sap 9LOVITJJO,| NO UONVULIOJUL | 
op UOIsNyjIp op gyupider ey ‘apnynoexa,] JoIOlaue ,p 
no sjuvyodurt snjd spuoj ap insed ev saguuop say] aimmpoid 
ynod uo yuoWUIOD JoNUOW Inod yUaWIaDUR] ap xnedeo 
SOP ITWUINOJ dp ‘SaQUUOP Ip NLU Ud S9dAIBSGO SaUNe] S23] 
Ja[QUIOD Op SNA Ud dII[IQvsIe} 9p SapNjd Sop suLp INSIAUI,p 
Japioap jned uC ‘snssad01d np a1yU99 Ne jsd a]Januue uONeSD 
-Ij1ueyd op panqiqey a[dA9 9] ‘epeued onbnsneig y ‘sinay[ie 
INSSAUII B S2dINOSsal sap J919dn991 INod aoR{d us souNIeIS 
-old sa] Ins 9g0J9xa uoIssoid eR] a1Inpei op ‘dnoo np ‘a 
SOIeIOLId JUSWUAINeY UONLULIOJUI Ud SUIOSdq xne s1puodal 
op Joremoulod Inb spuoj xneaanou ap uoNUAIGO Pp saz[Iq 
-Issod sa] JoUIdO JUSUATeS9 jNeJ [] ‘SInojesijNN,p sodnois 
SJUIIIJJIP SOP SUIOSdQ SIOAIP So] UOWASNf ap dAnoid JuRsIey 
ud Joredwios ynej [I ‘sayqruodsip spuoj xne sainotadns 
sino[no] JUOIas SapURLAP Sd] SUTLIOD “ajINs JouUOp A Inod 
QUIWUeISOId ap USWIeXA,| Op 39 SINaJesT]N sop saidne suone} 
-[NSUOD Op BIped d] SUeP Sar][IoNnde1 saauUOp sap a}dwI09 
JIUd} B aJSISUOD IND snssad01d 9] B A [I ‘Ndl] JotWIap ug 


sa1olid sap yusWassy|qeyy = ¢"¢ 


“SJUSI[D Sap sutosaq xne snjd yuspuodgs ou inb soumueis01d 
Sop SUP JUSWSsNSaAUIgI Np no sassedap sowtueis0id 
SUIVLI9D ~SUBP SIISOAUL SPUOJ] Sop eNO Np assise,s 
[I,nb ‘\uowassijsoAur,p sigteW Ud suoNndoO sap UOTUIJap 
RI B JUONGLyUOD saTTq “sjuvINOD souTtUVISOId sap snuNUOS 
90Ud}SIX9,[ ‘asIeUI Ud sUIOW np ‘juaWIONbipotied asnes 
Ud BJOUIII Op UNWTWIOD Ud JUO saydoIdde sad saynoL 
‘NSq np siinpoid sap sounory] soy 
JOUIIO ‘UOTRISQIUI Pp sasATeuR Pp xNeVAvI} Soidoid sas ap ayIns 
Jed ‘tssne ynad jy ‘sanbusneis syinpoid sap uonesinn | no 
SOUSA SI] JOT[I9AINs Jo onbysiye}s sp swueIs0I1d np sojues 
-Odui09 SasIdAIp Ins juROd sInayeslHN sap uonoejsnes 
op g139p a] Ins saygnbua sap Jouaw ined NSq I] 
‘sInaypie no sumueIs0Id 
QUIQUI 3] SURP SPUOJ Sap JUdWaT[aNUD}0d JUOIAa.AI Inb xnao 
B Joredwiood sa] ap ulye sjuewoduit surow say soumwueiso1d 
-SNOS Sd] JOIJNUSpI,p sourweiso1d xne Japuewap jnod 
UO ‘se{qissod oumeiso01d ap sjuowasueYyo say JueSuOUE 
woddel un J9sIps1 39 WOATOSEI sjI.nb sorreyUsUIWOD 
so] juawonbipowed sJoneag je Il[lendel IWOAap jusAned 
soumueisoid say ‘soumuvisoid xne sayodde e sjuow 
-OSULY SOP IPULUTUODAI 39 SIN}LSI[IN Sa] dI[NsUOd [I,Nb 
Inod juepuadeaput yadxe un,p Sdd1Aras xne IINOdeI Jnod 
UOC ‘SUOSR] SASIOAIP ap ale} 9s jnod UONENTeAD III9) OU) 
"squar[o 
SOP SUIOSAQ Sap UOTOVISHeS op sIS39p np Ja[dwioo nes[qri 
UN IIUD}]QO .P ONA UD YNILAY UO Jd DISQIUI UO JUSWIOUTLIIO 
aonb sairejuswigiddns saguuop sap Ja[quiassei Issne ynod 
UO ‘S]USI[D S2] NBA UOSTRI] ap spaniiqey SaWUIsTURdaUL Soy Jed 
d919UIS UONLULIOJUL | OP ISI[N UO ‘SUDLULXO S]O] BP dIPVO 
3] Sueq ‘saiinpoid saguuop sap UOISNJJIp op supides vy] v 19 
opnyoexa | 8 11 e Inb 90 ua Issne sreul ‘soqIe) sjofns sap 


ys nb 99 nod juswajnas UOU ‘sINd}esI[MN sap sulosaq xne 
jugpuodal 19-xng0d Is JanyeAg Inod a1gt[N39I aseq auN INs 39 
dOydxs gue op soWUeIZOId sa] JoUTWIeXa JURpUddad 
Nev} [[ “SININJ 19 XNVIANOU SUTOSAQ Sd] INS UONRUWIOJUI,| Op 
snjd ud sjuvinos sowwuess01d say Ins sinoyesi[yn sap wed Py] 
ap UONIKONAI BI OP 11U9}GO ,p JUOIOWLIEd snssap-Id syLIDap 
jUOS IND syUdI[D Sd] DdAR UOSIVI] OP SoUISIURDOU So] 


swmWeIs01d np uaWIeXy 7°¢ 


‘g1qelj JUUIUeSTJJNs sed yso,u Inb no ajqruodsip sed jsa_.u 
Inb sinoqesiqyn xne ailessaogu uoNeuOjul | — onbrsiyeis 
[rosedde | ap sounder] So] JOUIIO B JUDSIA SOLUSTURDEU Sd) 


“SJUDUIDUSTIOSUAI Op SopueUEp sop 
991] 19 SINdesT[NWN soy Jed sgjnwWIoOJ UONdvONeI kJ Np — 
‘sastidanud sayyjed ap suoreroosse jo SaT[alasnpul 
suonersosse saedioutid sat o9Ae soalUuOoUdI sap — 
‘SayeroutAold aed spurs ua saouajadui0d ap sinajoas 
soy suep onbysnejs jyuowoddojaasp np uonses e{ 
Inod sonsnf e] ap 39 jues ke] Op ‘UONVONpa,| ap sinajoas 
So] Suep sayeloeds sayetoutAold-sayelapej sajuajua sap = — 
‘snuuod 
JUIINIWIP XNCIIOILII} 19 XNPIOUIAOId syUDWIOUIBANOS 
sap onbysneys ua sutosaq say anb nod sidaid sjafns sap 
INS SIITLPUODAS S9}IWIOD sap 3a onbNsHeR}s ap s1gWeW Ud 
anbniyod ey ans yeroutaAoid-jesapaj JoeyNsuos [lasuod un — 
‘soumuueisoid xnevaanou sz] 
NO Sd9SPSIAUD SUOISIOEP So] SuUBp sayOT|duut sanbysiye}s 
SOQUUOP Ud SUIOS9Q Sd] IOUIOO B QIQIULL Op Sa1STUTL 
xne suontsodoid xne saooe,, stiduioo A ‘soumuwieis 
-o1d say yo sanbniyod say ins sansiuru-snos sap 
SUOISSNOSIP xne Joyo Ud UDIONSNeIs np uoNedionsed ey = — 
‘[eIape] JUDWIOUIDANOS Np soigysturw xnedioutid 
Sd] DOAR SoTeIOads sayesa}e]IQ SUOSILI] Op SajJUd}JUD Sop = — 
‘sasteroeds sinajoeas xnediouid 
Sap saystjeloads ap sasoduioo sjneinsuos saytwi0d sap.) — 
‘anbnsieis op sowuueis01d 
sop sawioud sat ya sanbiyod say ins sjlasuos 
sop ouuop inb jeuoneu onbysnejs ap jiasuod un — 


(9661 
ISa]Ja-]) epeueg snbysneys sed sasipyn sowstuedsowWi SUTeLOO 
‘g]duroxd,p oN & ‘suOUUOUSP “SASIAQI NO xXneaANOU 
UONPULIOJUI Ud SUIOSAQq Sop JoIpUdsUd.p Sa[qudaosns sino} 
-estqun xnedrourid sap sijap sap ja xnafua sap ie} ne aje,p 
NSq ne juenauiod sjuswisustasual ap 3199]]09 ap 19 UON 
-P][NSUOD ap snssad01d ap s]qUIASUD UN ,p JUSUULULIOU ISP ,S 
Wop [J ‘sinayestpHn xnediouud sas op sinynj yo spanjor uOTeU 
-JOJUI Ud SUIOS9q SOP JULINOD Ne JaINBWIap ap JUaoULEd In] 
nb sowstuvd9gUl op s[qUIasUd UN,p 9}0p a9 Op NSgq J] 


SJUdT]D Sap SUIOSIq SaPIAING ['¢ 
‘gouaduT}Ied op s1aNeUl 


Ud DOUPULIOJIOd VI JoNeAD, Pp DIQIULUL LI INS UOISSNOsIp dAqiq 
dUN.P p'¢ UOTIDS PJ B STAINS ]UOS Ja SUOTIIAS SoUTeYsOId SION 


enbysiels ep neeing un suep seeuuOp sep ayijenb e| ap uol|seb e7 :euojsyoRlg Z9Ol 


Sd] SULP S]LIDGP JUOS 19-xNaD ‘saoLd sap JUSUIASSI]qQeId ,P 
snssao0id un 3a sawuieisoid sap uawexa.p snssadoid 
UN ‘SJUSI[D Sd] DdAB -UOSTRI] ap Ssnssad0id un :snssadoid 
xnediound stoi yney [I ‘aouounsod ey] JoInsse inog 
‘SO]JONPIAIPUI Sa9UUOp op sjquuiasua 
un,p piesa, e.nb joinjd «anbusiyeis ap sumueis0id» 
un,p nedAlu ne saguuop sap souduNIed el JoneaAg 
Jo Ja198 xno invA [I lonbinod jsa,cd ‘saxouUod 3919]UI,p 
sinajoas ap piesa] & Sarqiuodsip saguuop ap sa,quiasua 
sone sap puadap saguuop ap a[quiasud un _p sousut}ad eT] 
‘O]]I21 Op Yap UN anINsuOod SININ} UOTLULIOJUI,p SUIOSaq Ud 
siatpnonied sya{ns sap inod sjg1gjul,p UOISsoIdx9 | QIINpeLL 
‘sanbrysiyejs SOUL] Ud JUSWIOIIV][D S9TNWIOJ JUSTOS UOTeW 
-IOJUI Ud SUIOSaq Say] anb aieI 4s9 [] “sINNJ sutosaq sing] 
JoAgid inod tssne seul ‘sjanjoe sulosag sinoy said ap dJAINS 
Inod juawanes uou ‘sjanuajod ja sjanjoe UONPULIOJUI Pp 
SINDIVSI[IN .P [IVJUDAD IISA 9] JOAP 3ORIUOD Ud JOINOWIAp 
ne} [I ‘sayuouod jusInowap saguuop seq aonb nog 


AONANILUAd = *€ 


“SUOISUSWIP Sdp sUNSLYO ap 3s9 
mnb a0 nod 9y1,enb ev] ap uoNsad vy JURUd}UTeEW SUOAO A, 
“SOUTUPISOId Say SNO} B SUNUUOD s[NO sap 
no sayooidde sap ins saAndde ,s yuaanad syinpoid say ‘a1ooua 
RY] ‘Is uIgW ‘anbusne}s yiInpoid onbeyo e saidoid sayaudoid 


Sop oulwW0d sadiapisu0d ang jueAned uUONPULIOJUI,| 
op uonrjyeidiqui,p siujiqissod el 39 UOIsnyJIp op 
aupidei vy ‘apnynoexa | ‘ayouradl UY ‘NSq Op omed opueis 
Ud DAQ[II UONPUWLIOJUL | OP dU[IQissaoov | ‘[e1QUas UOISNJJIp 
ap suaisks un.p asttuanua,| Jed saiaty juos sanbrysnyeis 
sunpoid sap yednyd ey awwo0d “aoudl9YyoOo eT op juRjNe 
ap ua jned uo ‘uontuljap Jeg ‘owMUeIsOId UN yno} Inod 
Janyeag | INvy [I tlonbinod 3sa,-D ‘sayqruodsip sjuswoustasudl 
sane sap puedap senbusneis saguuop sep soudurzed eT 
‘JUdUT[aNprAIpul std ywnpoid anbeyo nod anb yond ‘NSq 
un.p sjinpoid ap sfquiasud uN,p UOOUO] Ud SagrEpISUOD 
a9 JUSWIT[ONIIQeY JUSAIOP UONLULIOJUT | Op DOUdIDYOO Pv] 19 
DI]IQissaoor | ‘Aousutyad ey] onb Juswalesa suouuonuUs/ 
“sINayesi[yN say Jed sapqvasasqo JUSWII}DOIIP 319 
quassind tnb uoNeUojul | ap dI][IQIssoooe | 19 UOISNIJIP 
op supidei ey onb e A.u [J “sasi{yn syusoel-snos sydoou09 
S3] 19 SOPOYIOU! SI] ‘SUOTIROTJISSLID Sd] INS sJUDWIBUSIOSUdI 
sues QJUOPIAS ojQ. sed ou ynod uONeUOJUI,| op sousU 
-od eT] ‘apni joeXd | IP SAINSSU Sop IWINOJ Wop ‘sagstyN 
sonbiuyse} sop a}001Ip souRssreuUOd uN B Inb 3a sajusoRl 
-snos saguuOp-OloU xne sadder e [nas Inb ‘NSq 92] stew 
‘SdOINOS SaIjNe Pp SdAv SUOSIeIedUUOD Sap B Japgoold ynad uO 
— soijjyo sop juowianbiun sied ve saguuop sap epnynoexa | 
aiinpep sed nad au uK~ ‘(saauuOpr}aW no) someyuowgtddns 
s]UdUAUSTasUaI op sed onbiunumwW09 aU NS gq 9] IS Sunayesipn 
sop xno xne sajuaptag sed juos ou sanbysnejs soguuop 
sop sajueyodunt sajgtidoid sap yednyd ey anb suousijnos 


‘ourejied onbuguinu aourpsoouod ev] JUusUIaIIessao9u sed puajyua,U UO ‘a2ua1ayoo 


LOL 


Jeg ‘SauNuIUIOD ajgnbua .p sanbiuyoe) ap uONest[NN ,| SUILIOD INO} ‘aoudIQYOO PT asUOARy SadAq sayqio suone|ndod ap 3a 
SUOTILITISSLIO ap ‘s}daouod ap UONesTNN, TJ ‘sdwiay np py ne anbydyeue o1ped ojsva un suep sonbysjejs s}uguIoUsIOsUdI 
sone .p & sajurof ang juaAnad 10-sa]Jao ainsout ajjonb suep pusjue uo ‘sanbysyejs saguuop sop aauasayod Ieg 


‘sanbysnejs saguuop sop 
IPNVOeXO | IP SINIBOIPUL $2] J9 9}99T]OD ap sopouIaUt soy ‘sastpN sjusoel-snos s}daduod 39 SUOTIBOTJISSeIO ‘soTqvueA 
Sd] INS SJUDWIOUSIasUaI Op [e1QUNS US JISL,s [] ‘UONLSITNN,| & 19 UONLIPIdIOIUL,| & SoITessodaU SOQUUOPLIUI Op 39 
soirejuouig|ddns syusuiaustasual ap giyiqruodsip ey pusjue uo ‘sanbnsneis ssouuop sop uoynjasdiajul,p ajpigissod ied 


‘AIIJIGISSAIID | JOUTULIDJOp JUDUIITVS9 JNod UONLUWIOJUL,| 9p INOD JJ ‘sinajesIpHN 
SUIvLIOD INOg “saguUOp xne sgodv JOA Jnad uo Janbnp usXour ne vIPsU NP No UONeULIOJUL | Op uoNL}UIsaId eB] Op 
gudoidde o1aj0v1e9 a] onb awigui ap ‘a}S1X9 UONeUWLIOJUI | onb J9}e]sUOD Jnod UO aT[anbe] 9aAe OII[IORJ PT Op JUUTUe}OU 
1132S TI ‘NS Np Jomnooid say as jnad uo ayjanbey] daae aitpIovy v] puajua uo ‘sanbystyje}s ssguUOp Sap a7171qG1Ssa2In Ieg 


“UONPULIOJUL | op aouautuad 
RL Ins vlonyul wvomsnffip ap ajipidos eT ‘UONRULIOJUL,| Op apnjijaoxa ,| 19 UOISNJIP op sypides ey aU stwo1dwio0s 
JIOAe A WUDANOS HOP [J ‘sorqruodsip juos saguuop soy a][anbey] ev aep eT 19 UONeUOJUT | oOddel as Janbne (aoueI9}91 Op 
apoudd ey] op ul e] NO) doUdIEJO1 Bp juIOd 9] SUA IeJep Ne puodsa0d sanbysyejs soguuOp sop uoisnf{fip ap ajipidps eT 


‘(asuodal ve] 39 asuodal-uoU P| ‘aseUuUOT[NULYOE | 
“QINJIDANOd ‘a[duraxa red) sajovxXaUI SoguUOP Sap & JOUDW ap sayqndeosns sinoua .p sayedtouud saoinos xne yioddei red 
Juap PT tssne nod uK ‘(aitoyweaye Ino1I9) souLTIVA Ap Ja (OnbIvUIEISAS INdIId) steIq op sajuesodulos ud sgsodulosap 
JUSWS|[SUUO IPE] SO JO SOQUOID sonbNSHe}s suoNeuINss xne poddes sed a1uyap yUsWIIT[aNIIGLY ISOd O[[q “JOINSOU! JOP 
a1[2 nb suguiousyd 9] ustg WOSp UONULIOJUL | AINsoWl a]Jonb suep pudjus uo ‘sanbysye}s ssquUOp Sap apnyqyIvxa Ieg 


“SQdINOSSAI OP IIOIVUI UD SdJUTLIUOD Sap NuUd} a}duUI0N sinayesI[NN sap surosaq xnedioutd xne xnotui 2] 
apuodai inb swiueISOId UN ILOADDUOD Op UL SINIIWSI[IN SIUdIIJJIP SOP STOMII[FUOD suIOsaq say JoreduIOD ap 189 NS 
NP Yap IJ ‘sinayesi[yn sap surosaq sI9AIp sap pusdap 19-a]]J90 Ivo ‘aAjoafqns Jsa sduaUIEd eB] ap UOTNTeAY,'T “XNA 
sing] RB sajueyoduut snjd say suonsanb say Ins sinojest[YN soy JoIe[Ia JUDATOp soguuOp soy ‘sayUoUTIEd ap sogutTenb 
31]9 INO ‘S}LJSHRS JUOS S}UdI[D sap SUIOSaq sa] sINsaU aTJonb suep puajud uo ‘sonbysyeys ssguuOp sap aauautad 1eg 


saguuop sap sitjenb ve] ap suOISUaUIIp XIS SaT 
T neglqe 


aUasayor) 


uovjaidsajul, p 
EAI USSEG! 


autpiqissaooVy 


uolnuUsoful,] 


ap uoisn{ffip 
ap aipidoy 


APNINIOXY 


IDUIUIJAIT 


6661 aiquiadap ‘ajanbua,p sanbiuyoe | 


‘aBIR] SUdS 99 SULpP dyI[eNb eI Ja193 TOP NSq 
un oINsoW s]Jenb suep JourWexa Inod 9[NNn aseq oun JuNN} 
-I]SUOD SUOISUSWIP XIS So] ‘INO} JIdTRPY “a[quiesdsojur 10s 
uoneULIOJUI | anb snod stusnoj syusWiaUusIasual Sap Inied 
B SIULJIP JUULI[LS9 LIBS IDUDIOYOD BT *BOUILINIUOD UOJ 9s 
anbi0}sty ddUdI9YOO ap Jd oUDUILIOd op dJaTeU UD SUTOS|q 
Sa] puenb ‘sajjanjorjuoo ang srojied yuoaned aousuned 
Rl OP 19 DOUDIDYOO LI IP SUOISUSUWIP SOJT “UONRUWLIOJUT,| 
op UOISNIJIp op aytprdel vy 39 opnynoexa,| aU stuo0IdUI0d 
oak A JUIANOS POP |] “UONRULIOJUI.| Op soUdUTIEd 
RI Ins ‘sanne anus “uanTJUI suOIsSUdIP Sane buld saq 
‘sorjne sap soun sa] sayuepuddgpul sed juos ou sala “uaUI} 
-SOJIURJ] “| NVI[Qu} Nv SAQUINS9I JUOS SUOISUSUUIP XIS SAD) 

‘99U9.19YOI op UOT}sonb eas [I ,Nbs10] prepurjs sopoyjou 
19 SUOTIROTJISse[O ‘sarqeiaeA ‘s}daquod sap ins oindde.s 
}9 SOIPVD SI}SVA OP SUP IOSUI.s aNbNSeIS UONPULIOJUL, | 
ainsoul oafjonb suep suolJonjeaAg snoN ‘sJuoWOW sno}q 
@ SIUIJap s}Inpold say sno} Inod sayqeiedui0d sapoyjeul sap 
32 s}daau09 sap ‘suIOW Np ‘NO sapoyaUT ja s}daduod sauIQUI 
So] JuesI[QN ua Ituaaied A ynod ug ‘Jasin say usiq ap 
a[lovy snd 1sa [I ‘saxouUOd SaQUUOPp ap SaTquIasUd SolINe .p B 
So] quiedu0d JUOS SAQUUOP Sd] IS “SJUWOU SIOAIP B SIdINOS 
SQUBIJIP Ip soe sonbysyeys saguuop ap sayquiosus 
SJUSIOJJIP JAsI[N stojsied JUDALOP SJUSI]D Sd] ‘UOTUIOJUL | 
op uoneaidiajul,.p gyoedeo ev] ap uorsua}xa sed ‘uljuq 

‘uoneIId19jUL,p II[IGIssod vs 
onbuysnejs uonewojut,| ap ajatidoid oy00 red suoipuaqus 
SNON ‘SsoquUOp sop opnqioexa., ap uoNen[eag sidold 
es onb sug op ‘UONPULIOJUI | Op aseq PR] & UONRUINSS,p 
}9 JUSUIIITV] ap ‘9}D9][09 op SapoyiaW sap ‘sasi[on sjusoel 
-SNOS S}dIdU0D Sap 19 SUONVOIJISSL[D Sap ‘SaTquUeA Sap suON 
-dilosap sap uno} Wop NSq 2g fonbinod js9,cd ‘sayatudo1d 
SO] SIPUDIGUIOD Ud 19 JIJBUUOD S3] JUSALOP SJUDI[D SIT ‘NS 
np sanbysnejs saquuop soy JUSTIOsd uO & JOSITNN Inog 
“INTIQISSIIIe ,P JULIO] US $99ITeI] JUOIOS 
SUONLISPISUOD Sad ‘sjanuUa}od sjudI[D say yUasodsip jUOp 
SIBO[OUYII} SUN INS JOpUOJ ds JUDATOP sanbysNeIs syinpoid 
S23] 19 BYOIDYIII 9p suOTOUOJ say] “afqeuuosies xd un & 
JUSIAUOD Ing] Inb saguUOp op UOTJEIJUVS9Id JUN B SQddR IIOAR 
JUSAIOP s[aUd}0d sjUdI[D sa] “I1U9IGO So] ap UOSe] eI 19 
Sa[qiuodsip s]UsWIdUSTaSUAI Sd] JOUTWIA\9p JIOANOd JUsAIOp 
S]USTIO SQ] ‘Sat JuaIos sanbnsneis saguuop say aonb nog 
"JUSUU9} UD] 
juonjoag inb souguiousyd soz inod jueyoduw issne 
ang sed ou nad vjao anb sioye ‘aurgut Inof a] saguUuOp sep 
JIOAR .P [ANUISSS JOIQAR,S Jnad [I ‘sayuROdWI sayjansuoW 
sonbrwo0uo0sg saligs soy Inog ‘sinajesijgn sap suloseq 
xne onbiysyejs UoeULIOJUT,| op UOTeIdepe | op aUeWOdWI 
UOISUSUIP o1]Ne UN aNjsSUOS UOISNJIp op aytprde.a ey ronb 
-Inod 3s3,cd ‘syuoutziad sja{ns sap Ins sjoexe s]USUDUSTOSUAI 
ap ulosaq snjd jyuo,u s]I ‘suOIsIOgp Sine] stud jUO sjUdT[S 
say anb stoj ous) “10-saTJa0 & JapgooR ,p UOSe} PT 19 S]USI[O 
xne Safqissaoor Juos sonbnsiye}s SaguUOP So] NO JUDWIOUL 9] 
Ins juayi0d juaatns nb gyyenb ve] ap SUOISUSWUIP XNop so] 
“UONPULIOJUL | Op IpNzydexa,| Ip 
IOI BIISE ,S [J “2a ‘QOULIJUOD ap SaT[VAIOUI,p ‘steiq ap ‘adA} 


-INDII9.P SIAIOUOD SINI] IDAV SUDIONSNRIS $9] JUDUUDIAIOUL 
JUDWIDT[oUUONIPeN anb RI 3S9,cd {a1qQeidaoor aj]a-1s9 Anda .p 
dSIVUL | SIO[Y ‘oUN IUd}qGO Ud,p s]qQIssodut swWgUI sIojred 
}S9 [J “JOYS S31j UDANOS 9}N0d 9]9eX9 dINsoW sU_, {apMIn 
-OBX9,P JUSULUSIJJNS SdaP [I-]-apgoo1d sgudoidde sidaou09 
sop usXoul ne sjusutzed sjaf{ns say sinsow Inb NSg 37 
‘sanbysneys soguuop 
Sop adusurj.Aad vy] e yueOdde as suonsanb ap sayduiaxa sap 
RIIOA, {[aNj{Ov [IVALI] NP 9YOIUL J] II[9-}-d}9[Jol SuOIssayoid 
SOP 19 SIDOUI Sap UONOIJISsEID VS {INY psnolne .p [TUL] 
RP] & B[o-puodsaoo aj[lwWie} ek] op uOTIIUTJap VS {sassedap 
SJUDWUBUBIasUdI Sap Ans sinofno} [I-3-oIndde ,s no sanbiayens 
suojsonb sa] ins ajuounsed uoneuojul,p i-}-asodsiq 
‘ginsow ap satidoidde sjdaou09 saz astpyn 3a sjyafns suog so] 
Ins saguuop sap yinpoid NS 2 IS JOYLISA ps0ge ,p INv{ |] 
*XNOINOSII 
anbyeweyyeu juowaddojaasp ne ajde snd oy ayyenb 
PR] ap yoodse J99 ‘apnynoexa | B We & INnb 99 Ud sUaIONsIyeIs 
Sop d[oUUOTUDAUOD UOTedndd0¢9Id BI ap B[ap-ne Uatq BA INb 
yda0u09 un ‘ayjenb ap sie Jdaouod np sajueyodun snjd 
SO] SUOISUSUIP Sa] JUoWIONbNeUIA\sAS Sn{d JdI9PISUOD ap SIO} 
-91N0} JouLIed UOTIUTJap eT ‘a]JoUUOTeJ9do UONIULEp oun .p 
Re] sed y18es au [I ‘sanbysnejis sjusususiasual sap sasesn 
SIDAIP O1lej nad xna.p unoevyo onb ja sgeA Jo xNdIQuIOU 
S]UdI[D Sop & NS UN dUIWIOD ‘sIePl “S}JUDITD sap suLosaq 
xne 10-xnoo op uonridepe., ins juenyur nb NNSq uN,p 
sonbysnejs syinpoid sap sjoadse say sno} sumW09 9yITeNb Pe] 
JIUlJap SUOANOd snou ‘sINayesI[ MN Sap NO sjUdI[D Sap sUIOSdq 
So] Ins JUWaTedroutd yuasodal NSg UN,p sgodons np uoTeNy 
-PAQ | 19 SUATOV Sap uOTTUTJap eB] anb suojydador snou IS 
"JUBAR Sayoud quaIe}9 
AS (L961) JZ 19 ZUMINY ‘UssueH (6661) SAYA 39 
SUI][OD SUP UdUUODAI SNTd ‘39 (L661 YURI 19 VSpaTfog 
‘L661 JoxRI! 12 ulaysues1oy] “L661 Oddiq ‘L661 SUITIOD 
19 MNJ] SP 166] UIMOIL 19 ‘zremyos ‘oddiq ‘mMnoeq] ap 
‘SuI]JOD ‘IoWoIg ‘3IaqK7J) snssad0id sop syyenb vy 
yo Saygnbus sap ainsaul PI INS C66 Sp BeUONeUIOIUI BOUdI 
-9JUOD PR] & SgjUasaid sjusUINDOp siInaIsnid suep saapsoge 
939 UO JUSUTOUIOANOS Np sanbysneis say suep gzyenb ey] ap 
UONSdS PI 19 UOTIIULJap eT] ‘sonbysneys soguUOP ap UOSIRIATT 
ap Jo uoNONpod op uonestuesso oun ev onbrydde,s ayyenb ey 
OP IIBIL[9 UOTOU 9799 JUSWILUOD JOpULUAp 9s INv{ |] “aIsIe[S 
aatoodsiad oun suep JUSALIOSUI,s sanbysie}s sopoyioul 
Sg] ‘uoNsas ap sayooidde sao e yUdWIOSIe] JUeNGIINUOD 
Ud INO], ‘[eUI] SdIAJas Np no jinpoid np uoNRIOI[aWe | B 
yo Snssaooid sap ayuojal ve] & saXo[dwia sap uoNedionied P| 
ap sourOdUIT ,| PUBI[NOS JUO Ja UOTRSIURSIO | SP UOSIPIAT 
ap 32 uoNONpoid ap snssad01d sop suyenb ey] Ins systsut 
1UO ‘SINIeSI[NN Sap SUIOSAG xNv XNCUIJ SIOIAJOS 39 s}Inpoid 
sop uoneidepe | Ins jUdd0R.[ STU UO UOT}SAS Op SdtI09y) 
SalNe p19 LOD PI op JUSWIIANOW JT ‘SISIVIS 3S9,$ oyyenb 
ap uonou xv] ‘suonestue3IOo sap uoNses ey Inod sie 
‘JURUTULIDJOp B[QI UN onof ‘uoIsTOgId 
O9AR JIUIJap ‘soguUOp sap yyenb ev], safjanbsap utras 
ne ascjeur .p 19 UOTBUITSS ,p sonbruysa} sap pard ins stu yuo 
SI ‘sasayodAy ,p UONROIJUDA PL] SURP INL ,[ Jo JUOWAsNIe | 


anbisieys ep neeing un suep SeeuUOp Sap 9gyijenb e| ap uojseb e7 :euojsyoRg O9l 


“vouvdIvIS M1OSOvIG :anbiuosda[9 J9LWINOD ‘QL O WIM (OULIUD) EMENGO ‘epeuLyD onbuysnei¢ ‘a1sojopoyjayy 19 anNbNeULOJU] ‘eUuo]syOvIG UOPIOH : 


ap ayenb ey ‘sterq ay ‘adAj-inaua,, aumuo0s sj}daou09 
ap iied y ‘apniiisoul,| suep sostid suorsisap sop ouyenb e| 
no sanbysneys sajapour sap juswiaysnie | ‘sonbusneis suon 
-PLUI}SO Sop suyenb ve] op uONRJUSWISNe | Ins daxe }so UON 
-PULIOJ INI] BINOT, ‘Wey elap MOA] 9p UOIssoiduut | JUSTeAR 
sji,absind onbnsnejs uoneuojut,.| ap ayjenb ap ydaou0s 
2] AUYOP & SNOWJIP B[ VP NS JUO SUSTONSHEIS Sor] 


SHANNOG 
SAd ALITVNO V1 A NOILINIAAG = “7 


‘auyenb ey Jolas xnorwi inod sinajoas 
SUIRIIIO B BaTPNONIed UONUaye uN JayJod ap suoslgssNs 
snou ‘uOT}OeS aIgIUIOp eB] sueq ‘suenb ev] sp uONses v| 
ap geqoys sysoidde oun ke sailessao9aU XNeI9UdS SOUIIISAS 
Sd] ILULJap op 39 ayT]eNb ev] ap SUOISUOUIP XIS Sap SUOISNJOUOD 
SOP SOUILLIID JOIZIIUI ,.P SUOIOJUD} SNOU ‘6 UOTJOaS PI SURC 
‘uOnses PR] op sourULIOjiod 
e] op uoeNeag,p sonbiuyse} say 19 Jajdope ke uolsas 
op Sapoylaul say ‘IaI9s e& SJUSWIZI[9 Sd] Sa|[o,p oUNovYO 
OP pleS9,| & SUODSESIAUD SNOU Jd SUOISUSWIP Sop ouNdeYd 
NADI ud suOSssed snoU ‘sSa}JURAINS SUOTIDES XIS Sa] SUC 
"NS S92] Joronos as JUDATOp JUOp syITeNb ey] ap suOTSUSWHIpP 
XIS SUOJOSSNS SNOU NO ‘afore JUaseid Np Z UOT}OS BT SURP 
uonsanb jsa ud I] ‘NSg UN,p [leave ne ayyenb ap ydaou09 9} 
JOIIWII] & OUOP a}sTSUOD Jap JarwWoid ONON “INaJeuNss uN ,p 
suusXour onbyeipenb noua .| sed JUSWIUIe}OU SIUTJap ‘sUdTO 
-WSV}S SAP SPaUUONUSAUOD s}da0U09 sap Rap ne aytyenb 
ap idadu0d J ISIe[9 JUO UOT}SAB Op SoIped sane ,p 39 (LOD) 
9[210] aenb ek] ap uONsas op JUSWIBANOW JJ ‘apneayes so 
QUID] OJ :SATUUDDEpP SAIIIUIAp Xnap sao ayTTenb ap gpied don 
® UG ‘adn9d00 snou Inb 9}xa]U0d 9] suep dyyenb sed jyuow 
-9]08X9 suOpUaqUd snou onb a0 ATULJap Jed IgdDUdWIUOD DUOp 
SUOADP SNON ‘Jud IOVJ sed yWuIJap as ou gyyenb vy] sie 


‘onbuysiyeys 
op xneaing sj suep ayyenb ev] ap uoNnses ek] ap uoNsonb 
RP] ‘aITeSIOATUUR OIOWUNU 99 sURp ‘sUOIPIOge snou onb grid 
-oidde 12] B 3no} OUOP 3Se [][ ‘auyenb ev] ap sastides sajurew 
B ‘suB CZ Ue ‘9ITBN] SUOAR SNON “(6661 HOANN) 6661 
ap sudsdoina SUdIONSIILIS SAP IDUdIIJUOD LI IP SIO] BIPUoj 
-o1dde uorssnostp oun,p jafqo | ej UO (QoURUIOJIJAd P| ap 
anbyo UOIsUSUTP SUTUOD ay[eNb ve] JUOP) sdUPWLIOJIEd ap 
SIndedIpul SY] “jW1dsa,p sINVIDANO | ap Jo DUIST[BUOTSsajoid 
Np ‘UONVULOJUI | Op doUSUTVIOd Re] Op doUuRWOdUWTI | JURUS 
-1]nos sadiouud sinaisnyid p66 | Ud satUA) SUOTIBN Soy Jed soa 
-noidde sajjaioiuffo sanbysipjs sap xnojuaiuppuof{ sadiouid 
XIp Sa] tued nuajal & UO “(8661 LVLSOUNA) sanbusunis 
ap adsaljvu ua ajijonb v] ap aQuDANSSD,] Ja ajyjonb ap [wavy 
3] 866 IeUl Op aNUOOUaI INI] Bp SWAY} IUIWIOD IsTOYyo 
}UO suUsadOINS gIneUNUIWOD Pv] OP NSq Sap sJoyd say aonb 
suouUOnUoW ‘a[dwWioxd .p a Y “sayfaroyyo sonbnsneis xne 
jueyoddei as syuauiousag sinaisnjd ap iped 9] suep NSq 
Sop UOT|SIS Op sIQVeUL US gyTTeNb ve] op soueyOduut | NUUODAI 
JUSWUWU999I1 B UG *(sKed Z| UOTaS JOTIeA Jnod uONeedde | 
quop onbiigues jeyusWaUIoAnOs onbuysneis op neoing 
un .p Japied nod N¢q aIZIs a| SUOJOST[NN snoU) syInpoid sas 
ap aujenb ey] op nary Joruaid ua atonos as jeuoneu onbnsneis 
op neoing un,nb yeipiowtd juenbgsuoo sed jsa [] 

“asULYIII 
ap sonbisajens suondo .p sJUdIUQAUODUT So] Jo SaseIULAR 
Sa] Ins Jay10d ap anb yo injd sosyjyrys suog say e Inb Jour 
-1d]9P B JUDYDIOYO BU 39 SINOD INI] ap JUSTASP SUOISSNdSIp 
sa] aonb onbsii un sioye & A [[ ‘agTURIge 3s J[qQeIy UONeWI 
-I0JUI,p ajJuepuadgapul jo daNoefgo so1nos ap uoNendas 
BS JO OSNO UD ISTWAI JS9 NVIING Np sy[Iqipaio vy ‘sayoodsns 
JUOS SoQUUOp Sz IS ‘sa[qeIfJ soguuOp sp UOTONpold 
PR] Ins osodai onbnsneis op neoinq un.p dIAIns ey 


NOILONGOUINI ‘TL 


“UONPULIOJUL | OP UOISNYJIP op oytprdes ‘apnynoexe ‘aousunJad ‘sapjaroyyjo sanbysnyejs ‘auyenQ :Sq1O SLOW 


‘Teuoneu onbnsneis op nesing un suep 9}I[enb ve] ap UONsasd op speqo]s oyoodde oun ke saltessad9qu 
XNVIQUIS SOUIQISAS SO] JIULJap op Inq 2] Suep sujenb ev] op SUOISUDULIP XIS SOP SUOISN[OUOD Sd] JOISOIUL,P SUOARSSO SNOU ‘NdIT 
Joop u_ ‘souPWLIOJIJod ev] ap UONEeNRAY,p 19 UONSIS 9p Snssad0id Sa] SUODSSESIAUD SNOU ‘sa][9,P oUNIvYO INOg “UONPULIOJUT | 
QP BUdIOYOO PR] Ja UONLIVIdIOIUI.p sITTIQIssod ev] ‘dIITIGIssa00R | ‘UOISNIJIP op supides ey] ‘apmoexa,| ‘souounJed PY] 
:SUOISUDLUIP XIs sOdUIOD syTeNb eT “s}UdT]O Sap SULOS|q xNe 19-xndo ap UONeIdepe | Ins JUanuI Inb sanbysneis s}inpoid sop 
sjoadse sa] sno} pusidwioo gy1yenb ey ‘toy “saguue sanbjanb sindap apneayes so duLI9} 9] ‘JUaWIATIOR} sed ytUap os du oyyenb vy] 
‘sieJQ] ‘sjinpoid sas ap syiyjenb ey op nary Jarrad ua aronos as Jeuoneu onbysnejs sp neaing un nb jerpsiourd yuanbgsuos sed 
}SO [J ‘da[ULIGES ]sd 9[QLIJ UONLULIOJUI Pp aJUepUadapuUT Ja dAT}O9[go doINOS op UONEINdal Bs Ja aSNwd Ud aSTUISI Jsa NeaINg np 
DIIQIpsio ey ‘sayoadsns yUOS saguuOp Sg] IS “so[qely soguUUOP dap UOTONpold ey Ins asodo1 anbnysneis op nesing uN,p IAINS eT 


aWnsaa 


tWNOLSHOVUE NOGAOD 


anbiyjsye}s ap nvaing un suBp saduUOp Sap 931]enb ev] ap uOT)Sa8 eT 


6S1 


epeuey anbiysijejs 
LZ4L-6Sk “dd ‘Z ‘,u ‘Sz “1OA 
666| aiquadap ‘ajanbua.p sanbiuyoo | 


‘08-955 ‘87 ‘aoua19g Joanyjno14s y fo }DUANoLr ‘syudUILIadxa 
Jo sdnoss Jo siskyeur oy (861) “D'M ‘NVYHOOO 19 “A ‘SALVA 
‘anbysneig op seuoneusojuy oynjysuy :onsepyy oy], ‘suouvoyduy 
pup ssuipurg solow ‘(p861) SAAAUNS ALITLLYDA ATAOM 
‘TYUISTOH ‘anbysyvi¢ 
ap aJDUONDUAU] AININSU],] ap UOISSAS aUlal-Z¢ D] ap Sajoy “UOIU_) 
uvodoing 94} 10} sAdAINs [eUOTeU SUIUTQUIOD (6661) ‘A ‘WNMAA 
“sudyIY ‘Saisojopoylap Aaaing fo suosiavduioy 
JDUONDUAaIUT :dITeUTUIAS oJ] SUeq “SoIsOTOpOyjoW sAeIedWO0S 
UI SoNnss! UIOS :adoing ul sAdAINS PloyssnoyH (7661) ‘A ‘VIANA A 
‘THEE ‘L “epeued onbuysneis ‘ansoyeyeo ne ¢Q0-78 ON ‘asuvs 
pj Ans sj4oddpy ‘uone{ndod e] ap gues ve] Ins afeuoneu ajonbuq | 
op eseuuor[Nueysg .p ueTg ($661) ‘D ‘NITLVO 19 “Tf ‘AVENVL 


‘UO NOW onseH WL au] fo as a4] “(ZL6L) ‘V ‘IVTVZS 


“SUOS 7 AIM UYOL OX MON “SOUSUDIG DadV ]]PUS (6861) 
‘dW ‘HONIS 2° “dD “TVANUYS “WN ‘OVE “UY “AALV Td 

‘TW PBS “SAIS YIPOH IGN 

‘Skaaing Maldiajuy pjoyasnoy yijpay ays fo susisap vousuisg 
(8S61) SOLLSILVLS HLTVAH YOS YALNAO TVNOILVN 


‘OL ‘ON ydessou0py UTeOH 
ONGNd 'S ($S-PS61) apimaivig pun (Z7C6]) asor ung ‘skaaing 

YyyvaH viusofyvy omy ur K8ojopoysaw “(9S61) ‘M’H ‘ATNOOW 
‘O€T-LTZ ‘UONDIIOSSY JDINSIDIS UDILIAUY ‘SI11S11D1F ]01905 uo 
uo1sas ay) fo ssuipaaz0ig “SKOAINS IjJeN 1oj opdures Aypiqeqoid 

o7e1s-H[NW Y (1961) ‘d ‘MOMOVA 19 “AM ‘AOLAAOT “TI “HSIN 
‘OP-LE “PI ‘sousuvig jorsuf{o fo 

jouinor “so{dures Sul[[o1 pue suoneuea ouinsaoeds (8661) “I ‘HSIN 
“LL-SS ‘TT ‘Sousivis 

oro fo Joudnor *s\2}J2 USISEP JO} SpoyI (S661) “T ‘HSIN 
“OSI-LOTL ‘79 ‘anbysiolg ap ajouoipusajuy 

‘suSisop AdAins uoneindodyinw, (h661) “IT ‘HSIN 


“LL-L9 ‘1 ‘9| ‘ajanbua, p sanbiuysa, ‘ya[du109 JUNWTJaANOUII 
D9Ae SUOT[HURYDS 39 sodvi9 Jed juoUIOSUZIOyY (0661) “1 ‘HSIN 


anaay 


"E€-61 ‘PI ‘algnbua,p 

sanbiuyoay “so{dyjnul sasesn ev asepuos op suri (8861) “T ‘HSIN 
"SUOS 2 AQTIAA 

UYOL 2JOX MON “USISAG YoAvasay JVIUSUDIS (L861) “1 ‘HSIA 
66-08 ‘6EI ‘W Saas ‘Ka1209 JoousipIg JoXOY ayl fo JDuAnor 

‘suSisop odures Jeouly ul ewrxoid pue eundg (9/61) “1 ‘HSIN 


senbiyudesbowep sajenbua,p uosieulqwioo eB] No |nwUNd 97 :YsIy 8Sl 


"SUOS 2 ATI UYOL “YIOA MON “Sutjduung Kaaing (S961) “T ‘HSIN 
"607-107 “p “UOISSAS 

SUIII-CF ‘anbysyojs ap a]/DUOTIDUAIJUT IN]YSUT ] ap ulja]]ng 

‘syiun yeore ut Ajloussouroy Jo JUoUWIAINseaW! WY (1961) “T ‘HSIN 


“OIAG|eNUID YUSNEIS :O[SO ‘9L6] oste[sue uoNonpeIy ‘skaaung 
joousuvig fo poylapw aaunjuasaiday ayy (S681) ‘NW ‘YAVIA 


‘AASNI ‘sued ‘aouatadxy youasy 
IY] :SULYD] SNSUaD JOUOIIPYAT, 0] SAANDULAIIY (6661) ‘W ‘GUVNSI 
"69-96 ‘/ ‘YOuDasay D1UjMIYIKSg Ul SpoYylay 
fo Joudnor Jousajuy “eyep AOAINs YOY [eJUSW JOJ IdUDIOJUT pur 
$}99]J9 UBISap o[duies xo[dwoD (6661) ‘f ‘NIT “O'S ‘VONTYAAH 


"Ssaig oIWapRoy ‘JY ‘OpurpiC ‘sisX{jouy-viapy 

4of spoyla jvousuvig (S861) ‘I ‘NINTO 1° “A‘l ‘SHDCaH 
"9-¢ ‘¢ ‘dayouvasay JDUOIIVINPY “YoIeasal 

jo sisAyeue-ejou pue Alepuoses ‘AIeWUg (9161) “AD ‘SSW1D 


“6T-1OI ‘OL ‘S2tuaworg “syUsUIadx9 JUdIOIJIP 
Wo sayeWHse JO uoNeUIqWOS eYL (PS61) ‘D'M ‘NVYHOOO 
"8I-ZOl ‘p ‘a Selgs 
‘{Ja120§ oousuojs jokoy ayj fo }ousnor ‘syuautiedxe Ie] Mus Jo 
Saas & JO sIsXyeue oy) UI SuIsUe sWIa|qQO1g “(LE61) ‘D'M ‘NVYHOOO 
"ssold A}ISIOAIUL) PIOJXO SUL :P10JXO 
‘Kaadng IYN4Ay PI4OM P4L (L861) ‘OD “LLOOS 3° “f ‘GNVTATO 
“TyUIs}ay ‘anbusyoj¢ ap 
AJDUONDUAAJU] AINIJNSU] | ap uoIssas aulal-7¢ v] ap sajoy ‘s\lodal 
A[YJUOU O}UT BIep ADAINS SNONUTUOD BUTUTQWIOD ‘sonsNe}s JoyIeUW 
Inoge| MN (6661) ‘d TALS 19 “W ‘HLYOMVH “d ‘NVTdVO 
“‘Sqv ‘eLlaqueg ““ojnuop uoynjndog 
upijoaisny aut (€661) SOLLSLLV.LS dO NVAUN NVITVULSNV 
‘TyUIs[oH ‘anbijsio1g ap ajyouoyousajuy 
aNjJYSU],] ap uUolssas auai-7G DB] ap sajay ‘sosn [eluUussep 
pue Ajseak 103 Aaains ofdures 8ur[o! ¥ (6661) HD ‘YAAGNVXA TV 


HIAdVaSOITsla 


‘greumndo uonnsedgi ey anb sovorya sutow so '4 
g[jouuoNJodoid uonnedal oun Ud jUR}SISUOD SUdS SUG Op 
suled uonnjos a[duurs ey “uepuadsD “(gg6I USM ‘€'L “L861 
Ysry ‘O°L ‘OL6I YSTY) Suds Np JUdWITeSe ev onbnewWsYeW 
UOTNIOS eT onb 19}e]sUOD dp JULSSIIDIUT IS9 [TT “(6661 UND 
yo Aequivy) epeued onbnsneis ev saygnbus sauteyis9 inod 
s9sl[ONn a9 & ofeudo UOTBOOT[e BNED ‘saourAold sopuvs3 
snd onenb so anod (‘44 OOO OL B SuNaLIEJUI steu) sT;aUUON 
-1odoid said nad e uonejususne oun 3a saoutAold sayned xis 
sgj Inod ‘uw mnod QOL 19 O09 eUd « JaYyouR]d » un yUaNUOU 
Z ausI] ve] e soojuasoid ‘uw ap suna[ea say ‘seo onbeyo 
suep jusula[nas %4¢Z op owed oun Os “UaWaAToodsoal 

H/'&{ 10 '€'mX inod ‘QEge'1=7+ 1 @p7'1=7+ I 
op T+] sinefea sj yUoUUOp snou suoOIssaidxa sad 


G-H+ M) i= 'u anb a[Ja) sauvo SoIpUIOW sap spoyeUl 
R[ Jed UoON[os oun jurj}9 sINaT]IOuL sy ‘suog jUdWaTQenb 
-IRWI9I STULOIGUIOS SUTe}II9 B JOALUe ynod uo ‘URpusdad 


"Soyqeiquias 
Soyiod ap sagyorjud ang & dOULpUD} JUDUITe39 JUOINe ‘'aJa 


p5Sys 


‘UOISSaJOId BI ‘AILIV[ODS Op NVIAIU J] ‘ABB ,| UOTAS Sa][e9 ou 
-W09 ‘saadnodal Sa110391e9 Say $ajno} onb snyjd uou Jaljqno 
sed Se OU SNON “ooURLIvA ah oP WOE] op uonejususne 
aun wos ‘¢Q0¢'z = 7M XH = Bo, +] Op oAnela oyod 
oun daae ‘000 I/, MX oP pias gyeuoneu ouudKoul Pe] Op 
QOURTIVA P] suepuades "Q = 7 ouied oun doar ‘7 = J+] op 
BIOS DALIT 9UOVITJJO INI] 19 (QOO'T/T) { B BAPUOdsalIO09 
000 1/'€X seuuakou sap aourrea vy ‘siopy ‘aoutaod 
anbeyo snod uorstogid ouIQUI PT JTUaIgo INod ‘QQQ | = 'u 
‘gy]te] UIQUI op suUOT[NHURYSa sop jUspueWop (sAed 
sone .p suep jo epeued ne) souuosiod souleyiso ‘ou0g 


9€9 879 LS9 699 9L9 ¥89 698 S66 O€LI Lert Teusry 


6b 60% 997 TEE E9E 10h SE6 9OTI PEST SOLE J 2usrT 


‘(O61 USE SUep s[Nd[ed) sasouTAOId saqyed snjd xts 
xne juswaedioutd sanp juos sayied sag) “auUdAOUW BOURLIPA 
Pl OP WOOE Op uonejuswsne oun jos ‘6g/6‘Z op anneal 
ajied aun inod cgz6‘¢ = ’M/1) XH = 7+1 ep (4-'4) 
Sa[VIOUIAOId sinaeA sap suosteeduio0d sap suUdAoU! Py Inod 
no OL /'« { sayeroutaosd souusXsow sap ouueXour vy Inod 
‘uoresmnpoid sajjauuonsodoid ‘uw sinapea soo ‘“uepuedag 
“ouueoul Ind] Joyno[e9 jnoed uo.nb no sajqeiquias juos 

'2 $1N09 $9] 19 rs HG solleytuN saouRlIeA sa] onb sasoddns 
suoAnod snou Spiod SQ] INs JaqUVOUOS as INod 3a gy191]duIs 
op ionos wg *Q=7 oMed dear ‘T= T+ 1 dAT}eTOI ood 
op uoTOUOJ oUN OUOp lupe MX op ("4 {anod oyew 
-ydo InsyeA oun yesnpoid fauuonodord uoT[WUeYdE UN jo 
000‘01 /'¥='M Jos suotOdold saqT “Zinoquiaxn’] np aI[99 
SIO} QOT UOIIAUD JSd DUBeWITTY ,[ OP IIe} ve] ‘auusedoina 
SINCUNUIWOD ev] op ules ne ‘afdwiexo Jed ‘saydnynw suonry 
-ndod v svo say nod osugui ap isa ua yy ‘shed sap yednyd ey] 
ap saoutaold say Inod aULINOD B[QUIDS SNOYOINOJ BAD “6p 
ajdu09 ua tnb ajjed snjd ej aonb apuess snjd stoj ¢/ UOIAUS 
1S9 ‘S¥d OOL € BISIXO [I aTJonbey] nod ‘aoutAoid opuvss snjd 
eR] onb e1aye}Su0D UD ‘O00 OL = ¥ OP [eI0} UOT[MURYSE UN 
inod | ously ey e yUeINSYy nb ‘wv ap sinopea OQ] Say JUSWIAAN 
-eulxoidde ‘1 7/Z:[| =f ap uonssyes ap syqiqeqoidinbe ,| ap 
spoujow ev] Jed uoToaIas op xne} uN dae ‘JIeIINpOld ‘1 66] 
ud OOO TIZ LZ B a[e39 ‘a[e10} UoNe[ndod x] yUOp epeurDd 
Np ssouraold OQ] sap Injao 3s onbusuwinu s{dwisxe uog uA 
‘(y661 UST 
‘OL61 UST) (-H/1 + m)/ »'M SOAR «{eUINdo» stuoIduI09 
un jUdWIOIgI[NINIed “sTuOIdW0S sap B BORIS I]JUOD 90 
aipnosal jnad uQ “aus vy anb sapueis snjd a109ue sayed 
OP SI9YORIUD JUOS 19-Sd][Id 91JUS sUOSTeIeAdUIOD Sa] 19 SUOT} 
-etndod sap suuakoul souruea vy ‘sioye ‘step, “'44 Se] aU 
'u sap a[jauuoniodoid uonnredai ey ap seo 9] SuRp aIIp-e-389 9 
INOTRA SUIQUI BP] Sno} UO "y Soy IS s[NU JUOS ane] 19 
un] ‘’y sptod soy muued uoneiea ap qaTo1yy209 9] ‘ 70 10 
(QOUvIIvA BP] Op UONRJUSWISNe) sANeIaI ood vy aquasaidal 7 
‘s10]e ne D+ L= 7+ 1 Jueesinojoey un ,p suosteurquioo sap 
OURLIVA LB] QUSWISNe IseUUO][NULYSE ,p xNv} Sap o}I[VS9UI 
Ne "'M SIUSIOJa09 xne suosieurquiod saz saIsnfe 
inod 'y sprod say artmponut ynad uo ‘s1opy “Y suoneindod 


666} aiquadap ‘ajenbua,p senbiuyoe | 


So] Sojno} nod sayesa (QUuoWAaANeUIXOIdde) ang jusAnad 
UO][NULYSE ,p Sa][ie} sa] Wuepuddad ‘ajJURINOD JURIa snyd No 
OS B | SP SNOYOINOJ 9uN ‘JUSWIDTIO} JUDANOS dLIvA SadUTAOId 
sop no sked sap no ‘suonerndod sap ‘44 saneyial ore P| 
anb aored ‘yuounuanbely yuasod as sjuryoduut sytyyuoo sap 
‘suone[ndod sinaisnyjd ap uosteulquiod ev] ap seo 9] sueg 
‘(7661 YSEY) Saistiqeqoid suo[[MURYoa sUog ap INs saqnNo} 
JUDPUOJ 9s saTja,nb uoNIpuod ke ‘suone[ndod sasiaarp xne 
anbydde uo. anb aseuuoj[nueyos .p sapoyyeul sap x1oyo 
ne juenb sql] spuvIs ouN 9)SIxXa [I ‘AyoURADI UG “suON 
-endod sa] 1a sainsoaul sa] ‘sayqeisea say jutod yney snyd ne 
«JOSIUOULIBY» ,p ‘ajJgnbus .p SopoyIgW! $3] JQUUOP1009 ap Ue 
‘SUSSIOQU LI SINaT]Ie astogid Zasse UOSe] Bp QUBI[NOS Ie .f 
6) 4. “QOURLIVA BI JONUIWIP oe] B doURpUa) B “u “U 
(u's T- = (€*xX) AOD Z- souRLACD ap ata} 9J “(sanb 
-Ipotied saygnbus o1jU9) syUSWIdYONRADYO ap seo U ‘sIeIq 
ap sue} 9J onb ajuRyodur snyd ang ined suop ‘(so}UWSNe 
alley ej nod “w no “uv ap AneyeA sIqQIeJ oUN 39) sooURLIeA 
XNOP SOP SUIWOS PI & B[VB9 JSd DOULLIVA BT “SpURIB JUOS SI 
puenb owigui ‘sarqeiedui0d yUOS s]I,s JINOURAY,s B BOULPUS} 
JUO SOOUdIOJJIP Soy JUaYoRIUS Inb sieiq say aonb eidjOU UG 


“ws a+ "usss*a+ ft x-(Oa}-(x-(9a}]- 
(A)rea + (x)rea+ [(4- X)- (4-9) q]= 


(4- x)iea + (4— x) -sierg = 


(4€- x) WO" 


No ‘suosteiedwod so] nod ajudJJJIp ISO UOTENIS VT 
“stg XN& JUSWISA[AI ONUTWIp soueLOdUII UOS “JUanbgsUOd 
Jed ‘Ja quuskoul P| a[No][Vo UO satjenbse] Ins sayuN.p s1q 
-WOU ne judUaT;oUUONIOdoId onuTUIp souUdXAOU Sap due 
-LBA BY ‘pues iso ‘44 sprod 9] quop ‘sayIUN sapuRIs sap seo 
3] SULP SIVIQ Sd] dIINPal op ayIsseo9u eR] oUSI[NOS UONeNbs 
91199 ‘sofdijjnur sourewiop e no suoneindod e suojjnueyos ,p 
SBO JJ SURG ‘SIULJSUOD JUDSWTSANPIAI 9139 JUBANAd 10-xnd0 
‘sanbipolied suoy[nueyoe ,p seo a] SUR “S[ONPIAIPUT SIeIq 
sop selgpuod suusdKoul ve] & [esa Sa dOUIqUIOD dUUdAOU 
eR] syoujus nb sieiq a] onb eiaj0Ou UG ‘aTNe,| & B[qQuLeA 
oUN Pp JUSUID}IOJ JoLeA JUdANEd siNna[eA sad ‘apnid 91N0} 
op sed a] sueq ‘soxatdwiod asepuos ap suryd sap sjajjo 
Sd] Josuaduio9 inod wal asepuos op urd ap sjajja.p inary 
J] OAR ‘SaT[Ie] Sa] 19 SoMIeIUN sooURLIeA Say JUOS ‘uv 39 
$12 “'M duos synejar sptod sx] ‘soaneSau no saantsod (“s) 
SOOULLIVAOD SOP Id}SIXO JUDUITeS9 yWeLINOd [I ‘soureWOp 
suleyao Inod ‘stojaynoy, ‘saoutaosd say] SuUMWIOS ‘soureULOp 
SIOAIP 39 (1) sked siaatp inod sgIJLI9A 3sa UOeNbe 399 


(4 2s7a im X)+ dla - COg]'m KX} = 
(‘« ‘M X)zeA + (i'm {) -stera = 
(«'m X) woa 


DULIOJ BI SNOS dILID9 Ss jnod souUdXOW op dasapUOd UOSTeU 
-Iquiod ouN.p (WOW) QuusKhow anbryeipenb ima /J 


SIINOUdWOD ‘SALNAd ‘SUNAUNAA °8 


‘4 NO J Bpoyqoul v] UOTAS SUOSTeUTqUIOS 
S93] 19 SuOsIeIedW0d say SIOj eB] & aIOUNLIEd JUOIAOP 
ajyonbus.p suvjd say “aUuIYyD ap Sa|IA sopuess qny 
e buro inod saiieysIaAtun sadinossal ap 3a aygnbua ,p 
suv]d op uolyeUIpIOOd ev] Jotjiueyd op ule udisaoUQ GJ 


“‘xneIni ya 
SUIVGIN SUOT[MULYSE Ud D IPOYIUL BI UOTAS SQUUOT}DETIS 
919 JUO SQUUOT[NULYDE Sed Sa] ‘sUOT[NUYSE synod 7x 
op s[quiasud | op uswIeXa saidy ‘sue p ap sjuRjUS 
Sop oireumtid afoA9 9] JURAR asessnuaidde .p suoentts 
sa] Joipnia Inod xneini 3a suleqin suoj[HuRYyos s}yed 
ap QUUONDET9S B UO “IOSIN Np sivig OE Sep buro sueq (2 


"J BPOYJOW P] UOTAS SAUIQUIOS 
919 1UO0 S]J ‘oueutid afoA9 9] JURAR asesstjUaIdde .p 
SUOIENUS So] JoIpnja Inod sue p ap sjuRjus QOD | 
auudsKkoW Ud JURIdWIOD sayst{Iqeqoid suO][]WUReYdEd sop 
QUUONNIDITIS B UO ‘OUIYD ap saoutAoid OE sap [| sueq (Pp 


‘4 9poyjgul 
RP] UOTaS sgUIquIOD 939 jUO ST] ‘outewiid 9[9X9 
J] JURAR aS8esstjUaIdde .p suOTEN}IS So] JaIpNIg,p ona ud 
SUL pf OP SJURJUD,.p soUTejUd. sonbyjanb ap suoj[HueYyss 
Sap QUUONOaaS B UO ‘sTUL]-sIeIq Sap spIOD ET suRq (9 


“(q)'N d2Ak ‘INO ‘IO UOTIS 
{JUSWIWUOD 39 SUOT[MURYDS $9d IOUIQUIOD UO-}IRIAOG 
‘(QQO6[ Ud «SOTBIORI SOINOWId» sop Noi] Nd JUO NO) 
SIU]-SIeIT SOP SOI[IA SapuvIs Z[ SUBP SQUUOTIDETES 919 
JUO soSevusul ap sourejuao sinaisnjd op suoyjnueyse saq.  (q 


‘(q)'N 90ae ‘9an 
-PULIJJe JS9 asuOdal B] ‘IOW UOTAS {JUSUILUOD 39 SUOTIN 
-URY9 $90 JOUIQUIOD UO-}IRIAOq “suoNendod sap are1 
PR] Doak ‘unoNe ai10A ‘Wodde1 op nod aonb vu sAdAIng 
AqyNI9J POA, Sop xneuoneuU suoj[HuRYoe sap aie eT = (e 


‘sg[dulaxe Sap IOIOA UA “S[NUIND Sa] 19 SUOSTRUIQUIOD So] 
INS ‘S9SIOINE XNEQIIA SJUSUIOUSTaSUdI Op No sattqnd sonb 
-IUY99} SJUDUIOUSTasUaI ap assI8v;s [I,nb ‘sayqeiy saouaJgJol 
ap oenbueul 9] 9}e]suOd 39 UTOSAq a] NUASsaI Ivf 19 sojIOs 
SaINO} op saulg[qoid sap INS SUOISSNOSIP Sap NUD} 1d STIIS 
-U09 Sop guUOp Ie.f¢ “sfaei sonbryeid sowiepqoid xnaiquiou 
op & sew sang no sanbioay) suonrinoads sap ev sed 
UOU Ie} JUO SagUUONUSUISNs suONdo saz ‘Isa snyd IN?) “ney 
snjd sagouous suosiel soy nod ‘Tetsads joj seo uN stew 
‘sardnnu sjusuraoe due sap Ins saguuop op uosreUIquIod 
R] ap [eloads svo un dUIWIOD dalEpIsUODS oj9 Jnod saguUOp 
dP seUONeUN[NW UOSIeUIQUIOD PT 19 € UOTIDas BT B SAQqUS 
-g1d sajjao & JUaTquassai saguUOQUoUIsSNs suondo say] 


senbiydeibowap sajanbua,p uosieulquuod e| NO jNWIND 97 :ysIy 9S 


“IISLOYD Op 
JUSTAUOD [I (J B (q UONeIgpUOd ap sapoyie sap ayjanbr] (9 
y9 (e uondo | sajda0oe juoweduiis no suolnueyse 
Sd] JOUIQUIOD Op UO,] Is (q ‘(‘M) UONLIndod ap saneyer 
[ie] PT & a]jauuonsodoid ang Wop a[a Is no syuoWade]| dua 
S| Sno} Inod sugU BT 9.19 WOP III} L] Is JUOWIOITTNONIed 
‘uoT]HURYE,p Sal[ieVy sop uonniedal vy] op (e& Japloap 
ne] |] ‘uONvortueyld ap s1ps1oO | B JUOWoIIessaoguU sed sTeUl 
‘SUAIOV SdP SISOTOUOIYO PT & PUOdSIIOD IDI QOUOUD OIPIO | 
JUOP SUOISIDAP ap SaTquIdsUd SIO] sIPUdId ap JUSTAUOD [] 


‘agsuodaJ-UOU dp SA1JOS9}v9 Sap B IDRIS 
asuodal-uoUu Pk] & OP SIeIq J dIINPdI Ap ONA Ud S}OJJO 
XN® I[GUassal B[@pOW ap a1Uds 99 9p UOTONISUOD 
el iN % "{ aye10} oy]te) op opuvss snjd uonendod e| 
ap UOT[MULYDE UN JULI SUUWOD [PI0} UOT[NULYIE | SIOTL 
J1QPISUOD UO ‘OUOG ‘apI[eA sasepIsuod ang yned ‘jy 
dun | Ip UONdITaS B] SaTfanbsap Ansed zB ‘«sosTe]ILUIS» 
sjuauiaov| dua, p saasodwioo ‘’y eek sajes-opnasd op 
UONINNSUOD PI & ddBIS SAQUUONUDUISNS sUONdagoO Soy 
JQJUOWLINS OP INA Ud SWOJJd Sa] Ja}1A9 jned Ar a 0" 
wouajsod ke uonroynens ued uoneigpuod ey GJ 


‘JUSUIIVIIGIe SQUUOTIOITIS SJUdWId9e[ dW _p 
d[quiasud UN.p uUOsIeUIqUIOD eR] B Josoddo,s jrelInod 
uo ‘juepuaday ‘sprod sanne,.p IIstoyo yWesnod uo 
sIeul ‘a}qeuuostes ajquias ‘Ay uONe[Ndod ap aI]1eI P| op 
XIOYS FT “SATJe[OI DOURLIOdUWI INZ] dINSaU dUTe}IIO oUN 
suep ]uv}a]Jo1 splod sap sjususoe[dwi xne sanbiydde 
eB yuatAal ‘My {/'«'y { = “€ aaigpuod uosreurquios ey (2 


‘nN. uoneindod x] ap ajjrei ey op 
iu 'U UOT[NURYDE,p a[[IB1 B] ap aIdu09 JT} SUBS ‘JUL 
-aoe[duia onbeyo e sprod surgui aj Janbiydde e yudtAos 
sjuawaor[duia y ep y/'€{ awojrun uosteuquiod ey (Pp 


‘qd ap syooidde ;s 5 ‘sioye ‘19 sayes9 
anbsoid yuos 10-sa]jao “WUaANOS = *'w~UOT[MURYDE,p 
soy[i@] soy uoNeigpuod ap juaroyya0o inod yuo '€ 
uOo|[NULYDE,p sauUeAOUL So] onb vIB}0U UG ‘s]USWITS 
'N { ap uonendod ourgui ev] op onsed juestey our09 
SdQI9PISUOD ong JUdANed sjusUIBOR[ dua sap ‘Ay suONR| 
-ndod saj anb sasoddns e ouinsai as sauuoy]NueYyse 
sed sap sno) ap ‘uy’ {='« adus [nuns ey (9 


“SOANROLJIUSIS JUDIOS (¢ ~ '€) saouarayjip say anb inod 
(suone[ndod sap ‘uonrasasqo ,p sapouad sap ‘sounsoul 
Sop ‘So[quIIvA sop) UONestuOUIeY oUN jUd}ISsIo9U 
S}OUNSIP sjUoWsoR[da say aud suosTeIedulod say (q 


“S9dINOSSOI 
no sopoyjeu soidoid sas viast{iyn inb inayoay np uon 
-Q1NSIP P| B SOQSSIR] JUOS Sd]OUT)SIP sanbysyeys sap UOS 
-IVUIQUIOD 9}NO} NO UOSTeIedWIOS BINOT, “«SsgsTUOULIeY» 

Iu saguUop1009 9a39 sed jUuo,U soguUOp sa] IS 
JUDWAIaI[NOWIed ‘aaidope juswajanirqey sa Inb ayjao 
}so UOTINTOS aNeg °'€ sajoUNsIp saygnbue,p suoneumNss 
sg] juowanbrun saqjussaid eg soNUN as ynad uQ (ke 


“soguuop 
SOp JUSUIITVI] Bp sorqissod sapoyIeWl SasIOAIP Sap dIST| 


Sst 


aun JING “USWSWOJ sIVA syUsWsOR]duIa sop UOne[ndod 
RB] Op IIe) PT Is UIQUI ‘s]UdWDOR[dWID SIOAIP Soy INOd sWIQU 
PR] ISO UOT[NULYDS,| OP ale} ev] “WOANOG “«SOIIeJUO[OA» 
juda{duiIs JUOS NO JUOWOITeIIGIe SIstoyd JOS s}UdW 
-20e| dud Sa] NO SUOTIENIIS SASIDAIP 9AIISQO Ie. “JUOUNUOD 
un .p sianue sked say ag swig JUdTeNOd S|] “soursn sop 
no xneyidgy sap ‘sayOd9 Sap SWILUOD ‘s]USLUASSI[GuIE Sop ane 
Issne juareiinod sq] ‘sked un.p s}oLNsIp sa] No saoutAold soy 
‘Sa]IA Sa] ag JUsANed sjusUBOR|dWIS sa] ‘s}UdWUVOR|dWIS 
$90 ap aystiqeqoid uoy]HURYSE uN.p saidne tu ‘sno} e sed 
sIeul ‘sauIquios uoNEndod aun,p syuowsovy dura sinaisnyd ke 
Sa]qu[quias saguuOp Sap I]][lende1 & UO, anb suosoddng 


SDTONILSIC SINAN) V Td NAG 
NOSIVNIGIWOO °*L 


“SINILIDIUL SYDONS Sd] IIJTVUUOIII OP UOTIIPUOD k ‘oINd|[IOW 
PR] ang-ined so osAyeue-vIDU OP UONLUSISEP PI STRUW ‘IOI 
UOISIO9p BR] BIpudid sed suOAdp ou SNoU ‘JUdtUaSNaINIY 1104 
“ONUUODAI JUSWISIP] 19 SSLIdWO9 UaTg InY ,pino{ne dA}d9]][09 
UOVUBISAP ‘«aSATBUL-BIOU» BV] Op sIQIUUL BI SNOS $a]NOo} 
Jodnoisai so] op aj qeiayoid 3s9 [I,s NO YE SaguUP Sa] sIndap 
JOYSl{ 19 SAA ‘ULIYIOD We} UO] DUIWIOD ‘«saguIqUIOD 
saouatiadxe» sagjadde ane juarelaop (sopuuoUsWsns 3 
10 g ‘V) sooustadx9 ,p UOSIPUIQUIOD ap SAPOYISU STO] Sd] IS 
IIOARS Op UOT|soNb ek] DIpNosal B suIOW! sed 9}S01 Ud,U T] 
“‘xnonjonyy stuo1dui09 un JoAnoN) 
stojied ynad uo] Is suigu ‘sagredgs sapoyjawi xnep se] 
IluaureUL ap ayn snyqd so [rnb oumsa ,f ‘yuowsljouUosIag 
‘gIquioo ong siojred yreunod nb onbiuojsty juaprooe 
un.nb jsa,u xnap say aud assoj of onb ang-jned yuol 
-pudinos sunone q “sapoysu xnop sao Jasuvjow sed ou 
ap s[qQe1ajoid ajnop sues 3sa [I ‘saygnbua,p UOsIeUIquIOd P| 
19 SQ0UdTIDd Xd Pp UOSTRUIQWIOD Be] 91]Ud sajJURpUddaplojUT 49 
sonbneurgisks ‘sajuryodurt saouclayjip sap nua} aydwi0d 


“UONORIISR .P SUIOJ 
91190 ap sUIENX9 UONPI}SN]II | Sd ‘sjouNsSIp sanbnsneys 
s1so] sap ‘q SOUT) sInoyeA sa] Ins UdWeNbrun 
QPUO]J “IOYSL Ip QUIQUIOS sa} AT ‘soatTqnd efap sonb 
-1]S17B}S SOQUUOP Sap INS SWIQU ‘sonbyysiyeIs sasATeue Sap 
[BUI] J9JOA 2] INS Jopuoj as JuaAnad KOJI Se] ‘aNUOD 
Jeg ‘oaqurofuos asdyeur | Joy pIoey op ulye ayyiqeiedwioo 
PL & 19 Ques eT e yUeSUdd Ua dNdUOD ‘a}a{duI0D 
aenbus,.p spoyjeu sun suru 3a aJQ7dWI0d anbnsiyeIs 
asA[eue oun yuoyOdWI0S FO{ So “WWOWOUIZISIOIL, “¢ 


“XOW S9P 
Svo J] SuBp og, Ned aU No sed js9a_,| dU “WUaUTATTANIIGeYy 
‘SIRUL “OI Sap seo a] suBp dastooid ysa aseq op uON 
-ejndod ey] “(11 ‘L861 Yshy) oun Jorloes ua .p 9010} 
}S9 UO] 19 UONSTUOpURI ap SOWIOJ XNAP S90 JasITeal 
OP ILOJIp isa JI ‘oyosroyoor op teary yenb aywod 
-UI,U SURp “JUdWAT[eNIIQeH ‘soruljap suoneindod sap 
SUBP — SO[QUURA Op UOU 39 — sjafns ap oITOJegTe UOTDeTaS 
d9Av astfiqeqoid aseuuo[[HUeYdS,| INS JUSpUoy as 


6661 aiquieoep ‘ajenbuae,p senbiuyoe | 


AOW Se] ‘uepuadayg ‘sjaf{ns xne yoddei sed sajqeuea 
sop UONestWOpuUR! eT & DORIS [eJUDLULIadxd a]O.NUOD 
3] Ins jUdD0R | JUDNOU KOI Se ‘ouoq ‘sajgnbua 
sop ins quoyod qo sao aonb sipur) ‘saouatiadxa 
Sop INS JUSPUOJ 2S KOW SIT ‘guid eB] ke ddl] 
SO SOPOUJOW XNIP Sd] IUD DOUDIOJJIP QWIQIXNSp eT “7 


“‘UONPOIJIUSIS 
ap siso} sap uoneordde,, ap soy ‘gy sauiqeqoid soy 
auuango uo | anb juawanbiun asrxa JoYsly op 182) oT 
“soTeJUSWULIEdxe sarqelieA Sap InajoIpaid/puejoipeid ap 
soiled Sa] d1]Ud SUONRIAI $3] INs aBpuo]j as asATeuR aNaD 
“«QSATVUL-R}OUI» DULIO} d] anbipul,| suMW0d ‘saesi[eas 
efap soouaiedxe.p syiodde1 xne sanbrydde say ynad 
uo nb yey Ne Id} (KOI) SeoudTIadxa ,p uOsTeUIquIOS 
OP SOPpOYIOW Sop aSeJURAR pUPIS UN ‘aNUOd Ieg “(P66 
YSIS) Dlessaogu STeUL ‘A[IOIJJIp 1s9 aJanbus .p xneuoreu 
sur[d sIdAIP Sop UONPUIPIOOD x] ‘soyeUuONeUNTNW 
sajgnbus sap Injao suep sIeu “JUdWAT[IINIeU Ie} as UO 
-PUIP1O0D P| ‘saydynu sourewiop & sayeuOTeU sajgnbua 
Sop SBd JJ SUB ‘“SdT[aANOU JOS INb ‘suOsTeUIqUIOD sap 
In[9o suep onb ‘saasi[vas a3 elap quo Inb ‘suosteredu09 
Sop Sed do] sUep UdIq Issne ‘saeUONeUN;NW saignbus 
xne jnouns onbiydde.s onbrewiar 999g ‘UONPUIPI009 
op 10 uONeoTIUed op ‘sjneredgid ap dnoonevag juasIx9 
(GOW) soynbus,p uosieurquiod ap sapoyjsw say ‘| 


“saqueWOduI saoUdIAIJIP SION) IajUasaid JUaTqUIaS SapoYIeUT 
sao ‘sagnbidde 919 yuo sayja,nb sajjay, “aipnosal & JUASIA 
sazjo,nb sawefqoid sa] aud 1a sapoyyawW sao ap syndefqo 
SO] WUD SIdUdIOJJIP Soy] JouTWeXd eB aNg-jned ajsIsUOd 
SUONPIAI $90 JOUIID op USAOUL INI|[I9WI 9] “Xnap say aue 
STN SUONLIAI So] Ja[9d9ap op UlJe 19}0U Op JUaTAUOD [I,Nb 
soTqe[quias sjnoafqo xneiquioU op jUO apnid,p soureWop 
xnop sa] ‘Juepuddad ‘aousdtiadxa.p saguUOp Sa] JOUTQUIOS 
ap JUR}OULIOd sat[ao anb j1eJ ua pre} snjd dnooneag ‘jutod ne 
SOSTW 91Q B JUSUATNas JUSOUDWIWUOD asepuoOs Jed aJgnbua_,p 
SdQUUOP Sa] JaUIqUIOD ap juR}eWIed sapoyjeul so] 


C861 UPTO 19 
SOSPOH £96] SSPID) “(eanUs,p SequuOp) sInajoIpsid 
sinaisnjd no un saide.p (Qeiynsel) purjorpeid owgu 
3] Inod suoneindod 3a suoj[Nueyse sIdAIp op soidne 
snuaj}qo xnejusutiadxo sjyei[NsaI sa] Jodnoisa1 op 1a} 
-jouuiod sajq “yuowuenbey snjd us snjd ap saanbrydde 
juos sonbnjAyeue-ejaul sapoyyawW say ‘saquada1 sn[g “O 


‘anbnsneys ap soiien sop wednyd 
RB] SUBP ]LIOSP Isa NUUOD UIQ }$9} 9D) ‘a][NU asayodAY 
«QWIQUI» PB] JOIJI9A Inod ‘sayqeueA SaSIOAIP B OWIQUI 
]9 SOJUDIOJJIP JUWIaIatUS suoNL[Ndod sap ev sanbydde | 
yned uQ ‘uaToUe snjd o109Ua jsa ‘aT[nu aseyjodAy 
«QUIQUI» BP] IP TXT PLVd-IYd $}So} Op 9ALJOP ‘soguIq 
-W0d saiiqeqoid xne s[qeordde says op iso] oT “g 


sojuepuadeapul saouatiadxe sinorsnyd 
JauIquios Inod ja saguuop say JUaWONbNsNeIs JosAyeuR 
Inod aourliea ey ap askyeur pp sapoyjour soy anbiydde 
UO SInayne sag ‘saguue p Ja sdureyo ap ‘suone[ndod 


OP SWS OUN JUDTRIANOD Jd (SINdoIpaid sinaisnyd no 
UN) SIVISUD So] UOTAS (puULIDIPeid) sainjy[Nd op jUSWIOp 
-UdI ne je) JURAR SQOUdLIOdxa sap ANs JUdIeLIOd sajote 
SION SXT “(ESI UBIYIOD 19 SOWA “pC6Il 19 LEI 
uRIYIOD) pajsweYyIOY 319 JOYsty Jed onb tsure ‘say x 
Jed apioge 919 JUSUIE|eS9 B Jd ULIYDO_D Jed sattqnd sjus] 
-[99X9 SINdLI9UR SI[DTe SION ap jafqo,| wep eialnsag “Vy 


SHONGATAAdXH.d NOSIVNIGINOD = °9 


‘saquvysIxa 
efap suoneoydde say siaAndde inod «sajeurmdo» suon 
-N]OS Sj JoyoIayoeI ap ana ua sanbruyoa} sapnia sap Jastyead 
vIpPNe] [I ‘eouaplag a3no} eq = ‘(enbruonssja uoneorqnd 
Bl B doRIS aNjQ-Ined) Inayoe] Ne xIOYO 9] Jasstey ap 39 "4 


DY 


19°'€ toy ey & Jarfqnd ap afqvagouod jIeIas [J °xNvI0} Se] 
19 SoUIeOp spuRs saj Inod ”'€ x stew ‘sauteWiop synad so] 
mod “'€  aouasayaud ve] JueuUOp Ud «anbuNaUIAse [NWUN» uN 
a100Ua No ‘saguUR sorgIusap xnv yueodun snjd 9] sptod 9] 
apiooov inb euueXow oun °'€ uaiq no ‘”’€ aguue olgruop 
Bl 9p QUUDAOU BT IIOARS B ‘sagUUONUEUUSNs suoNdo sasiaAIp 
$9] BI]UD JISIOYD 39 S]Usd9J snyd sez @{dw0d JUsWIaTJaANOUAL 
d9AB SUOT[NURYDE Sa| Jed synposd syeyNsaI so] JUSWIST[ENUUE 
Jatjqnd jnad [J] ‘saguuop sap satjqnd inod sue g] aipuane 
snjd Wop ou anbusneis ev] ap neaing 9] ‘jUoWOTTaAnoudL 
JAR JUDWIASUdDOI UN,pP sed aI SUBpP ‘Iso snd Ind 


‘soguitied 
ang 39 sue QO] & UN.p JoIep yUdAned Inb [euUddep 
JUSWIASUdD0I1 UN,p sesuUOp xne | = °M4 JeNUS sprod 
3] JUepIODON Us a]JaNIOv sINaY,| B SNUd}qo xnao anb 
sINO[[IOW JUI[QUIIS s}eI[NSQI sao sno], *”'€ ap sawaNXe 
SINI[VA XNIP SUIWIOD sagsepIsuoS ang jusaned “’« 4a 
"€ ‘quod ‘sanbuidurs saguuop sap seide p no afapoul 
un saide ,p douRSSIOIO ap aqiNOd P| JOUTULID}9p ned UE 
‘(sed onurwip ou no) anbruojouoW uodej ap dJUsUISNe 
uno Sms scms'ws oy cone “Kim T=" (0 

‘aides suuog oun ang WeLnod sdwioy np fy ne 
g]quis uUaKOUI oUN,p [NdI[eO 9] ‘soureWIOp syed ap no 
3][210du19) souvpUs) sUNONe JULJUASEId OU SaTquLIeA op 
seo a] sueq *[‘Q = ‘mM splod xip soy sane “K'y =" (q 


“9SCUUO][NULYDE ,_p 
uorsiogid ey aonb ajueyodut snjd 3so oyyenjor,| 
No ‘(suOTIOR Sap sinod ‘satuapide ‘aseUQyd) JUSWUIdWOJ 
juanjonyy inb sayqeuea xne nb isure ‘aurewiop puris sed 
Jo SaTRUOTILU SUOTBUIT]SA xNv apoyjesU 999 1anbijdde 
yweinod uQ ‘eyeuly sguue., yUoWanbrun juesi{yNn ua 
‘9 ='M Spiod sanne jnou sopyo [ = My soar “OK ="K (B 


TSM 

9 (6° '710=)'4'M {='k afeuuacgp ouuekow 

gun Jgpnojeo inod '¢ sayjanuue souuakour xne sanbidde e 
'M, Sptod ap sayquiasue sanne sinaisnyd onb suosepisuod 

‘uoneindod vy] ap 

[Te] VP] Op Saile]Noas saouRpUd) Sop a}dWI09 ITUD} a1N9-]nNod 


senbiudeibowap sejanbua,p UOSs!euIqUwOd e| NO jnWNd 97 :YsIy Sl 


WVIAIP UO ‘sue QT INS sayfonuue sanbysiyeys op suudXoul 
RP] Ja[Nd]eO INIA UO, | Is “BYOURASDI UY “soIe[Ndas saouvpudy 
so] Jojuryddns yresinod sarojyegye 19 SdIQIUUOSIVS SUOTILLILA 
SOP I[|QUIASUD | 2p JUUDAOW PI Ap [Nojed 9] :a[duuts aapouw 
ap IMAJOs JusteLnod seo sap [nuns ajduis ay 1a f aseu 
-UO][HULYSE Pp UOJ OUIQUI BT JURST[N US (SqAJA) uo 
-99]98 Op auiqeqosdinbe,| ap epoyyau ey sed snuaygo suoyyn 
-UvYd9 Sa] ‘aguUP J[Nas OUN INS [NUNS J] INOg “saastaoIdut 
sopoyjew sap uojas aonb sanoajJa aia eu sonbipoed 
sajgnbua,p jnuino a0 ‘juasaid ev nbsnf ‘eo ‘iuaae | suep 
anbruysa} a[sue | SNOS JUSWASNILIES SUTWUIeXA ag LIADP 
yans 99 {sanbipoued sajgnbusa sap Jaynuins yuoWIUWIOD 
‘sna sed teu af anb sane .p juowayqeqoid 
dISIXD UD [TJ] “(T96I ‘T[O9 19 USEY SQG6] AouUOOP]) BJBUONeU 
doyiod oun sed quede .u onbionb ‘ayjie} apueis ap «jaydwio09 
JUSWI][IANOUDI S9AV SUOT[NULYDE» Sap JURALIOAP SINaLIQjue 
soponie xnop Jauuonuow op atidoidde jusurayese 3S9 I] 
‘satqviedui0o 
JUSUS[VIQUSS sTIeU ‘sJUdIaJJIP suejd soap juoUTWIeXa 
sked sane sulewiad ‘sagynuind sayjansusw saygnbus sap 
INS JUBUDJUICL JUAPUO] as dATOR UOTE Ndod ez] Ins sajgnbus 
Sap saguuop Soy ‘up-suINeAOY NY “(666 PseUST) NUNUOD 
JUSWISUdIEI UN .p suR]d so] JoIOQRIa,p ule) Ud yso onbTy 
-SI}e]S BP] Op [eUOTJeU NeaINQ Z| ‘dour U_ ‘pse] snjd [euuss 
-9p 10 [euuanburnb jusuasuasal ap saguuop op uONONpold 
ey onb tsure ‘¢Qqgz seuue,] saide sasvusw ap YOO OOO € 
INS S99PUOJ sag][IeJap sayjonuue sanbysyeis sp uoNoNpoid 
RI 19 SaBeUDU YOO OSZ ep seidne sajjansueu saygnbua,p 
uoNrRst[eal P| WOAgId aBepuos ap urd a] “(666 JopuexXeTy) 
neaing snsuag SQ a Jed suorsa1 /¢ suep ajoyid tessa un & 
ayjanjoe ainay | B stunos jsa Inb ‘(Sagy) Adaing AyunuTWI0D 
URSLIOWY | Op INjs9d juL}a 19-xNdd op INTO 9s] 30 
puvis snjd 9] — a1uas 99 ap xneUONeU SUOT[NURYDE Sep JUdUT 
-W9991 NSUOD B UO SIRJAT “JUSUWIIATIOOJJO WeIa10geI9 UO J aonb 
JO[CWIOD JUSUTAT[AANOUSI JdAR [ePUONeU aseUUOT[NULYIE ,p 
uryd 1no} ap ajuadseyo vy yUoWIa;dutts yUajUasaidal yney snyd 
soasodxa sajejUsWepUO] sagpI soy onb amjoupe stop of 
‘ouenb suuog ap sonbrydeis 
-OW9sp sajgnbua sap ya aatjoe uoNeindod ey] ins sayenbua 
Sop (QUOWOIT]OINSOWIN No jUdWET[ensusW) JUSUTUIENb 
-9JJ OSI[VaI1 UO] NO sXed sa] suLp sadVdIJJa S[INO sap ang 
Issne Juarelinod ja du109 JUSWIST[9ANOUAI D9AR SUOT[NURYDE 
So] ‘UORUINSA,p Sopoyjaw op uONvoTdde sed no sansise1 
ap soguuop sap saide.p sajduis sanbnsneis sonbjanb 
jo sonbiydeisowlap suoneumnse souuog Zasse ,p aitnpoid ap 
soqedeo sed say suep dUIQUI SdIIeSSID9U JUOS SUOT|HURYDE 
sag ‘uonrindod ap saiyjiyo sap juoweduits anb jo3njd 
SQTBIDOS Jo SaNDIWIOUODSS SaTqRLIvA SASIOAIP INOd sog|[Ie1ap 
juowloyeneds sayjonuue sonbysyeys sop oinpoid e juauayed 
-IOULId JIRIASIA JO[AUIOD JUSLUDTJOANOUDI SdAv SUOT|HUPYE ,p 
uonesian | ‘sked ap ciquiou sued “(8661 ‘L661 ‘0661 
ysry) sAed xnoiquiou ap suep sollessad9u JO} JUSIeIOS 
JO InNvjJap JUsWopuLIS jUOJ INb saguuOp ‘judd INOod GQ] ap 
SsuO][HULYSE ,_p Sidne sar|[tandal a1j9-jnad ‘sag|[IeJap Sajjenu 
-Uv SOQUUOP Sap dINpold JUsWIsTes9 JUSTeLINOd sajgnbua sao 
ueyodui snjd o100ue y1e,J “XneUuUddEp S]USUIESUddaI So] 


Sl 


J2 date UONL[Ndod eI Ans sayjansudwW sajgnbud say AOARS B 
‘saqqueyoduut snyd say sayjaroyyo sanbysneis op sovos xnep 
Sa] o1Inpoid snod Jasin quatoagid no yuast{yn shed xnoiq 
-uou ap anb xnao jusov[dwias Ja]dui09 JUSWIST[9ANOUSI DAR 
suo][Queyse seo aonb sajonie sinaisnjd suep gsodoid ie .f 
‘OTS/OTS AP JUOWsUddaI UN JUSTeIINpoid sjonuUe suUOTIN 
-UPYO9 $90 ap XIp ‘sIO[y “1U99 Inod Q| = QZS/TS ep [onuue 
uO] HULYSE UN JreIINpoId sarepeWIOpgay SUOT[MULYIE $d ap 
ZS Op [nWUINd FT “O7S/I =f EP (SAA) UOHNDeI9s 9p sIT[IqGeq 
-oldinbg | ap apoyyeul ve] Jed UONdaTIs Op xnv} DdAe DTepew 
-opqey [euoneu aseuUo][NueYyoe.p urd un suoUIsew] 
‘sapoued 7 19 [| aUa 
SLIGUIOD JUOS SaIIVIPSULIAJUI STIeJap 9p XNBdAIU Sa] sjonbsa] 
Inod ja 4/¥=,f sjenbsay nod yajdwos juswayjaanoual 
ddAR SUOT[MURYSE sop sIINpold yUdTeIAap sopoliad 4>y¥ 
OP SOIIVIPSULIDIUI S|NUIND SAT “T= Y/y = ,f IoAe BIQuIasUS 
uos suvp uone[ndod x] ap g]][IeJap JUoWIASUSd_I UN asInpold 
sopouiad 4 sap jnwino gf aonb uodey a[[9} op auuoNda[es 
y9 97e10} uONeindod ve] op 4/] =f UONoeIJ SdAe J}ST[IGeq 
-old uo][HUeYSE UN B UNdeYS JURBpUOdsaOD (sjUBYONeADYO 
uoU) s}ouNsIp sanbipotied suoyHURYdE 7 JUeUSICUIOD (J1N99] 
-[09) gutquioo uevyd un.p W8e,s ]] ‘ye[dwoo jusWsT]aAnoU 
-d1 DAR JUDUIISUIIOI UN SUOSSIUTJap ‘I9DUSUIWUOD INOg 
“SJUSWU9SUdDAI UD NO spuRIs 
snjd xneuussasp no sjanuue suoj[nueyse ua sanbipoted 
SuO][MULYdE Sa] aynuINd uO puenb sayeneds saytun sayned soy 
$9}no} Inod suoneuMNsa souuog op JUSWIgTIOeJ oIINpold snod 
juauraeroads jno} snduod 9139 JUDATOP jo[dWI0D JUDWIAT[IA 
-NOUdI SAAR SUOT[HURYSE SAT “sdus) Np [IJ ne [NUNS 9] Inod 
geulixeur aeneds anpusjs oun 11u9}qgo0,p omjouled snod 
aueyodun snjd dnooneag sinWdANod UN JIPUTONe & IISIA 
JUSALOP JOTCWIOD JUDWIDTTOANOUSI DdAV ISLUUOT[NULYIE ,p 
suryd sa] ‘auoo Ieg ‘saxquUOd sajygnbus sane .p Ja sATOe 
uonendod ey ins sajgnbua sap aseuuo][nueyse .p sueyd 
XN SOULIOJUOD JUSIOS SUOT[HULYSE Sa] anb JaNssev .p 19 SIND 
S93] DINP9 ap ana Ud “Ad(),P UONdeTas PI & YOR So] JUSWI 
-gjeneds oyu] e@ UG ‘sonbiyroads 39 saqualayjIp suoNdUoJ 
sap inod snduo9 quos tnb ‘jaydu109 JUSWI9TJaANOUAI JAR SUC] 
-[QuevYd9 So] JONZUTSIp WOp UO STRJY “saXxdUUOd (YODA) sja 
-pluasoidal sje[NUINS sUOTTHURYDSE Sap salgI[Noed sau0J 
SOP OULD SSIBPISUOD d1}Q JUDIRIASP SaINe Sa] 39 SUN SIT 


SINGINYUSNAOAA La 
LATA WOO LNAWNATTHANONAY 
QJHAV SNOTILINVHOW °S 


‘sjugjeadjod aseuuol]nueyoeg ,p suvyd say inod onbrun spew 
-1do spouad aun Jourunayap assind uo anb ayqeqoid surow 
a109Ud a] quIas [I 19 onbrun sfqeiueA suNnone Inod «euMdo» 
JUSUTSYONVADYS I] JouTUIa}9peid ynad ou uo ‘aour[quias 
-IBIA 9]NO} UO[IS “JUasSsIstoyo sa] inb sed say] snod «xneuwl 
-do» JUDWI]]991 JUAIOS sayeredsip syUdWIayONeADYO sao 
anb ajqeqoidut y0J 38a |] ‘27a “oJa ‘slow Z| ap sapotiad sop 
MOUS SaNe Pp SURP ‘SIO S101] op sapoliad sap saijne ,p 
suep ‘slow un,p sapoliead sap odnoisei uo ‘seo surejz199 


6661 aiquiacoap ‘ajenbua,p senbiuyoe | 


SUL {dIIBIIIGIe [I-]S9 XIOYO J] dINsow ajfanb sueq “USUI 
-O[PANOUSI SAB JSeUUO][NULYD,| INod sadIstoyo JUSUIDI 
-leniqie sapoued say anua.nb i9inj{d ‘sapoued say saino} 
IUD SUONL[IIIOD SOP INS SAPUOJ JUDILIOS sJUdUTAYONeADYO 
sa] onb yey ne juan Add np yueyodur asejuear anne uy 
(0661 USTH °$°9 “L861 
Ysry) WseUuUOT[NURYDE _p SayIUN SOWQUI Soy] JUSUIaTduIIs JUOU 
-UdI}UOD ‘JudWaT[anqIqey ‘Inb syueInos syuBYONeAsyo suOTIN 
-ueyoe xne Woddel sed sajqviapisuod sosejuRAr Sap dd ne 
yWeINUUOp (S]USUITS ‘SoUUOSIod) SNPIAIpUI,p sfoued ap uots 
-N[OUI J “SosevUugU Sap Ja SouUOSIad Sap dII[IqOW BI ap asnvd 
B ‘SoJUBYONLADYO ISVUUO][NULYIE Pp SaIUN SdAv SaIIeUIPIO 
suejd sap uaXow ne Josijeai ynad au uo, aonb (sainiq) 
SO[[ONPIAIPUL SUONRIIVA Sp dINsoW ve] JoUJod [I ‘ano u_ 
‘(sanbidodsosseul) sayjaU SUONRIURA Sa] JoInsoul Inod saynn 
quos Inb suone[a0d so] WUINOJ 19 JUOUIIT[OANOUSI JA 
aseuUo][nueyos ,p sueyd sap sjyuauayoneadyo soy sovduras 
oued a] ‘21a pd-od-qd-nd sed uosteutquiod Fv] si0[e JayUas 
-91da1 & 19 ‘DJa p-9-q-p syuRYONeADYS UOU sUOTTNURYDE ,p 
g[Q[[ered atigs oun e d jaued un Jajnole e aystsuod Inb (dd) 
guuonoely joued e urd ajedde.f onb aseuuojjnueyss ,p 
ueld nedAnou UN JaIapisuod Issne jnod uo uepuedad 
‘JULISLINOIAP }S9 SMIIAIOIUI SO[[OANOU 
Sop SIO] osuoda1 op xnv} | (9 19 sorQtwWoid sap nao 
onb siqrej snjd dnooneaq sed 3s9,U SMOIAIOIUI SaT[aANOU 
SOP NOD JI (q ‘saTqrej JUOS SaAnIsoOd suoTye[ai09 sap wed 
-n{d ey] (@ Is saoRvoljya StTuUOIdUIOD SIDAIP JOUISeUI WeLINOd 
UO ‘“SOANISOd SUOTIe[IIIOD Sa] IOIAD INIA UO] IS sTNUINS 
Sa] Inod sjouNsIp suo[[HUeYdS XneaAnoU ap JoUUONDETIS 
op yI[qQeiojoid yUSUIN}IOU 3S9 [I ‘ANUOD Ieg ‘auoYdysyal sed 
NOI] JUO SJUdO9I SNyd Sa] $JOeIUOD Sa] IS SBD 9] }S9 [ID SUILUOD 
‘s}ovJU0D SIoTWeId say anb sasnajnod SUIOU JUOS SMOIA 
-IQJUI SOIQIUJOP Sa] IS ‘SoITeUN sjnod say aJURWOdUT snid 
d109Ud UOSeJ Op OIINPS op JUSOULIAd sjUsWAYONeADYO Sd] 
SIRI “(PS6I UOSIONe ‘Zp Uassar) yalns 99 B suONRoITqnd 
solgtuoid xne jURJUOUIAI Ud ‘asvUUOT[NURYII | INs safoe 
SO] 19 SUN So] sUeP dILIOOP UdIG 919 B ‘saJUBYONeADYO 
sseUUOT[HULYDE Pp SatuN sa] oNUa saanIsod suoNe]as09 
sop pusdap tnb ‘uononpel a0D  “sajyURINOD SUOTRUIT}SS ,p 
uononpold ve] anb sapoued aua s}usuasueYd sap oinsaul 
Re] Jue} oUIOOUOD Inb 90 Ud aseUUOT[HULYDS.p sun Ied 
QOULLIVA PB] OP UOTIONPal B[ ISO SJUSWOYONeADYD sao Jalyysnl 
Inod sagouevAe JUSANOS SUOSILI Sop oUN JT “JUDUWIO[[IANOUDI 
ap one | no sulIOJ uN jUeAOASId aSepuUOsS op uRyd UN INS 
queAndde s ud Juawatjaried yuayoneasyp as inb suoy[Hueyog 
Sap Ins sagstjeel yuos sanbipoied sayanbua sap yiednyid eT] 
‘asesn s]qnop e aseUUO][HUeYDSE,p ULTd UN ITOADDUOD ap ONA 
Ud SIdqI[ap WOJJo unone .p JuUvINOD Ne ‘pres JO kv ‘sins ou of 
‘uonesI[yN afqnop ana0 anbuyeid jo ssodoid je uo J anbrond) 
‘sopotiad sinarsnyd Ins s~nuinod say Jainsouw Inod 42 (qrerAop 
3] UO DUTWIOD) sJUvINOD XNRaAIU So] Jo Sonbrpoled suon 
-PLIBA Sop JoInsaw Inod stoj ve] ve sanbipored suoj[nueyog 
Sop JOsI[NN WOp uo] Is Josod as ynad xnaLgs WyUoS UE, 
(0661 USE) 
sjonuue sjesoise sap inod onb ourej 9] ou ‘sorpe[eul SouTeLa9 
Inod no sayyed snjd suoisa. soy nod ‘ste ‘stow saz sno} no 


SOUIVUIS Sd] S9}NO} SayBUOTBU SoUUdAOW souIe}I99 Jol[gnd 
yelinod uo ‘aguuOnUaUUSNs STHH,| op Sed a] Suep ‘a[durexa 
Jeg ‘Sa][easajut ssuoy snyd ap ans [nuns saide .nb sourewiop 
syjod say Ins sayjao Jatpqnd ou ke sieul ‘s]eSaIse spueIs So] 
Ins saguuop so] JuswUUUENbayy Jatpqnd ve yUR\sIsSUOd sayUPINOD 
sonbiyeid 3a suontsodoid soureyiss ap puajua.s enbiyauAse 
[nuns a] ‘sjenbepe snyjd s}uswiazeN ap xtoyo o] dUIBDUOD 
Inb 99 Ud GUSWSAILIG SSUUOTUDU 3199 ,P JUSILIOUW sJHeTNUINS 
SUOT[NUBYSE xNe SdI] Sapo}! XNap 39 sowefqoid xnoq 
‘(¢ uoNdas) sanbryeid suoster 
sop nod jya[dw09 JUSUIdTJaANOUSI DBAv SUOT[NUYIE Se] 19 
WO $2] aU UONOUNSIp ve] dT} Bp a]]IasuOd of ‘sulOWULaN 
‘sorgttnonied suoneoryand ap jalqo | Wej tu sigue SUIQUI 
aun snos sdadnoise1 919 IU JU0,U Saja ‘juasaid e nbsnf 
Jueynog ‘sevod opueis snjd oun juarginboe 39 juUaly 
-ISIOAIP 9S (YOA) spejuasoidal syryepnuino suoj[nueyse sop 
suoneardde say 3a sayduraxa sauyne ,p d3STXx9 [J “(6661 B98 
30 YomeyH ‘uejded) syueyoneasyo uou ‘sjouNsIp sjansuoul 
SUOT[HUBYOS SION op [NuIND np jueUdAOId saguUOp so] 
stoul onbeyos sarjqnd ap juayautied sXaaing 99010,J Inoge’] 
So][OANOU sg] ‘tUPM-suINeAOY NY “((C66I SAV) sousneis 
jo neaing uelyensny) sjonuue suojjnueyos sap I1ua}qo 
JInod apnuino uo, anb ‘aseuuoy[nueyos .p sosreutid saqrun 
SOP & SAUWIT] Issne xno ‘sJUBYONVADY UOU S[PLNSOWIL SUC] 
-[URYD9 Sap INS JUSPUOJ 9s SIOJUOPY UONRINdog ueI[eNsNY 
SY] ‘SOI SIIPe[RW Sop JOAIOSgO.p sWIQUI JURNOULIEd 
‘squgjeadjod suoynueyog ,p sjqenbieuias a[dwioxe un yuanyns 
-u0d souuosied QOO OST op snid op sjanuue suol[nueYyos 
SX] “ddN.P vuoyjnueyss pueis uos mused neaing snsuad 
SN 2 sed sguuonosjes jUOS suOT[HUBYDE Sag “(BI-ST 
‘dd ‘gc6] sonsneis yyeoH JO} JayUdD [euoNeN) saseusul 
000 ZS Jeasiye10} Inod juawejjanuue sgynuind ‘saseuguI 
000 I UOIIAUS,p S}IOUNSIP soilepeWopgey suOoT[MURYDE ,.p 
saidne sagsi[eal JUOS (STHH) SASAINS MAIAIOUT Ployssnoy, 
yyeoH sey ‘stug-sieyq xny ‘uonejndod oun,p oseu 
-UO][NURYDE ,p SayTUN S93] $9jNO} B (¢ UONDeS) «afdu0d USUI 
-O][PANOUAL DAK SUOT[NULYIE» Sa] JUSUSIEqI[ap PudsI9 UO | 
anb sipur} ‘ure13} 3] Ins suonesado sap 1n0d Z| s1INpel op 
ulje ‘aseuUOT[NUeYE ,p SoMeUILId saqlUN Pp UOTIOIIIS PI B SUOT 
-[URYO9 $90 IOUT] ap onuUOD UG ‘suOTe[Ndod sapueis 
ap Ins saguuop sap Jeynuind nod sndu0d suo][WURYdE sop 
OIIP-B-]S9 9 ‘sayeuoteu suoNendod ap (YO) syueiuesoidos 
SJOR[NUINS sUOT[NUYSE sInatsny{d JURUDUTeUL 3]STX9 [J 


‘sjUdd91 Zasse JUOS sonbipotied saygnbue 
sop Jaynuind nod no eyeuoneunjnw ajygnbue.p sueyd 
Sap Ja1oqgeye Inod saanbrydde sapoyjew sap juoytey Inb 
xngo ‘ayouraal uq ‘sanbipoied sajygnbua.p uostesed 
-UW109 Op S@pOYJEU! Sd] JUDALIDEP Sopoe xnoIquIOU Nq ss ‘f 


‘suosteieduioo xne issne juonbrydde .s sanbrewo1 
sao ster ‘sanbipotied saygnbua ,p [NWINd 9] INs JUdOR | 
IO SJOU Of “XNRUOTIRU SUOT[MURYIE.p sed 9s] SUep 
SOPOUISUL SI] JOSTUOUILY ,P IIOJIP ISO [I ‘aUOS Jeg 
‘sapoued say soino} e onbrydde sa] uo ‘sairepiuis adeu 
-uo]]Queyoe .p suejd sap 39 sapoyjaw sop sanbiyjdde ,p 
ajqeisjeid juowae1gueas jo s[qissod jso [I oUIWOD ‘¢ 


senbiyudeiBbowsp sajyenbue,p uosieulqwiod e| No jnwNd 97 :YsIy ZS| 


‘aSvUUOT[MULYS_,p suL|d xnap sa] oUS 
}[JUOD 9d dIpNoOsel Inv] [I ‘[NUIN sa] Inod sayquireynos 
sed Juos ou s}UaUIaYyONeADYS $90 SWIUIOD, ‘sayURINOD 
sInagjea sap onb tsure ‘suonelea sop SUONPUINSS sop 
OURLIVA PL] 39 DIILIUN NOD J] SIO} LI  BINPoI op uLye 
«SJUBYONVADYO» ISVUUO][NULYIE Pp S9}TUN DAR OSepUOS 
ap suryd ap uondasuod py jUastIOAR] Inb sapotad anua 
SOANISOd SUONISIION SAP PUdJUD-SNOS dIIIIqGuIs 39D 7 


‘OSUO][L Ss 
apoued ey puenb Juanuruip jo ane | & B[qeUeA oun .p 
JUDWIIWOJ JUDIIJJIP Sa[[q “SuONde sap sinod np sed 
3] SUBP SUOTJENIONIJ So] NO gues BI INS SAQUUOPp Sap sed 
a] Suep sarwapids say a0 ‘suoNdaoxa sasnemquiou 
dP dAJOSgO UO] 19 SOANIL[AI aonb yUOS OU «aIIIGLIS» P| 
10 KOPNIT[IWUIS» BT “oN |  <potad oun .p a[quis SUIOW 
no snjd Jainowep v sourpus} v Inb ‘uonerndod «awiguU» 
| Jaipma inod sanduo9 juos sanbipotied sajgnbua say *| 


‘soydnynu 
souleuOp & no suoneindod ke sajgnbua,p UOSTeUIqUOD BI 19 
sonbipoued sajgnbua ,p [nuns 9] aus ‘anbioay) anb y0njd 
anbneid aipio ,p ‘saouasayjip ayenb JauUONUSW SIOp of 
‘[IaTOS Np INojne 42a 
QUITOUI OXB UOS INS IIT, VP] OP UONLIOI PT JULIOTJOI ‘Jonuue 
}2 OUINIP SdJDAO Sd] ILOARS B ‘UONRURA Op «S[amnyeu» xneqo[s 
SapoAd Xnop onb 9}s1x9,U [I ‘SIRT “SA[NN 19 SOUND JUOS 
sWIWUOY ,| Jed saruljap sapotiead sag “aNSouN UN ,p NO slow 
un .p ‘ouIeWds UN ,p ang jnod Inb ‘uoneAsasgo .p sported 
BP] Op IMoNsuo] ek] UOTAS JUOUIDIOJ vIOLIeA IgITNONIed 
J QeLIvA 9}NO} ap pAesaI Ud dITIQeIs PT ‘ANNO UY “(9 anIdeyo 
‘L861 USE) BeAJasqo JIGQeUeA ke] UOTAS  UDUWIdIIOJ 
a1aIJIp uonefndod a)n0} ap «aiI[IqGeIs» ev] onb Janbrewsal arej 
Inod jnes ‘uone[ndod «sugw» oun.p saajeda1 sapnid so] 
JUdAQINOS anb sanbrydosoyiyd suonsonb xne 1d! Jopseye,s 
jnod au uD ‘sajduynur suoneindod ze no sourewop ke sal[ao 
OUIOD ‘ayeeds uosteUuIquiOd ke sajgnbua sa] d9Ae Saye} 
-USWILPUOJ SOPNIT[IUNIS SIN] JOUST[NOS Op UlJe Lol JOUTLeXS 
So] Op Istoyo te,f Ylolomns oq ‘sagynuind suoneUINss 
Sop oInpoid op ona ud UONRSITNN Ins] 39 UONdd.UOD INI] 
SUOJOUIWeX9 SNoU ‘or uepuadad ‘sjaryed syuauayoneAsyo 
sop med jue ua «saqueinod» suoneuNss sap aimnposd 
Inod ja sonbiporied suoneiuea sap Joinsou Inod juswreyed 
-louud sagsi[n 3a sanduod juos sonbipotiad saygnbus sa] 


SHNOIGOMMAd 
SALANONA.G TAWND ‘P 


‘ssonsnfuoo 
jUsUaIaT[NoWIed Ja — saassnod snjd sanbrsoay) 1a sanb 
-Iiduia sapnia,p Jafqo ,| aitey wesaap saydnynur suonejndod 
sop Ins sanbnsneis sop aimnpoid inod sayeuoneu sajgnbua,p 
UOSIVUIQUIOD ev] aonb yUAapIAd jsd [I ‘Naty sweLnenb uq 

‘WOd.1 anb 
ajuvyoduit snjd ang nod souvuva Py ‘suoTTHURYoE sined sap 
seo 9[ SUR “(JWIO) dUUdKOW onbNeIpenb snaia ,| a1inpdl 
Inod snSuod sayapowl xne sat] se_qeqoid sreiq soy Jo souRLIeA 
ap SUONeIUSUUSN So] Jasod ap SUOP USTAUOD TJ] “(g UOTIDES 


LSI 


PR] JIOA) xneSaul spiod sap & sanp doURLIvA B] Op SUOTIRJUOWI 
-Sne sao JuoUgsIO9Id Zasse JOUTULIAJap nod UG “aoURIIRA 
RB] JUDUa|QeIapIsuod JajUUISNe jnoed uoNeindod ap sayjie3 
so] sqide.p uoneigpuod ey] ‘aese aie] op GQuoweAneU 
-1xo1dde) juos suoj[MURYos say puenb ‘nol] OWgIsION ug 
‘sjuvyIodull sterq Sap JUSANOS JUaSNeO UOTe[Ndod ap sprod 
sa] anb yoynjd xne8e sprod sap Jast[NN.p Wwe} aj onb nourea 
-UO0D SINS af ‘9OUd}STXOUT NJ] sed onbrydu ,u sterq op saoinos 
sop ajdwoo mua) sed oN ‘asvuUOT[NURYOS,.p SepoyoW 
sasieAneu xne no dsuodgl-uoU eI & snp steiq soy Inod 
SO J] ISO BIIO SUIWUOD ‘apinsqe | Jed oe} 9s WeIASp dAnaid ve] 
uepuadag ‘aienbua ,p sayqeliva Soulvyso jo splod say] aus 
SUOI]L[9IIOD SAP UOTOUOJ oUN jsa sIetq a] onbsind ‘oipnos 
-91 B O[LDIJJIP ISO UONsSoNb aya_D_{JUBYOdUIT [I-]so $1990NUT 
spiod ap uonesnn.| & OP sterq a ‘nol] owerxnep uq 
(EL “L861 USE “py NesIqQRI 
‘QL6I Ysty)(enbnetaos uoruy,] 30 slug-s}e1q soy studui09 
A) squeyigey,,p SuoTT[IW QQZ apgoXe 9]e101 UONE|Ndod yy yUOp 
sked anenb say s[nojeo soul op njoxe Ivf ‘g/ 6] ua ‘ajduiaxa 
Jeg ‘juaulgiedgs s9iua xnop Sdd JOUIWIeXd,p 39 SPU], | 
anb auryd ve] Uarlq Issne oIN[oxe Ud ,p ‘aIsy,[| op onbrydeis 
-093 UONVOIJISSe[O PR] Jossedano .p spuewWOdeI of “ayenb 
-9pe dJquIds OU dD UOTN[OS ek] IU | UONNIOS ze] IU sfanbsoy 
Inod ja sAed un e nb JusuNUOD UN ke a{qu[quias snjd uNoeYyD 
‘Qpu] ,| NO BUTYD Pv] SUIWIOD sjuvas sKed sap yuajUasaidar aonb 
SOUIQIIXS SBD SO] SULP S2TORISGO SOARIS Op B SUNY Issne sins 
ow af “saoussajoid sau saXndde snod anbruyse) uonesepts 
-u0d ounone JLo xned ou af Yuepuaedsag ‘juouduUaIpHonb 
dAlasqo uO, onb g ap ja VY ap adugTeAaId P| s10[d~ap af 39 “q 
2p 19 C OP ANDAR] Ud JUSUID}IOJ JoYyOued ve souepud) sreine 
‘\UdUIAT[OUUOSIOg  {UOSIBUIQUIOD ke] Jo}UNS9Ido1 Ud 
-gjedioutid lop ang) “saanueysqns suoneigpisuod sap ins 
jusuaTedroulid Jopuoj 9s WeJASp x1oyo 9d ‘nary Jomuaid uq 
‘uoneIapuod ap SapOYIOW SASJOAIP Sd] 91JUS XIOYD 9] BUIIO 
-u0d Inb 99 ua juajsisiod suorsiogp ye suoljsenb sinaisn{g 


‘osuodal-uou P| ap 9}dwWI09 sua} Inod suon 
-0d1109 Op Sopoyiewl say jUaTNsNf tnb sajjao ap sayuaI 
-9JJIp se sed quos ou x1oyd 99 yUatNsnf Inb suostes 
say (D)HI/I no (7) "mM sptod say juenbrydde us anuayqo 
I[OIOIJIIB UOSIeUIqUIOD UN kB sagUuUOp sep spassod 
uo sjanbsay inod sXed sap jnole sajduits ne o[qviaj 
-o1d ane wWeunod «uonroynens-opnesd» ap a[aroynie 
apoyjawt ayaqg‘sAed (sto) sap no) xnep sap sprod 
3] Wesronquye uo janbne jJyejuasaides xtoyd [nes un 
stew ‘shed (sto) no) xnop Itua}U0d JUaTeLINOd sanne .q 
‘ssouuop sap apassod uo yonbat inod sed purvis 
[nas un.nb siuaju0d ou jyusTeLINod sayeNs souleyeg 
‘«SJIPJUISIIdII XIOYO» SP SUILUOD SPIBPISUOD JUATeIIS 
SoguUOp Sap TuINoJ jUO Inb sKed say] satjanbsay seide ,p 
«S$d}e.I]S-Opnasd» sap d1IN.ISUOD op JOUISeUNI WeLNOd UO 
(‘sAdAINS YEOH otYydeisowaq sop no sKaaing AqynIE4 
PHOAA SOP SBO I] SURP SUIBOIIOWIe-pns no suTeOTye 
sked say ‘ajduraxad Ieg) “10-xnao ap aystiqeqoid uo] 
-[Queyse un tu ‘sked sa] sno} Ins saguuOp ap IOAe sed 
ou stew ‘(ajQue]d ey ap no) juaUNUOD UN,p sked sinats 
-njd suep sogsteal satqereduioo saygnbus sap ek areyye 


6661 Biquiadep ‘ajeanbue,p sanbiuyoe | 


MOAB UdIG Say WesINOd UG “«LOLIa}sod v UONROTNE.NS» 
Jed uoneigpuod oun e sapgooid e yURySTSUOD (,J) 19-xNdd 
Op JOWAp ds ‘AsULYOAI Op S]USWID}Ie] op sIyoIeISIY 
OUIQUI B] DIIPIsuod UO] Iq “saTdyyNur syuswsoeydua 
S93] suIIDUOD Inb 90 Ud / UOTIOS BI & WISP IN]Id 
anb awgjqoid ouigui ne JUSANOS aNeY as uO ‘suo 
-e[ndod sinaisnjd e aulejye & UO] NO sUOTENIS Sa] SURG 
‘oua}sod & uonRolyNeIs Jed snuayqo spiod sap JasyNQ, 


“OUINS Op [sure ja ‘afoad ap splueq sap ‘Ja1IOv ,p souUO) 
Sop ‘UIIIO] OP Sore}OOY Sop slew ‘souuosied sap guuN 
Inod sed yuo ,u uonendod ap sptod say ‘uaanos ‘({ no 
‘6 NO) Q Jed aurtu19} 9s SIJJIYO J] JUOP SaguuUP Sa] $91N0} 
SJUDWIASUIIEI Sa] asI[Ra1 UO ‘aTduroxa ied ‘sajgnbua 
sap (a1ep) apoued ev] JasiIfewWOU Wop UO ‘anno u_ 
{Xnep say no ‘ayeind no suteqin uone[ndod ey] yuawenb 
-IUQ) {SO9TIRW SUID] Soy UoWONbIUN NO {souWy 
soy quowonbiun nO {salnpe say yuowonbiun no 
{souuosiad say sayno} a{[a-}-aIAnood ‘aydwioxe sed ‘uon 
-etndod ev] op onpudyd,| JOUTUIO}9p op Issne JUdIAUOD 
II ‘suosteuIquiod say no suosieiedui0d say aud. 
-U09d IND 99 Ud SJNROIJIUSIS JUSUAT[AMIUDAE S}UdUIOUS 
-I9SUdI Sop o1INpold judAnod suoneindod sao ‘sauinsa 
ong JaAnad No WUd}STXd SdIJJIYD $99 Is ‘(SUISIeI Op NO) 
Iq IP SINDJVATN[ND op No ‘sInay[NdWSe ,p [210] sIquIOU 
np J13e s yWesLINod [I ‘(UIA ap No) sajeaigo asp UONONpold 
RI Op seo a] suep ‘ofduloxa Jeg ‘WOIIJJIP WO} one 
yeunod uonendod ve] ap nuajuos gj “uepusdag “y uoN 
-endod ev] suep souuosiad ap [e10} aiquiou 9] ajUasaida1 
4 IS astidui0d usIq NOUNS Isa spoyIsUI 990 ap 
uonvoyrusis ey NC / "N= "M19 “NTC IN = “4 
‘uoq ~°“4 Uonetndod esp spiod say sesitng 

‘(sjuauraoe[ dura ‘sayanbua) sed soy 

Sno} & H/| xnese spiod op uoneorydde J anb amd x1oyo 
un aijg Jnad +» ‘aujno ua ‘saloyegTe SoMeIVIGIe s1nd\oej 
ap pusdep “uv uojnueyos.p ai[Ie) e] ap uoreLeA 
ey ‘sdura} np wednyd xy] ‘stojaynoy, ‘Cuytoy | = toy"u 
Sd uOIsIOgId eB] JUOp sprod sop JosI[NN.p ule ‘one | 
B uoneindod oun.p iualayjip 79 SQ] IS «UOT[NURYDE ,p 
SANOIJJO eT[Iey» ev] Jonbijdde issne yned uQ “wu sed 
“Wop/"u «UOT[NURYDE,pP SATOIJJO o[[Te» ve] Jooe[durss 
jnad uo ‘sioye ‘«<asepuos op uryd ap siajja»,p uostIel 
Ud JUSWI[QeISPISUOD ONJONIJ sTeIUN DoURTIvA LT NO 
suoljenyis sap @ aydoidde ana9 sipusaja nod uQ. ‘(9°9 
‘L861 USE) sanbnsiyeis ap uosteurquiod ey] anb 39 yn{d 
«S$BO OP [NUINS» a] aJOUap [J “UONeLUeA ev] op (afediouud 
no) anbiun ajursoduioo x] 3s9 yUOWgI9 Jed gouRLIeA 
ey aonb no «uonejndod suigui» e] ap jUuaWaT[aIUESSa 
jusuUaTIAOId syUaUIgTP Sa] Is Jaysnl as jnad ya uonbesy 
JUDUZTVS9 }S9 BPOYJOW 93190 Op XIOYD VJ “sJOUTISIP 
soygnbus,p no sjuswaorjdura.p ‘shed ap jueusaold 
sguuo][nueYyos seo ap [nuino edulis np juowenb 
-yeuroyne ayfnsai nb ‘!u ("a “u {= “& ‘quod ‘suoj 
-[Queyos sap “wu ayjrei ve] ap ajduroo yuRUA) Ua JaIgpuog 
‘SaTQ@pOul Sao sup 

souerluod sunone Ie.u af \uepuedag ‘sed aioduit,u 


uonetndod ve] op aj[tei ey] No steur ‘asoueyodut spurs 
snjd vy ap juos sked aud suonelea soy no sayapour 
op seo gf Suep sorysnf ang-jnod jso aq “«suas UOG» op 
suiatd syquies a][a nb sosed jyuoweyediourd onpurdgi 
ySO OJ sreur ‘apuojoid uolxayjel oun.p jeqnsal 
3] WOUWOIeI ajnop sues jsa uoNvodde uog ‘shed 
3] ousp y no ‘*f uoNe[ndod ap sptod sap xtoyd np 
MpPNOsal & SayloyJIp suoysanb say (W owWW0d) J9UINOY 
-U09 ap JouJod apoyjoW 99399 ‘ajURINOD JUOUOTeSq 
‘sked soq snoi e (W/1) xneSe sprod sap sonbyddy ‘3 


(Y661 USEY)Seplea 
JUSIOS SUOsTeIeduO0d say anb :nod ‘ainsaul ap sepoyyew 


$3] ouJaoU0D Inb 99 ud sajeuONeUn [NU suOsteled 
-W109 Sa] Inod sasijN4n sseuUOT]HUeYE,p sueyd say «JosTU 
-oulseyp ‘suoneindod op sed surquiod ou uO | Is CU, sg 


‘uoneindod ap sprod 
xne gjouuonsodoid jsa saieqg sap Inesse] eT no sonb 
-1ydeis sop juesinpoid ud souepud} 99199 op s}eI[NSaI 
S93] JoIolawue o1j9-jned yreunod uM “_ spoyIeU! FY 
V 2poyujJou BI JUDWIDAT}OaJJo NUOP JNpal [Ia ,.p dnoo a9 
yo ouUdAOW JIdUUIS SUN Ia[NOTed B BdUePUd} B 1Nd}99] 3] 
‘xnea[qei sap saguuop sa] no sonbrydeis sap sayyaniiqey 
(SaTBONJOA NO) sayRIUOZIIOY saizeq Say xNodA sap wNod 
-red |t puenb ‘tow uojasg ‘saartqnd efap quos soyeuoneu 
sonbysnejs say is sinajne say sed sgsodoid uosteu 
-IquI09 P| Jajafar nad ‘uodej 93n0} ap ‘tnb — uaXow In3} 
-eSI[IIN | ap Intao onb aiid ang sed ynod ou sinajne sap 
x1oyo a]: ‘onolal say af GuawayjauUOsIag ‘“«suatIsakeq» 
sjusuNnsIe sop no «lo}dwWId yedAvdo» Np ssa PY 
juenboaul ua ayooidde 33399 aipusjap nod uO “Nae 
-WOSUOD NY NO ANdIIesI[NN | & {INdJO9]_ NV ULOS J] JISSTe] 
Ud N{NOA JO 32 BPOYIW «dINI{[IOW» eT 3WeI9 aT[o,nb 
Joploap e& Issnai sed ang-jned yuo .u sf “7 ‘sagjafor 
JUO Sd] NO ‘SdQUUOP SI] IOUIQUIOD Op d}ISSId9U FI & 
IU SITIGIssod BI B Iu asuod JUO,U SINdINe SY] “| “SUOSIVI 
sinaisnjd inod jusumueinos snd af saidope a[s0 
Sd UONNTOS BaD ‘sa}OUTNSIP sayeuoyeu sonbysneys 
sop jusuranbiun Jatqnd :saguuop sa] Jourquios sed aN “V 


‘soyeuoneuU sonbysnejs saguuop sap JouIqUIOD 
Inod uoneigpuod ap sapoyjaw soujne XIS OUOP IDIOA, 
“«Sayeutjdo» yuauinjosqe sed 
JUOS OU Sa][9 IS DUIQUI ‘SaPOISW XNe SUOTRIOI[IWIe SOUIeLIDD 
Jowodde .p ang-ined eiyjoutiad yins nb uorssnosip ev] ‘sdure} 
-aUq ‘oo9y} RP] op UONeIOgeII,| JUO}TOSNs 39 JUapgooId 
19-Sa][a0 anb ouop ‘sapoujawW sa] 39 sanbyeid say yurod ne 
p1OQe ,P SINIOU! 9p JULINOD 3$9 [I ‘(2dUdTOS Ud 19) oNDYSNeIS 
Ud ‘WOIOINS ap falIOgY} sINaT[IowW UN saIOQeLTa WOs aonb 
aIpusne ined ou sayeuONeUN[NW SsguUOp ap SUOSTeUIqUIOD 
ap sepoylsu op julod ne ast ey ‘suIOWURaN ‘sozNe .p 
anb Isure ‘sapoyjeu $90 o1jUd IIsTOYd Inod aprjos at09u) 
gun ,p UoNeIOgPIY,| & aIpUodsaod WeJAap aseyd owiginburo 
RB] anb ‘ansapoul 93N0} Ud ‘ITUIJNOS OP IOW-Za}oULIOg 
‘OJ ‘SUOT]HURYDE Sop 
J[[Ie1 PT op ‘UoNENIS ve] ap oNIed spuvis us puodap x1oyo 


senbiudeibowep sajenbua,p uosieulquiod e| NO |NwINd 987] :YsIy OSL 


uoul 19 Y ‘g ‘Dd ‘q ‘4 ‘A Mos ‘asiaaut anbsaid d1ps0 ,| 3124 
-g1d of ‘\uaurayjouuosidg ‘satqeyoodsai sonbiymuaros sana 
-d1 sa] ed sed augur ‘assaid vy] sed sguuoNuaw JUOS OU xNeU 
-ol8U SUOT]HURYE Sap JauIquIOS Inod sanbiydde spiod sa] 
IU SOPOYISU Soy TU USANOS SAT], ‘OUTBUIaS oNbeYS JUdUUIIA 
-Ins sjuvddeiy sayduioxe sap stew ‘anbriiidwia apnjg sunone 
@ IU ‘[ad1 JUDWIDIQUIOUSp UNone vB apgd0Jd Ie ,U af “a}UvINOD 
SUIOW PB] B aJURINOD sn{d eI ap J ‘q ‘OD ‘_ ‘V 189 SoTeUONeU 
sonbnsnejis soauuop ap uosIeUIqUIOD FR] Inod uoneigpuod 
oP SA9poy sul soy Itstoyo Inod TAINS IPO] ‘[e1QUEs Ud ‘J9 
SO9STAOICUIT JUSWD}Q{AWIOS aNQ JUS[QUIS JOUIQUIOD say Inod 
SOIAINS SapoyJau sa] steur ‘(aseyd ouwlaistoN) sayeuoneu 
-1V[NW suostereduio0o ap suly xne sonduo0d swigu no (aseyd 
UIIIXNep) saistjiqeqoid suo][HUeYdE sap Ins ssapuoj ang 
-jnod yuos sked anbeys ap saguuop sa] *xne}0} 19 souUdKOU 
*XNe}] SOI]Ne Pp IIQUIOU Jd DOURSSIOIO OP XNVIPUOW XN} Sd] 
‘QUITVIIOW Op NO dz][eIeU Op sUdTIeYesns no sureoLje xne} 
So] ‘ayyeyeu ap no aseugyo ap sudadoins xnve} sa] SUIWIOD 
‘sajgnbud p sayeuONeUN[NU SUOSIeUIqUIOD op sj}eI[NSOI 
soy efep atjqnd 1a Wnpoid uE ‘sayeuoNeUNTNuI saygnbus sap 
JQUIQUIOD ap dNA Ud asepUOS ap suP]d ap dsalaqI[ap UONeaIO 
ey asodoid of ‘aseyd swiainenb ap asins ua ‘ny .pinofny 
(6661 OT 
}9 BSULIDOP{) jJUPATA UOUL ap sajst{Iqeqoid saygnbus say sed 
H9ANOD IIOA sed ou steusieso af anb surewop ‘Asojonuapidq 
omyetyohsg JO SAAING [PUONUIOIUT Sop a)U9091 UOT} 
-daou0d vy] Jed sguuorssaiduit Jo sasevinoous sins of “apueU 
-Op BP] & XNoIwW us xno ap sipuodal ap yuayauted sanb 
-[UY99} 19 SOIQIOULUTJ S9DINOSSAI So] ed ‘INOf a] TOA B JUDO 
-USUIWOD gJeuONeUT[NU ajJanbua_.p suejd sanne.q ‘(P661) 
UST ILOA {(6661 ‘T66] PWIA) QUUsEdOINS syneUNWIWIOD 
Rl Op aaNoe uoTe[ndod ey ins saygnbus s2y 19 (1661 SHA) 
S861 Ua gINQGgp juO INb sKaaIng yyeaH pure o1ydeisowiaq 
Saf “(L861 NODS 19 purleID ‘p86l SAM) T86I ® TL6I OP 
SAOAING AI[IAJ POM S2T “(ZL6I FIVZS) S96 ep SAoamng 
IS) SUT], SO] 99Av ‘CQG] US,nb sInNgGEp v,U SofeUOTFeUNTNUI 
sojgnbus,p saiaquap uondeouos ev] ap aseyd ouidisio1 
eT ‘sopeuoneuN[nw suosteredwioo xne yudWopides gua }UO 
safeuorjeu sajgnbus sao “uawiaddojaagp op oseyd owarxnep 
BL UeNIWsUOD “saguuR SdIQIUJap ajUeNbuIO say yUeINp anb 
$]U9UNUOD burd sa] INS sojUeINOD SaNUdAaP JUOS dU SJONUS 
sked sap juvsAnod ajsiiqeqoid uolMueyoe oaae asepuOS 
Jed saygnbus so] “uepuedag ‘27a ‘saygnbuood sa] ‘saiiens 
Sd] ‘SOSVAOA SI] DULUOD ‘UOTJBAIOSQO ,P SASIOAIP SOULIO} SOP 
INS SOQPUOJ JUD Ge|qUIdSTIeIA JUSTIA 39 SAUD} BJ] SULP UO] 
OINOP SUBS JUDJUOWA saTeUONeUT[NU SUOSIeIedWOD SaT 


‘ojo 
juosgid np sped og] JUDWA\sasTURUL assedep Jo SOWIN[OA 
sinoisn{d Ins dipuays,s wernod yalns a0 ap uorssnd 
-SIP BT “SoTRdO] UTD} a] Ins sUOeIadO Sap ja adepuOos 
OP SOSEq SAP ‘SAINOSSII SAP JURAIAS AS Ud SJOUN|SIP adeU 
-uo[[NUeYoE .p suevjd sap sanbiydde yo MOADNUOD JOP UO 
‘sorgttnored soyeuoneu suonIpuod sap v aipuodai nog ‘s 


“Q0uRISAgsSIOd PR] ap 19 salgtpNosed saouessieuuod 
Sop ‘g]Inugsul.| op wornbai inb ‘ajueseiog ayoR) oun 


6vl 


1Sa ‘asATeUR | 9p 19 SApOd sap onb Isule ‘sasreuUoNsanb 
sap 3a sjdaou0d sap syeuoneunfjnu uononpen ey] “py 


‘saeuoreUnNu saygnbus sa] yUaAnojd 3] SWIUUOD ‘a{qIS 
-sodumt sed 3sd,U dyov} P| SIVUL ‘SLIOJJo SOUOUS ,_p NUOP 
apuLlUap sorqeiedu10d s}ePI[Nsal Sap MUIIQO ‘Ja ‘saTeIo 
-os ‘sanbrpunf ‘sajfjauuonvonpe ‘sanbruouosg ‘sasnars 
-I]A1 ‘SaTJoIny[No saoualasjIp op asneo e ‘anne | e sXed 
un,p dnoonvag stojred juatea ajygnbua ,p sajqeliea SOT *¢ 


‘jauuOsiod ud UOTIeIOp FI ap 10 
juIod ne asi Ina] ap sasreyo jUOS ja Sarlessao9gu sanb 
-IUY99] SIDINOSSAI SIT JUDUUDIEP ‘SILVA OJ 9NQ JUDA 
-nad xne100$ sual] Say Jo SaT[oUUONRSIUeSIO SoINjONI}s 
say anb tsure ‘anbruysea) yuawraddojanap ap sat03saye9 
19 XNBIAIU Say JOP ‘s]JOUNSIP xneUuONeU xNeoING soq °Z 


“Spuo} Sop JdA01}00 ,p Jasnjol JUaTeIINOd saouRUly 
SOP dIQISIUILU BJ NO JUSWII[Ieg sd] SIeWI ‘sazoos sap 
saidne ajgnbua oun e sadionsed yreunod uoneonp_,| 
ap alaisturul 9] ‘ojduiexa sed ‘s}ouNsIp sowstueSi0 sap 
@ JaquIOOUI JUdTeLINOd SadINOSSaI Sop UONLIDITJe | 19 
sonbuijod sap uoneiogrys,| ‘shed anbeyo suep ‘anno uq 
“Spuo] Sap 101300 | aonb sanbirytjod sap synoafqo sap uon 
-IUIJap B] dUJO0UOD Inb 99 Ud jUR} ‘s}OUNSIP xneuOTyeU 
XNvIING SAP SULP SI[GeI9 JUOS SUOISIONP ap saMUII SIT “| 


“O4SI] PT IOIOA UA 
‘TeuOneUNNUW sseuo][HUeYE,p sueyd ap uoNdaouOd BY] USUI 
-3]qQvepiIsuod usnbrjduros nb xneyuswepuo] saoejsqo buro 
IP IsNVd & ‘SJUDIIJJIP OJ JUOS SadId19Xa Xnap sa] anb 3105 
-lodes uo ‘anbyeid ua “uepuadag ‘snuuos uarq saydnynur 
SOUIeLUOp & aseUUO][HULYDE ,p SuLtd sap sain sonbuoydeiou 
sjusuinsie sop sogsodoid sayeuorjeunnw suOsIeUuIquIoS 
xne Jonbiydde 39 sapnyipuns sao ap med Joi) SUOp SUOLIADp 
SNON ‘sofqeredui0d sao1dJoxd sap jUOS JUOUTUOS UN.p 
sked sat no sked un,p saoutaoid say aurquios ‘anbio0sy} 
ona op qulod nq ‘saydyynur sourewiop e aseuuo][NueYod ,p 
sued sap seo 9] SUBP JUSUIWIRINOD Ja}UOWWINS Op UO] 
aonb saj[ao & say[NOIJIP S90 Jaredu109 ap JURSSdIOJUI 4Sd [] 
‘gjomie juasaid 9] Jed sagsia 
Q[VUOTLUN[NW UOISUSLUIP B SUOSTRUTQUIOD Sap sed oJ SUP 
Issne juasod as suostereduiod sap seo a] suep JoJUOWINS 
ney [I,nb saqynoyjip say “sopoujyauw say aonb — sayjeinjypno 
}9 SOTJOUUOTININSUL ‘sargrouRUIJ — SIdINOSSdI Sd] JUL] JULYD 
-nO} sawgfqoid xnesanou op siquiou asod sayeuoneun[nu 
suosieiedwio0s sap jureyouised oseuuoy[nueyse .p sued op 
SopuewWiep sop uoNvoldninu eT “(h661 YSEM “p861 (SAM) 
SKaaIng AIt[N12J POM ‘7L6I lIPZS) C961 Ue,nb g10qeI9 
919 JuvAR .U JoTUAId 9] ‘a}UdD9I ISO SapITeA SuOsTeIedu0d sap 
amjouted ap sarqudeosns ajygnbus .p xneuoneunjnw sueyd 
ap sosaqijap uoNdaou0d ev] ‘uRLNOg ‘aJgnbus,p saguuOp 
op soyeuOHReUN[NW suosteiedui0d xne JUSWIT[OINJeU QU B 
uonesedoid ing ‘sing ‘OV ®] 10 onbuysne}s ey op neaing 9] 
qUdUaJaT[NoWIed ‘solu, SUOTRN sop sonbysie}s sowistues10 
so] Jed sgXndde ja saseinoous 919 JUO sInauUOT]WURYDE 


Sop SUOJJo soy ‘sindaq “(C661 YSM) Sp6I ep ned ve .nb 
a[[eYyoe opuvis e sajdope 9j9 JU ,U ‘aoURISIS91 op dnooneaq 


666] eiquisoep ‘ejenbua,p senbiuyoos | 


sqide ‘Ja C68] ua.nb (c6g{) Jeery sed sinponut gI9 
quo ,U UONL[Ndod eI ap «syneiUasaidai suOT]HURYDE So] 


TIVNOILVNILDTOW 
HOVNNOTILINVHOUd SNWTd  “€ 


‘JURUDIUTCUL SILIO9p siva of aonb sareuoneu 
-Q[nw sonbnsyeys ap uononpoid ey e UONONpoNUI suU0G 
oun ajuasgidel apaogid inb 99 ‘soyeuoneu sonbnsneis 
Sa] Inod ostej 9] ap jueINOd ysa JI auMUOD ‘A “yy = “4K 
g[eqo[s anbnsneis e] Itua}qo inod “v{/ “nN = “M uonetndod 
R] Op UONeIgpUOd ap sUdIOIJJ909 sa] (SouTeUIOP) sadUTAOId 
sap “€ anbusneis ey @ onbidde uo] anb tor asoddns uo 
‘(8861 USEY) 8 UONDAS BI TOA ‘saadnodaI sa1I039Iv9 Sa] Inod 
anb sure ‘ajduio9 uojnueyss,| inod soueea ayoyj snid 
oUN Npold spo aU 99399 ‘XI 3S9 UW [e}0} UOT[HURYDE,| Op 
O[[Ie1 VT Is ‘ste “SaoUTAOId sap I[Ie} eT & saTjauUOMIOdod 
yuowiasioaut quos inb “ay/“u a8euuo[[NUeYos,p suONoRy 
sop unpoid swojiun uonedsl ayag ‘a[le} Indy op yUSW 
-wiepuadaput ‘saoutaoid say sajno} Inod uorsto9id ouIgUU P| 
Quowaaneurxoidde) 11u9}go .p ule ‘FY saoutaold say sayno} 
Inod Y/u ="uU a][le} SWIQUI ap SUOT[HURYDE Sap 911} UO ‘STOJ 
-Ieg ‘sajueyodur juswasgtpnomied no sayned snjd saoutaoid 
xne 9agj9 snd xne} un eranbiydde uo ‘ayduroxe sed ‘ayqeiea 
BSVUUO][NULYOS,p XNv} S9Av OSepUOS ap UP] UN Ja\dope ._p 
yuvinod snjd jsa [I ‘stojaynoy, “aoutaoid ey UOlas JOLeA 
yweunod osseuuol[nueyse .p aspoyjow ey] ‘afduioxa ieg 
“SaduIAOId sapueis op nod 
JIOAgNU0d jnad uO] anb ‘sjouNsIp suo[[HUeYdE sop inod 
SOLS SI[OUOS IP OUdISIXA | SIIP-B-}S9 9 “DUIVIX9 oI | & 
Jassed ynad uo ‘sajouo0d ap douasqe | ap sUIgX9 UONENIIS 
RL 9q ‘“Wous}sod v Issne srew ‘WoL eB yUsWa[Nes UOU UTD 
-IJ1Ve)S | INod sadinossal ap Jd soguUOP ap suONbuewW snou 
‘\ueyinod ‘a aygnbua.p saaguuop sop asAyeur | Inod saque} 
-Ioduit saaneoydxa sayqeiieva sap siojied juajuasaidal sol 
-039}€9 S9D “SINS ap IsuIe jo ‘sapnNy ye ,p 39 sJUdWIaWOdUWIOS 
OP SII0OS9}C9 Sa] ‘ayIB[OOS ap XNvdAIU ap jo sUOISsasfoid 
OP SoIOSg}eO Soy] SUOUUONUDSUI ‘o[dWI9x9,p 9111] WY ‘“asepuos 
op uryd un quowiazaqiap 1910qr19,p a1qISsod sed yso,u [I $9] 
-janbsa| snod uo[[HuUeYyse | 9p SUOISIAIPQNs sap dIIp-e-1S9,9 
ajygnbua .p saguuop sap asdjeur | Jed saasiA Sal1039}e9-SNos 
Sap sajuvinod snyd say SOUL} Sa] JUDWAT[aNIIGeY JUOS ‘saT]a 
e juenb ‘saadnosal saliosayeo say ‘uoleindod xy] ap 3q 
-WdsUud | JUaSOdW0D Inb saureWOp ap Ja[dwiod UOT|HULYSE | 
op uonriussgidai ev] pudjud uO ‘SalIO39}vVO-snos Ieg 
“suonendod-snos ap uosieuiq 
-WOd 9uN sWIWOS UOTNR[Ndod ap UOT[HURYSE 3NO} WoOSed UO 
‘suds 99 UY “JUSWILaplj JoyUasaidai say inod saystjiqeqoid 
SUO][NURYDE SpueIS op salatidoid soy ins JaAnddv_s Wop uO, | 
}9 ‘SI|QRIIA JO] JUDANOS Jd SIDAIP SOUIPULOP ap sonbresou 
Sap UOS (SazNe NO) sayeuOeU SUONR[Ndod ap suOT[NURYdE 
S3[ ‘OUOG, “SUSIOAIP OpuLIS Ind] ap Jo aJgnbua.p sajqviea 
$d] DOAV (SUONLIIIIOD) SUONLIAI SIN] op asnvo B ddURIIOd 
-UUI,] IP JUDANOS JUO «SagdnodaI Sd110391vd» SID *I/a ‘UOT 
-VONPI,| ‘B]VINOS assK]d LP] ‘UOISSaJOId BT] NO ‘a5",[ 19 OXIS 9] 
SWILUOD ‘«sSaadnodal $a11039g}v9» suojadde snou onb aiues np 


‘sjqad 39 xnoiquiou No spuvis 19 xnaIquiou nod ‘sourewop 
xne sed juowayeigues juonbiyjdde s ou saiaqi[ap adepuos ap 
sued say ‘saoutaoid sap seo a] suep sanbneid juos sjI,s§ 
‘(196] MOYORY 19 AOLSAo'T ‘ysry) soisap sinatsnjd 
B sajuesodui09 op onbiidura asAyeur | red saguiyuos juos 
‘gsodoid suonrindod ap sjapow! neaanou 9] ddA JUdPIOS 
-u0d Inb ‘suonRAsasgo sag “ayjoyse aed snjd ev juswales9 
aysisiod suoneindod sap (g[nuevss ‘a110jyeg]e-uOU) dinjonI}s 
sigqoeivs gf aonb ajquies [J ‘“suonendod sayned snjd op 
JULIANOD SUOT[HULYSE xne Issne sie ‘afeuONeU ajgnbus ,p 
suvjd xne juowanes uou juanbijdde.s sourewop sjnod 
J SpURIS d1QUD SUOTIOUNSIP $dd ‘Jsa snjd INQ ‘saloOsa}e9 
xnap So] Jaqo[sua Inod «jeuoneuRlUl» JHoalpe | ap ILAJOs 
aS Op INN Iso [1 19 UONPUINSS,| e.nb osepuos op urd ne 
1Ue} Je) & INb 90 US sajuROdUII JUOS SaUTeUNOP sjjed say 39 
Spuvis so] aNUe sooUaIaIJIP SIT “(1LZ-L9Z “dd ‘L861 YsuIS 
12 [PpulRS “OVY “Yoel :€°7 ‘L861 YSty) «uoisar ned sed 
UOJLUINSS» Pp S9pOyIoU sap 1d-xnao nod julod ne su ouOp 
eR UO ‘aI[Ie] aed op sourewop sap yednyd vy] Inod aseu 
-uo]]HUeYd9,p urd un JUDUIOIAQI[ap Jo10QRI9,p a[qIssod sed 
}S9,U [I ‘(SIUP)-SIRI SOP SPIWIOD YOO € SP] SUID) xnaIquIOU 
snjd 32 sad snjd sourewiop sap nod ‘stoyaynoy, ‘sanbidAy 
JUSUID[VS9 JUOS SOULLLUOP SPULIS Ud SOIIe[ILUIS SUOISIAIPGns 
sop ‘(27a ‘sastidamud ‘syusWassi[qeis ‘saT[IA) suoneindod 
sayned snjd ap JUdJANOD suOT[MURYSE sot Ig ‘sXed sap ed 
-njd e] suep Qz & buto ap atea aiquuiou 9] JUOp ‘saouTAOId So] 
UID ‘SOUILULOP SAP SUISIOAIP LP] op a}du09 I1u9} JUdANad 
gyeuoneu ajgnbua,p suejd sayz ‘sanbipomednyjnu no sayeu 
-oneunjnu sanbysyeys soy swU09 ‘1d Japied xnaa af juOp 
SOIDI[IWILJ SULOLU SUOSIRUIQUIOD sa] nod sanbnstineay sayd 
-WW9X9 ,p IIAIJOS JUdANA sara ‘sarat]IWeJ 19 Sopduuts }UOS sUOS 
-IVUIQUIOD S30 SWIIOD, “SOUILUOP dP ‘SASIOAIP ZSSe UDA 
-NOS ‘SUOSIBUIQUIOD Sap INS JUSWIITJaNIIGeY spuoj as sanby 
-SIR}S SAP [NITed J] ‘xNeUOTIVU SUOT[HULYIE ,p Sed a] SURG 


SATdIL TAN SANIVINOG 
VY FOVNNOTILINVHOUG SNVId °C 


‘SIULJOP ISEPUOS dp dseq UN INS 9pUuoj a]qQeIS 
atuly uonejndod aun.p sseuuol[nueyss .p add} sjapour 3] 
Jaov[dwias nod nesanou Jusw[eorpel s[agpow un Jasodoid e 
suany of ‘uodey 91n0] aq ‘“awsIpeied ap no ajapour ap aed 
uo,| anb ano yuawayqeqoid jUuO,U SUdTONsNeys sonsa[[oo 
saul ‘sa snyjd in?) ‘axediad sasste] juo wu saydosoytyd sanb 
-[anb ddav SUOISSNOSIP Sap ‘piesa 199 Y “auISIpeied op USUI 
-Suvyd UN SUTWOD NO aJEpoul NedANoU UN sUTLOD sINats 
-njd e uonejndod oun .p suojjuueyse sap sayiod ev] ap uors 
-U9}X9 | JOSPSIAUD XNOTU yNeA [Is sntd uoU sed sites ou af 
‘Tol 
9st 1Sa Inb ‘suonefndod ap yuawadnoisa1 at anb sao1ssaxa 
sane .p v Janbijdde,s ynad «uosieurquiod» dud} 3] ‘d1]N0 
UW 3991109 JusWTIeJIJed squids ou aN | 1U UN] Tu sTeUl 
‘jarodwia) Ja [eneds saip10 ,P S[NUIND (NO)}a SUOSIVUTQUIOD S| 
SIO} PT B JANOS Anod onbrun suwi9} uN Jasi[nN ,p aqeiayoid 
WeIIs |] ‘J@[dwioo yUswWa]JaAnoud 9aAv NO sanbipowad suoy 
-[Queyoe say Inod anbipur snjd aquias «[NuNd» dWLIA} a] onb 


sonbiydesbowsap sejanbua,p uosieulqwiod e| No jNnwWNd 87 :Ysly Srl 


spur} ‘saydyjnu saurewiop sap ya saydyynu suonejndod sap 
SBO NE NOUNS IUIAUOD J[QUIAS «UOSTRUIQUIOD» “UOISNJUOd & 
ang-jned ayod inb uodeyj ap ‘USUIWOIOJJIPUI «UOSTRUTQUIOO» 
19 «[NWINS» souta} say asin f anb evsoyeysuod 19199] IT 
‘JaTduI09 JUSUIDTJOANOUaI 
dav no sonbipowed suojjnueyss ,p [NWUINS J Ins 39 xneU 
-ONVUN[NU SUOT[MURYSE ,P UOSIBUIQUIOD BT ANS 1e1aUIDUOD 
aul af ‘ajone juasaid a] sueq “JeTAu10d JUSUSTJOANOUAI DOAB 
aseUuUO][ Huey, p ja [PUONeUN[NW sseuUOT[NUeYIE ,_p suryd 
Sa] Inod ye1a}uI UO ap JUsUSTIOUI) sat[qnd efap sajonie 
sInaisn[g ‘sJatyusnf say sues ‘sagstaosduit sapoyjaw sap 
anb anbiydde .u uo ‘saguiquios juos suonendod say ts surg 
‘nO ‘suoneindod sao sautquios inod adj apouyaw sunone 
Janbijdde yned du uo nb no yeuuos ou uo nb sored ‘sanb 
-Iun suoneindod sap & uoy[MURYoS,p SUONPUINSA Sd] OPW] 
ouOp Ine [I,Nb a [NWINd ne NO UOSIeUIQqUIOD BI B a[RISGO 
un Jugjuasaidas suonendod say ajuda suoneLeA say anb yUdA 
-NOS SULIJJe UO ‘sed oINe | J9 UN. | SUR, “(¢ “p ‘E SUOT}DaS) 
DI[NPSIOUI Pp 39 NOP ap suOoMoeaI sop JUdANOS ayIOSNS 
‘yedap ne ‘39 J]JIANOU }Sd S[NUINS Sap NO SUOSIVUIGWIOD sap 
Jasi[vad Inod IMAJas Ud,s Op saplJ ‘WWoWdANdedsai ‘sayey 
-eds ja sajjaiodura) suostereduioo sap aiej snod juawayed 
-19uLid sagsi[an 3a sanduod 919 JUO sayfa ‘Isa snjd Ind ‘soury 
-Ioduil | op sipuaid ap xnap $ajno} JWAassad dU 19 JUDUTLUGO 
-91 Zasse nb julod ne sasiwi 939 U0 ,U SaxaTdu109 sajygnbua ,p 
SdIOS9}v9 xNap sag ‘ajyueyoduut snjd a10dua ysd sadINoOs 
-Sol op opueulop Pe] ‘sayeuoTyeUTy[NUL saygnbua sap seo 9] 
SUR] ‘SOPOYISU SA]JOANOU ap Jo sayUPLIOdUII SddINOSSal Sap 
jua}Issad9u Sonbipoied sajygnbua sap suoneisdo sap a1Ana 
Ud SSIUI P| 19 OSvUUOT[NULYSE,p uLld Np UONeIOgRII TJ 
“Sa]]a1odua} suoIsudIp 
SOP UO[IS SUOSIRUIQUIOD Sap dIIP-B-1S9,9 ‘(¢ 19 f SUOTIDAS) 


‘QOI8P IW ‘Jogry uu ‘uLsIYyoI JO AlsIOATUA) “YST “YSEY NSIT, 


«JQ[CWI0d JUDWIT[AANOUdI SdAR SUOT[WURYDE» sop IN[Io 
juej9 onbystajovses snjd a] ajdwiexa,| ‘sonbrpowed suo][y 
-UvY99 Pp SUOSTeUIQUIOD xne puodsa10d sWaTxnap eT ‘sked 
SIDAIP SULP SdaST[va1 SoJgnbua sap yUoUTATeNeds I9UIQUIOS 
B asta Inb “(¢ uoNoas) SAaaIng AINA] POM Sap Injso 
jueja anbysiugjoevies snjd 3] ‘Sg6| Ua ANOf J] IIOA B QOUDU 
-u09 yuo Inb aygnbus.p xneuoneunfnu suejd xneoAnou 
SOP I[90 1S9 dIQMWIDId VT ‘SdIOUTISIP SUOISUDLUIP Op psesII 
Ud SALIVA S}PI[NSII SAP I1Ud}qQO ,p Ja SAQUUOP xne s]USWUIITe] 
siaatp Janbijdde ,p yuayjoutsed nb aygnbuap suojjnueYyse ,p 
soliosayeo xnop ploge.p Ieilioep of srew ‘ajapoul neda 
-nou un e dovis suoneindod sinoisnid e sayqissod suorsuay 
-X9,p so[duiaxo sureyiso ulo] snyd rerouUOp of ‘“OTUTy UONR] 
-ndod gjnas oun eB oyu] as [I,nb adored aquasgaid [1 ,nb souno 
-P] Sd] Ins JuoWaNbtIuN IeJasjUINUOD ou af ‘afore JUasoId 9] 
suep ‘adA} a[QpoOul Np SUOISSILUO Sd] $9jN0O} ap Ja]Ied op nat] 
ne ‘sIojamnoy, “(R86 YSry) SuOIsusWIp sInoisnid ap pies 
-d1 Ud «Sa]UaTeAA]Od» JUOS asepuOs Jed saygnbus sa] “uanbes 
-uoo Jed ‘sanbusneis ap sadA} sidarp Ins Uapuoj as a3gnb 
-Ud,P S}PI[NSOI SI] ‘JUDWIOWIIIXNAp 39 SayqeuieA sasnaiquioU 
ap ins yuoyiod saygnbus sap yednyid ey] ‘uowdienueig ‘aygnb 
-Ud,P IseUUO][NULYE,| Op S[aar syndefgo say tu sonbnesd 
Sd] TU JLOSP JU [I Jed ‘INddWION 1sd QOUOUY ,P DUIS 9d ‘STOJ 
-9INO], «’sJUsWIZ{9 AY op UONLINdod oun suep ‘4 a[QeueA oun 
Inod (Xx ouuakour ke] ap no) X [e10} NP UONeWINSd oUN olINp 
-o1d ap 1s9 aygnbua ,p suo[[NURYoE Sap ING a» :1999 SUIUIOD 
soid nad e aseuUO][NUPYOd | INS Sa}Te1] S9T SNO} sUBpP INSTT 
inb adAj syapour np uondiosap vy] Josesydesed ynod uO 


SATdILTAWN 
SNOILVTNdOd V SHTAGOW 
*NOILONGOUINI ‘T 


“SQOUdTIOdXd .P UOSTRUIQUIOD {JaTdWIOD JUDUTAT[IANOUSI DdAP SUOT[NHUeYSE ‘sanbipotied 
sajonbud ‘saydyjnu sourewop e aseuuo][nueyos .p uejd ‘saydnjnu suonejndod e sdeuuo[[nueyos.p ue[g ‘SATO SLOW 


‘ajgnbua ,p syuawioov|dura sinaisnid ap uOSIeVUIqUuIOoD PR] 39 SADUATIDdx9 .p 
UOSIVUIQUIOD FB] ‘Ja[dWIOD JUDWIDT[OANOUSI S9AP SUOT[NULYIE Say ‘sardn[Nu soureWOp kB ddeUUO][NULYOE ,p sue[d so] JUOp 
“SQUILURXO JUDLUITLS9 JUOS SAI] JUSWID}IOI}S IDVUUOT[NULYIE,P SULT SUIEYAD, “DOUdIJOI AP dIPLd 99 IT[Qe}a,P }SO IOI JNDALQo J 
“QIOOIPSW UOSe] 9p JUdANOS ‘anbIsoOj;OpoyJeW No anbioOgy) sdUdIVJO1 ap o1peod sues ated apuess ud sogst[ed1 919 1UO 
ajgnbusa ,p suosieurquios say] ‘juasgid ev nbsnf yuepusdag ‘uonesNesoUOd Ingy e JUDUAUI ‘j1e] Ud ‘Ja saTqeyeYNos Ja sayqissod 
ajgnbua .p sonbysyeis sdguuOp ap SUOSILUIQUIOD Sa] }JUaPUaI sUOSTeIedUIOD sa] aIIe] INOd soIessad9U UONeSTUOULIeY .p 
}9 UONLUIPIOOD Ip soja say ‘JueNOg ‘sajgnbua oud suosteredwioo say Ins juoweyedioutd god juo asepuos 
op surjd sop juswaddojaagsp op xneard) soy ‘seo auyne | 39 UN] sueq ‘saygnbua,p sor10Saieo Xnap s99d ap INajeA apueIs 
e[ NUUODEI B UO, | Nb dINsoW kB ‘SoTUUDSEpP SOIQIUJOP Sd aNb sagstuesIO 919 1U0_,U Sarlessadgu ‘sanbruyse} onb sargioueuly 
jue) ‘sojuROdUIT saoInossal say ‘sajueyoduut 3a sajueinoo snyjd ua snid ap saitAnoe sap juos sanbrpowed saygnbus,p 
no suonendod sinatsnjd op sgidne sajgnbua ,p suonesado sap dJANa0 Ud SST P| 19 DSeUUOT]NULYOY .p uLTd Np UONeIOgeIP TJ 


AWNSAay 


HHSTM ALTSA'T 


sanbrydeisowsp sajgnbud,p UOSsIeUIqUIOD BT NO [NUIND aT 


Lvl 


epeueg enbijsiels 
8Sl-Zpy} ‘dd ‘gz ,u ‘sz OA 
666} aiquieosp ‘ajanbua.p sanbiuyos | 


a Mikes nd aye 
whe} 6 ; ae 64 “a 
7 en us ery. wy 
2n0§.1 7 Mee vewwseay; 
ag pee y, we > a 
- lyre WTR @ er MIN AG 27 
~ phases tae foes rat 
he Lg te woe uy sy 

Cer pestis 
beg aesiaw nt fabge eHive © 
ee a, a 
Ppa eape oy VO gem ins 

peta DY 18S Ei) F< - : 
, Vm, @ G* oma ay 


1 


qi Sweetie ei ahr £4 ' 
pe psidant a ee , ¢ 
a iHal pe j 
Porgy er VER 
a4 row é i 


d Mae My UN Oe 
yeas f ANT! & 
- Gees gees Gr Py <i? Os we, 


- mad 7 age be ro CMM ATE . mire : 
a eas c>ey ry . ee wren 
; Os Mis 4G?) Jo) 0) « 7 
* ‘Bees Ted ‘Se “ers GC ru . ‘ 


cue 4 Papa opeay cha 

Sirs 3 bint ee OP 8 beg 

ay . i f it TA niles nea edb yo" 
¥ 


A, - Lr 
yx 
ee Le i 
q << y of 
i=) 7. 


c es ast w 


a be ome 


fis) os aL red File he Oe) {i 
7 ‘ 7 va UT (ee ae : 
«ad d | Th } . 2 7 : 

re nihil ay lt 

Aid eal De yt) Ay er} Ati Grete 

rad Pe Eo at 

\ alg riagtoke i pale A? 

ai & ome! ty pia. ( 

Pe = Ad i i, ium, 

ante at = ,o oY iin rare 

ate ith bed Lue me s 

Mages bes Feats els 

soe i ie rite 


a ot = a Gay eyry 


potent a 


= “a Soy et Sees seer 


waa pnge ives 
he aE oe @ <Onay 
wey es ee ee 
we Bue’! my aes 
ih on wrod bale ela ee a 
pay eat, ae ae ty Rea! 
oes ay "sree @ We1DES 16 
woe noe NE TE Op B10 ete Le 
ohm La 
eet ol Weer ees Fee a Se 
are & eS thhiceet Wa fF et) Oe Cig “Puan o. poe 
areiee 2 te Weeyy : yy Hae | FR Reesor 


HPN) 19 BES WA, TH Uh QEUED OD AA 
sSIR.2y) wT Cur « le) Uy) Ge Seats oF 
sew weve A bh i ee, ee 
— dno gi] hy 29 @ BGA Ye ee i rTve 
7 to | Ves (¢ & arte ben itieily ‘aes 
ee 4%. 4 FS PS 5 2 
\ T RAYOoe r Heer? é ivy) a 
VT 2.9 > 
1) ort) GR ¥ » Vi ia ALaae 
¢ Vu = / 5 ' 
were “4k, 164) © ® j 
: f ‘ 
bide és 
1 j 7 
b aad X 
j 
’ n 1am (et *AvRK . 7 
* yioyrryy ; Pie HINT ai: 4 af (aos 
eal SWS Wile Cory fide a 
“Shy RS e eae eT a 
ar r ‘ a7} - 
et oe wri 7 iy 4) 
¢ 4 - 45 ‘4 
{ 
i 
ehie ‘ . 
Uv 4 au ' 
$4 
7) 
IAL 
‘ & 
ai 
: 
pis Lis; i 
cTLs w 3 | 
4) 
hl i ° ted 
} a 
oD ' 


‘giquioidas 97 np puoj ap ajoniy 
“SOTMOUIOGAD 01 BPINS s JOxIYYOUY PY (9661) LSINONOOA AHL 
‘yoqpint [7 ‘aurayut yuound0q ‘epeued onbnsneis e sourewiny 
sadinossai sap juautaddojaasd (L661) VAVWNVO ANOLLSILVLS 
‘urnf ‘epeued np onbusneis 919190s ey op uoTUNaI 
Re] & gjuasgid satded ‘epeueg anbusneig ‘suit pue sjayieyy 
IMOgLT JO asV_ ay] :Adt[Og ITQng pue sonsneig (1661) ‘D ‘LOOId 
"21q0}00/a1quiajdas 
‘OTTESIOATUUR SWQI-C/ NP O1QWINN “(1661) SYIVASV NOIAUCA 
‘[nquejs] ‘anbusuyis 
ap [DUOIIDUAAIUT ININSU] ‘UOISSAS aulal] ¢ Dj ap ullajjNg ‘SOsueRIS 
[BI90s Jo suiaysAs spremoL, (L661) W ‘NOSATOM }° “dl ‘IOATISA 
"86I-SOL ‘7 ‘b9 ‘anbusuvis ap jouoyDUsajuy anaay “UWd}SAS 
Teonsnejs sAtjoajja ue Jo sonsiajersweyD (9661) ‘d'l IOATISA 
“YOTAONNA 1d ‘eLIaNSeeyy ‘JOploH 
Jed 911pe ‘suvtionsneig uvadoing Jo aoualayuod oy) Jo uolssas 
Aleus|d YiOp ay) JOJ uoNKolgng Aresioatuuy “Canjuag yIQz ays fo 
Pug ay 1D Ssad0Lg IUYAIOWAG aYi Ul SISUDIS SUG ‘QDUdLIOdxa 
ueipeurD ey] — Sumas Ajwoud pue suruueld (7661) ‘dl IOATISA 
‘OO0E-S6T “AO” ‘Suouppyy paiuy ay fo jpusnor 
JVIUSUDIS “epeurD SoNsHeig 1 SUN (G1661) ‘d'I IOATTAA 
‘TTI SW SOUas ‘K1a190¢ JDINS1IDI¢ JOXOY ayl fo JOUINOL *SONSNeAS 
[eloyJoO UL sduapyuos otqnd Sururequrep (&1661) ‘d’I ‘IOATISA 


AIH d VUOOITELa 


Svl 


“a]jouuolssayjoid 
ya anbiuijod souvpusdepul anou Jad10JUa 39 JaAsasoid inod 
dilessadau Isa Inb 9d yno} aIeJ B ‘AIPULOW 3] UOU ste JUIOd 
Jalusap ‘Ja aourudsauod aidoid anou e,nb y9Qin]d ‘sulosaq 
sina] e aatidoidde uodey oun,p ‘sjuewodut sadnois sa] 
SNO} SIP-B-1S9 ,d ‘9JSINOS SOU IIAIAS UdIG & ‘(«UONUSAIOIUL,P 
SIDIAI]» SOP BJO oj Studuod A ‘sawatqoid say Ins sawn] Py 
AMe] op JURSIOJJO SNOU Ud ‘doURTI[IOAINS ap JOUUONIPL. IOI 
a0U ap ape a] Jassedap ap JaAvssa ‘suUONRIAPISUOD SamNe 
aud ‘Ip JUSWaTNV) sjUsUTIEd JaINAWIAp op Ulye dAINsInod 
SUOAAP snou dnb sanudaar sasIaAIp xne ayJold apuris 
Sai] DUN JapIOSOR & ‘JUSWIDUUOIIAUS UOS Jed sta XNeUSIS So] 
Jan 19 Jaydvo inod sinajdaoal squay[aoxa ,p nvaing 3] JaI0p 
B JUISIA JUIOIXA JIdIeIIS LP] Op Spatuassa s}oadse sa] 

“SQQUUOP ap Saula}sAS XNVIANOU ap & Id"IB 
ayins ey sed auuonosayiad ya ayjoia uo,] anb ‘sjamdaouos 
SaIped suleyiad Jaloqeja Jed yuowanbidAy jurdsuawiwo0s 
Ud ‘SATILION UOSe] ap ‘azaT]ered ua saapiloge d1j9 JUDAIOP 
sowigqoid ap sow40j xnap sao anb suannos af ja ‘saguuop 
Sa] 1a s}daouod say yuasod anb saynoyjip sap saipnosal 
B JUaSIA SuONRIdepe sao ap Uednid vey ‘ayeyuaWIOUIaANOS 
anbuiyod ey ausaouos inb a9 ua sjuaunied uawaratpnoned 


666| aiquadep ‘ajanbuae,p senbiuyoe | 


SOUIRUIOp SInaIsni{d suep soitessao9gu elap jUOS ‘IOU UOTAS 
‘Inb suonejdepe sopuvis so] suoep Ie.¢ JUaWIOUUOIIAUS 
UOS B Jajdepe s ap ajqedeo ajjauuoneiedo ja ajauuoIssajoid 
auoedes ayoj oun,p ‘saleiaspnq suorssaidwios ap 3}xa} 
-U0D 9] SULP SUQUI ‘UdT}UTeU J] 39 JUdtUaddoOJaAap dy JUOS 
QUIDJUI UONDUOJ RT Op sayedioutid sanbysugioeIies soy] 
“QISICIS I][9} DUN ,P S9UIO}X9 19 SOUIDIUT SJUSUUYIA SO] 
SUSI] SOpuUvIS So] SUP DI1OaP op dAvsso Ie [9 SISOTOININY 
RP] op juswoWNUI sed juepuddap ou dasnoINOBIA sI139}e1NS 
oun dJAInsInod ap januassa sew ajqissod juawanes 
UOU 389 [I,ND NoUTeAUOD JUSLUA[eJUSWIePUO] SINs af “adIDIOX9 
309 B Jojqid ow sed ou ap Istoyo Ie f ‘stojaynoy, ‘ueas 
g[npued un.p ajenjoe sinoy,| & s[qeUJSOSIP JUSWIaANOW 
3] JUoWONbiuN no dIIP[NOYS JUDWIOUDAP UN jsd JUdUOU 
-I9ANOS NP I[QI NP 9jU9991 UONONpPa PI IS JOUTUID}9p op 
ULJe ‘SINUPUD] So] JOUIOOSIP op JoAesso nd sieine,f (L661 
suoffy Us1a40J) I9YSNe[S dIeP-uUY 39 JOyONIG 1019g 
‘IOBuIsaTyOS INyWYy sulWI0D saysijeioads sjyuouTUE,p 
Jed suoffy u31a10J ap dilesIoATUUe 9C/ NP 1Ud09I OOUUNU 9] 
suep sagsnods 919 1U0 sasay} XNop Sd]) ISIOAUT UOTJENIS B] 
OP ‘USUIANIIFJO ‘NO UOTJeU-1e1q ,| Op UI[IEp Np jolns ne Joy 
-noads nd sreine f <onbysneys e] op neoing 9] ANs 39 919100S 
RI INS SUONVITUNUILUODYII} SOP 319 UONCULIOJUL | Op SdIdOT 
-ouYyd9} sop uONdope | op suotssnosadaz xne Juenb saystunyny 
solreugos soidoid soul Jo910 op sJoAesso nd sieine .¢ 
‘oyooid IUdAe UN sUep 
JOAI[aI vIpNej [t.nb sonbrytjod sop uonesoge[s,p seneul 
ud sijap xnedioutd xne juenb saigyo juos ow Inb sagpi 
SO] JDUVAR ILOASP Op ISUTe JULIA ‘NedAIU JneY op sonbnijod 
Sop suaIpeuLd saysAyeur .p odnois un Jed gsodoid oueugos 9] 
Ins askyeue UOUL Japuoj ap Istoyp Ie ff ronbinod 3sa,D “nagid 
SUOIAR SnoU aonb 90 ap sajUdIaJJIP Zasse JUSWAT[aNITQeYy 
juos oIpuodai A inod siyafnsse sourwmos snou sayjanbxne 
SOJUILIIUOD Sd] ‘Sd}991I09 JUOS SUOISIAgId SOU IS OW 
"«*QUUONOUOJ [I SITUDAR NA Ie, 
{» :QUIR]OXE 1S9,S 616] US oNbIIAOS UOTUL) Ud SJISIA OUN,pP 
Inojal ap ‘Inb ureotisure aystyeusnol oa, ‘ueydayg upooury 
Jed aylej d1ggjao UOTeIe[SEp PI Iso SoIgJoid sow op uN,T 
‘Juopuoge sonbysouseip sinoa,p snuuod uatq soyduroxe 
SY] ‘sanagid 939 JuaTeAe INb sa][9a0 ap saUaIayjIp UdIq 919 
uO sajuRyodumt ssourpud) sop yednyd ve] ‘uaWdANsedsonsay 
“QIQLIOARJ O19NB 3S9,U SoXxa}oI1d sane .p snos s9yous[IEp 
soqeiedwio0s sao1osexe.p ie f anb asouatiadxo,J ‘saouonb 
-9SUOD SINI] op Sayipnia sasA[eue Sop ILJJO.p Jo ssouRpUd} 
SOTJOANOU Sd] JOUIID Op ‘IUDAR,[ JOUIAOP op JoAvssa.p 
POUL P| & 38d [I ‘ULJ BS B BYONO} oMeugT[Mu s] onb so; y 


NOISNTONO) ‘8 


“IMUIJap & djSoJ ANZ] [I,nb sumnsoj sap & 9dRIS JO SOPOU 
Sop UOTaS jUDIOGeT[OD onbiysNe}s e] op xNeUOTeU XNvoING 
Sg] Is aonb gstyeai ang ined ou ajyuessioid sourywoduit .p 
awig]qoid 99 aIpnosal ap ana ud saIs01d no} ‘aoUSpIAg 
ano} 9q ‘eg[a0ap ong sues oUOp ‘UoUIeNbIUONDeI9 
‘seo op aiquiou uoqg suep ‘aliejy os ynod uonewodxa,| 


JUBAe,| 9p UONesedaid e7 - senbysyes seoiues seq :1He|e4 


JUOP ‘SddIAJasS So] BUIZDUOD INb 90 ua axaydwos snyd juoW 
-9]]9U DIOOUD 39 [I ‘SUdIQ Sa] DUIZDUOD INb 99 Ud asv\sIdap 
ap suefqoid 3] Wos enb snbijduios Issne ‘yWossins 39q 
“So[PUONLU Sa[BISTJ SIO] BUS 
SdOUdIaIJIP Sap JoI WOANod esasnl astidanua | anb sase} 
-UBAP SOP UOTIDUOJ Ud Sdua} Np snod ne Jan{OA9 JuaTe.LINOd 
SUONUBAUOD $290 ‘IQ ‘astudanua,, op safqriduiod suo 
-UDAUOD XNV JUSUIAWIIOJUOD OIINS ap sul Jd [eID0S [eyIdeo 
QJ ‘SYOOIS So] ‘saolyouagq soy ‘daynofe Ingjea ev] ‘uoTeUOdxa ,p 
SUIVS SOS JIRIDIV[OAP UdIpeUuRd JUROTIqQey aD ‘osudanus 
DUIQUI P| Jed sasI[N ong,p sulJ xNev JaUd BpuoW sg] sup 
d110dx9 Sg] 19 SUIOIJ Sap INpold ‘oyeuONeUSsUL) B[IGoWONe 
astidaua oun .p oyun .nb yur} ua ‘nb epeuers ne g][eisul 
JUROLIQe] UN SUOISPISUOD “a1QUOIJ SULS SIDAIUN UN SsUep 
sogtoydxa juos sarya .nbstnd sastidanua sao ap yusWIOUUOT} 
-OUO} NP JUSWI9TqQeUsAUOD a}dW09 aIpual jnad ou anbysne}s 
RI op [euoneu neaing unony ‘soyeuoneusuey sosiudanua 
sap sonbiruou0dg suonesgdo sa] 19 SUOTINGLUOD Soy 1908IOI 
IOAOP Ip ouUIssap as Inb ayIssod9U LI INS JUdIJUBDUOD 2S 
XNVAPRI} SID “DISSIOOU PI JOUIOOSIP JUSWAIIV]O Jnod UO jUOp 
SIRUL ‘SONO]J BIOOUD JUOS SUOISUSUWIP Soy JUOP sfeUONeUIOUL 
dayiod op xneAeI) OP BLIOSI}VO SUIVISIOI] BUN 9}STXO [] 


Sa[VUOTJVUSULI) SUOISUSUIIp SaT (II) 


“syQONpOId SIA JUOS 9S SUINIOJ $99 op 
DIQUION “SUOTUNDL S3] 91]UD S[[PAIOJUL,| SUBP S9IND9XO9 JUD 
-oddojaagp ap no sjanydaou0d xneaed) ap UONNGINUOD PI ISO 
[eUONeU «UOISgYpr Pp WOIP» a] sponbsay inod Jo JUSUISIOT[NSII 
ZaSSe JUNSSTUNAI as IND ‘sginjons}s STeUL ‘STATOIJJO UOU [IRAe 
ap sednois ap alias oun JauLIOJ & gssnod ke snou (SddIAIOS 
op SoLMsnpul sop indjo9s np uoOnpold ev] op sinsow 
RB] aud) ‘sourgtqoid surlej90 ap ajuRisisiod atjanjdeo 
-U09 9IXo[CuI0D BI ‘soguUR SdIQIUJAP SdD “(soTeUOTFRUIOIUI 
SOULIOU OP 19 UONBOIJISSe[D Op UONVIOGR]P ,[ SUIUIOD) 19-xNdo 
oP apisg,[ SNOS NO xNeUOTeUIOJUI SouUsTURSIO Sap Jed onb 
s91ndexe og JUsdANed ou Inb xneAed) xne jos ‘sanbisse[o 
SaTJOUUOISsaJoId SUOT}ORIOIUI XN IOS eI) & 19-9][99 sTeU 
‘UONPIOGR][OD BI SqO[SUD BOUUOTUDUISNS LIOSg}eO eT 


S[9NJDI][97UI $}.10JJ9 SOP UNUWIWIOS Ud BST BT (1) 


‘JOUIOJUT .P SIOA I Jed sayeuoneu saguuop sa] yuapgooid 
sues gy]Ioe] oun dade Joynsuod efap yned nb o1qnd 
pueis 2] 19 SofoInjeU DdUdIOJOI Op SaQUUOP Op WOAIOS 
SaTeUOleUIO}UI SUOSIeIedWOd Sa] sfanbsa] Inod sinayssayo 
Sa] ‘SaoIJouaq So] JUasstjIedal Jd SJLOIP Sa] JUUTWA}ep Inb 
XNVUONLUIOIUL SOUISIULZIO SI] ‘XNVUONLUIOIUI SINd}eIN039U 
Sg] ‘SoTeUONeUSURI) S9}QID0S Sa] JUOP ‘sadINOs sinatsnid 
ap jaraoid uonestuoweYy.p spueuop eT] ‘oey os ap 
vIONUIUOD J9 aIIepNdeyDeds UOSe} Op QJuUdWUNe ve ‘UeOdWI 
g19 sinofno} e Inb ‘ulosaq 9] ‘uOTesIUOWUeY | BUIZDU0S 
nb 90 ugq ‘samne sap soouatiadxa say side .p asessnuaidde || 
yo onboidiog1 youuotssajoid jyusWeseInooUa | ‘SuOT} 
-ROIJISSE[D Sa] 19 S}ddNUOD Sd] JOSTUOWILY,P INA Ud SLOJJO 
Sd] -IIOARS B ‘sue QC] op snjd stndap uoIssajoid anoU op 
SNUUODAI UIIG XNVAVI} SI] JUISULI 9S JUOB9}L9 99399 sue] 


Sa][FUUONIPe.Q SapeuOeUAIJUI SUOTIUOJ Sa (1) 


vVl 


UaAINS INb SAUIO} SION) Say SUTOLU Ne pudid 
Iq ‘Jueynovy oxnyj un sed jso,u aVuoreusajul ougos ke] ANs 
aouasaid vy onb stav.p sins of “1d! JoInaljjo sterpnoa of aonb 
DUIIIXS IISILNS L] IP JUDWIY[9 JOIUJOp J] ISd BPeUONeUIOVUI 
seyiod op xneavy sap ev sadionied ap ayssaogu eT 


J[VUONVUIIIUI UONBAOGEIIOD BT ¢*L 


“OQUISTURII]ILU J] 39 aSATeUR | BUd 
anug} UONROIBUIEp op ous] v] sed sssoissuvy ou aT[a,nb 39 
sowigjqoid sap jeniedu uswexe un ajuasaid ajo ,nb ‘aynou 
los asAyeue | anb sJainsse,s Inod ‘«jauUONNINSUL USUIe Xd» 
un suoyjadde snou anb 99 srqns Issne JUaAIOp s]I ste ‘onbn 
-A[eue BpOYJOW PI ap anbiyMUdIOs SIIPI[eA BI JOWIIJUOS ap 
ule ‘sired soy ed uswWexXd | B SIWINOS 3139 JUDATOP s}Inpold 
SY] “9198 UdIQ WO} O19 NOP swIWeIZOId 9] STRUM ‘aTquIOARJ 
Inof un snos nevaing 2] JOA B oI]qnd np saiquisu say soy39 
ayiod sanbijAyeur sjinpoid ap a] qIstA 39 JolpNsal xnyJ uQ, 
“SPIPOUL So] Jed a[[aYyd9 BpuvIS B S99II0 JUOS ‘IO}9IdIDIUT & 
SO[IOVJ SIULT[IES Se] Sop ItUa}UOD JUdATOp Inb ‘sanbydyeue 
Sopnye say ‘suoTRor[gnd sane SOU Op Je}SUI,| VW “ASIOAO.NUOD 
B JuaIgqid s[I,s ougUI — ajsojluRU yso doURWOdUIT,| JUOP 
SIOISSOP Sap dAR WOddeI usd ag JUSTIeIASp sf ‘sjofns sap 
XTOYO ne Je] & VOUDUIOd VT “JUDWISUIOANOS Np d[qQRIOA{ 
dseull ouUN UOU NO JUdyefoid 19-sayjao anb ‘suonearasqo 
soyedioutd say isossal aiiey B ‘sasayjodAy say Jaouous & 
‘sanbutyod sa] aipusjap ap Jawad & ‘auWeIs01d un ,p sjoadse 
SO] SNO} JOUTWeXd B aJsISUOD aANOA[go J ‘sajueoOdut 
ane | 39 oun, JOS doUdUTJIOd eR] 19 aATOALQO,T 
“soqyueyodull 
sgyetoos ja sanbmuouosg §=suonenyis soureyiad Ins 
uonuaye | 1172 Inb syuRy[es sje} sap auINsa UN sdguUOp op 
uOoIsNjjIp onbeyo e aiputol ap ay1o1,dxa anbrtjod ey ajdope ve 
neoing 9] ‘sonbydAyeue syoddei ap [reyusA9 a3Ie] UN Jolqnd 
op snid uq ‘27a ‘uoneoONps,[ ap 10 aJURS eI Op soUTeWOp 
So] SUBP SsddURPUd} Sap ‘NUSADI NP jd [IVARI] NP gyoIeW 
NP ‘sIWOU0dY,| ap SaayoioyooI WO} sanbyAyeue sapnie sop 
jUdUUDTUOS suOTRoT[qnd sad “«sanapea suoneorqnd» soy 
suojedde snou onb 90 jue}9 a{qISIA sn{d ek] ‘SOWLIOJ SasIOAIP 
jusuusid epeuesd onbnsneis op sanbryAyeue syinpoid say] 
*«JUOUIOUIOANOS» 
np [90 op onbiqnd osewil Ins] JaloUdISIJIP op sone 
aqjonb ayioduit,u aonb snjd ane-ined youtad Ineay aAnoR 
ae9 ‘onbnsneis ev] ap xnevaing say nod dueyoduIt Is ysa 
mnb onbyijod sourpuadaput ,p ja ajjouuorssayoid souarosuo0d 
OP ISLUIL | V DATVOTJIUSIS UOSe] ap oNqlyUOS sayenredurt yo 
soatdelqo sonbijAyeue saguuop op xn{j ap uononpoid ey] 


puoj ap asdjeue,| ap afo1 aT (I) 


‘oyjomiadiod 
IU O[[SIOYJO IU soUasTXD oUN.p jIse.S OU [I ‘SapueWap 
919 UO sl sjanbsay nod soumueisoid xnesanou xne 
JaINVSUOD So] ap INoUUOY ,| Jed snud} JUSUID}SazTUeLU SUOAOS 
snou onb udlg ‘dIeUIp1O JaspNq Ne SaISa}UI 919 UO SpUuoj 
Sd] ‘SNUd}GO SIO} dUN ‘WoIoINS oq ‘aJoLd ssatuUeId 93N0} 
OP JUL}9 SUIUOD ‘SJUBUDAIOJUL SOIINL Pp SIAR UONLIOGRI[OD 


evi 


ua ‘saasnf suoae snou aonb sayIAor Say[aAnou op Ja9URUTy 
B SQUIJSAP JUDILID S9PULLUDP SPUOJ SAT “JUSUIIIIVSSad9U Seg 
Lxneroeds sjyafoid sap inod spuoj sap Jopueulap op IeJ 9] 19 
DULIISPNQ I[O.NUOD J] dUS UONOIPe.NUOD oUN [I-]-91SIXY 
‘soqUPWOdUIT SOANBNIUT SoyTOANOU 
ap inod sosmejuowgtddns spuoj sap ajtns ey sed 11ua}qo .p 
stuliad Isure & snou ja ‘UOT}Sa3 BR] BUIADUOD Inb 39 ua .nb jou 
-uorssayjoid urd ne jue} dy[IQIpaid o1JOU JUDWIO]QuJOpIsSUOS 
assneyal & snssad0id a] 9193 SUOAR SNOU JUOP UOSR] eI ‘ey 
uy *XIOyo sou aipuajap & sigid ang & Issne Wed10} snoU UOT 
-ENUS 999 UOWIITJOINIeN “Wepusjud | [I SuUWUOD suONONpe 
so| Janbiydde ,p ‘uonsas e] ap tnjao onb jauuorssajoid g[sur | 
Snos jue} ‘aVAqI] BT Na sinofno} ev nedIng a “jURpUdadag 
‘saguue salgtuiop ozuinb e aznop sap sinood ne sagiadal 
Sollejaspnq suOIssaIdWiOd sap Iqns ev epeueD onbysnes¢ 
‘anne .p ya wed 
ap — sJUdWIOWOdWI0D say Ins JonIJul yWestnod uonenys a]]2I 
OUN Pp d[ENIUDAY, | SUIQUI ‘AIINO UY ‘s}URSseIIEQUI JUS 
-onbrijod sanbysneis soutueisoid sap Ja[qid ap UOISed90 ,| 
JUSWIOUIL}IIO JUSTeING S|I ‘srotfnonsed sanbysyeys sowuress 
-old sap JasIA ‘allejaspnq snssaooid ne aovi3 ‘yuateAnod 
sorqnd sitoanod sg9j ts ‘yaya uq ‘onbryijod souepusadeput | 
ap yejuswepuoj yoodse un jso ailejaspng sJONUOD JT 


aalejaspnq aQ.jU0d a] (I) 


‘sanbysneis sowiaisks sop onbuijod souepusadepul ,| Juowas 
-NdINOSIA dIpusJap Inod sgazja snjd say ssuel sap soireu 
-UOT]OUOJ Soy Ans Ja}du09 Weanod ou UO || Is JuoUEJaT[NOIed 
‘SQOURISUODIIO SAIINV .P SUBP SO]UDIIJJIP UOJ SUOISNTOUOD sap 
Jai yreinod uo sey ‘sasejuear sap onb aijjo .u onbysiyeys 
PR] Op NKdING UN,p IIIVUIPIO d19)STUTLU Op UOHENIIS PI ‘sopqus 
-OAPR] SIOURISUODIID Sd][9} Op JUsTeAgid aonb uoNIpuos y 
-aaudosddeur 
DOUDIDJIOIUL 9INO} VP SIOAR JUIIeJOS SeIPSUI Sa] onb epeueD 
anbysneig op saAordwa sap qwidsa., suep oaioue udIq 
JUSUAT[A} Iny _pinofne ys onbuytjod sourpusdapul ,p uonipen 
ey onb juowoyejied yes unoevyo un jno} ‘anno uq 
‘“anbnsneis 
R] ap neaing np sifiqipeso ey] ‘ayejuoWIoUJaANOS onbnijod 
ap seneu ua ‘e.nb soueyoduil |, JUSWIdIIe[D JUaSSISTeS 
nb (QNSIUM JOTWdIg 9] JUDUID}DOIIP JUaTNOS Inb a1aystuTW) 
dAlid JIasuoDd np neding np soiquiow soy Jed jo someu 
-UONDUOJ syney Soy Jed anudjoIWUD 39 B9IIOJUSI JS UONIPe} 
d}}9D “IOIUJOp 99 gI[NSUOD OAR Saide sanyosal IOs Joyo us 
UDIONSNEIS NB SASTUINOS IOs JUOS saWTUUeIZOId sap sayWOUd 
Sg] 10 sanbruyoa} sowseyqoid say yUBvUIZDUOS sUOT}soNb sa] 
soynoy, ‘sonbnsiye}s sowuess01d ap ya sanbyiyod ap sowiayq 
-old xne yey e& Inb 90 ua sagisgyIAtid uoU suOneIal sap 
epeursd onbnsiyei1¢ oar JuatjaNue |] ‘onbytjod op s1gnew 
ud aytjiqesuodsad oyedtoutd es ajuasaidai inb ued somueid 
op aInayayiod un,p olepnjy sinofno} jso nesing np s[qes 
-uodsal ansturu of ‘epeueg onbrysneig op seo a] sueq 
‘goudUIyod vs ILIpUIOUe .p 
UOP ‘3e1q,] BP Sasenol sap asejuRAep Jopost.| op onbsi 
3] asod sre ‘onbrrjod souepuadep ey] au0s onbnsneis P| 
ap neaing 9] Ja89}01d ap ins snyd a] UaAoW a] JUDJUSSaId91 


666| aqueoap ‘ajenbua,p sanbiuyoe | 


SuUOT}ISOdSIp op a1U983 aD ‘shed xnaiquiou ap suep [eiguas 
INdVOI9A Np neaing 9s] 39 seuoTyeu onburg x] WwOS J] 
SWIUWIOD ‘JUoWETIed np juase uN onbrysneis ve] ap neaing np 
JUSWIOIOI[AX9 dIIvJ B ISISUOD UONPSTTLIIUDO PI OP saseIURAR 
So] JUoWsTeSa sArasoid inb aljauuoNestuesio syI]epouw 
ane ougQ ‘onbniyod souar9jsoqur oun e& otInpuod jre1nod 
oNSIUIWU UN ddAv onbrYyoIeI91y soURpusdep ap Ua] UN ‘IO 
“QITeUUONDUOJ 
3] UOU jo ONSTUTW BJ ISO JUOWTIed ne sajydu0d sap 
oIpual Wop Inb ouuosiad ev] ‘Id]UTWASAAA OP JUSWIdUIBANOS 
ap s[Qpour os] suep “JoJyo UG ‘oNstumU ne soajdwioo sap 
PpUdI OI)STUTL-snos 9] “JURPUddaD “aUIa} SUC] B soUdUTVIAd 
RP] WP S[aUassa s}UPUTWID}aP Sap 1UOS ‘INO} Ina] e ‘Inb 
— SOIQISIUTW Sone .P DdAv SAATIONPOId 39 SaytoNS suONeIII 
op usnurew a] suep juryodut sam afo1 un ouop onof 
[E,nb jo (a19}STUTL UN Pp Joyo 9] SIIP-R-1s9,9) oNSTUTI-SNOS 
op mnpoo Be jusreatnbs ynyejs un e& Joyo ud UdIONsSNes 
3] B[onbe] uopas dso} e] JUDUIASNOINOSIA JUSTINOS s[OTVIE 
juosgid 9j ‘ed oun.q ‘anbijod ayanoolgo .[ e 39 sousuTIOd 
RL B We JuRAe SUOTILIDPISUOD So] dJUD ayOI[dxa stojied 
STUOIdUIOD UN 9}SIXO [I ‘TOU UOTas ‘1Oy “anbusneys aW9}SAs 
9] 39 onby[od snssad01d 3] aud UST] NP [AIOTJO s1gjOeIeO 
ne yer e [eyUsWepUOJ JoINjoNNs swe;qoid anne ug 
‘anbrtyod 
SNANOa[goO | op ona op julod np sqeigjoid jsa uONRSI] 
-eueo Re] ‘anbasnejs neaing np joyd a] Inod gaa[9 snjd 
onbrysresary Sues un & JUSWIaTqQeyTAguI onbsaid yyNoge aII9 
onbsind ‘ouog “JauuoIsstwap IOAap ap ayorduit sovuswi 
ve] @ sprod ap snjd dnoonesq suuop ona usd jusWwaneYy 
uonenys oun nb yey ne nb tos usd JoAnod ne jue} sed uou 
JUST] UONVIEPISUOD aad ‘9AaI9 snid esas anbiyqnd uonouoj 
RI Suep Sue UOS onb JUSWII.ROTFJa snd jURINe Pp UOTIUOJ 
99199 op viaqInbows [I “AM ‘neaing np Joyo ne ‘jno} jURAR 
‘gquiooul Inb gyyIqesuodsai oun jsa aouepuddapul 91199 
ap uoNndajo1d ey ‘anbnijod souepusdapul ,| juowapioes snyd 
Jaarasgid ap yousod uonestfenuso e] anb a[qeiqnpur js9 [I 
‘\uepuodas ‘asijenuso anbysiyeis suiajsAs UN aUOD 19 INod 
SJUSUINSIL SPULIS S3] (966 I39][94) SINaT]Ie gsodxo 1k .f 


so]]aUUOTIYNANsSuI SuOTIsOdsip saT_ (0) 


“UdUURX9 Pp 
SOUIO]XO SOTWOD sa] NO saguUOP ap SdLIgs sapuRis 
Sd] S3]NO} 9p UOISNJIP ap sayep sop sfqeieaid aouOUUR | 
SWUIWOD ‘saTN sosatpNoNIed sanbruyse} ap sed resajied ou 
JO XNeJUSWILPUOJ SAWETQOId SION INS TeJONUIOUOD OUI OF 
“INUISSII OSEIULALP BIONUD IIe} 9S DTATION[QO | op afe]USU 
-epuoj soueyoduit | ‘soqnd spuoj ap ajuessioloep ayuenb 
oun Jajoajje Inod «saanoa[qo» saguuop sep e,nb 309 1n]d 
quowiosnf ne Jol as & ajURSSIOIO sOURpUd} PB] 10 oNbIATTod 
snssaoold np pies | e olfqnd np aurstondaos a] guuop juRj9 
‘ny pinofny “(81661 I8a][aq) asejou onbyyod souslgj 
-IQJUI SUBS SUOTIOUOJ Sos ap JanINboe s ap gyloedeo RY] ke 10 
Q[euUOrssajoid 9iL139}UI | B We v IND 99 US sUdTONSNe}s xne 
jUSpsIOSOR s{I.nb souvlyUuod eR] ‘asATeUe SIQIUIOp Ud ‘d}Q[JoI 
Jasijn soy & sasodsip yuatos s[t,nb yWeJ ay ‘saTparoyyo sonby 
-SI}eIS Soy orInpoidas yUDWIDATIDaIJO JUDANEd sinoyest[NN ,p 


JIUBAB,| ap UOesedaid e7 - Sanbiysieys saolzues seq :16a||e4 


nod anbsing ‘juasinpoid say inb xnao ev sapso90R aouRIyUuod 
R] Op JuaUIa}O01Ip pusdap gia100s ve] Inod sanbysnyeis sap 
INIRA B] Vd ueyoduul so o1qnd np aourlyuod ek] MOAY 


I1IIUAIP 93399 ap UoNdad.1ed 
e] ap y9 anbyyrjod ay1ansefqo,| ap owgiqoid a Z"L 


*XNLIO] SPIPSU So] Jed aIN}JOANOd PI BIOssNeYyal 
INSU O][9} OUN Nb s[qeyquidsIesA jso [I puenb suoisnyjip 
SO] SUBP Sa[BUOISEI saguUOP Sop JIUINOJ ‘sonAdUS sap 
JUdpIOIIR UOTIAIIP aINVY Ll op SdIqUIDUL sap anb 99 kB JA|IIOA 
‘sInaduroN NO sguoId Saporye Soy W199 Jed JaynjJol ‘saquuop 
S93] JURUIIOUOD SOUg[qold sa] Ins NO sINd1a say INS ‘aaTIOe 
-o1d uodse} op ‘uonuaye | Jame Suajaduo09 afored-oyi0d 
un ‘uoIsnjjip onbeyo inod ‘1austsep ‘neaing np saguuop 
OP SUOISNIJIP SI] $9]NO} B SQddR JIQIT 9] syURJUaSaIdaL Sindy B 
JQUUOP :Sd}URAINS SdINsoW sap Jofqo ,| ole] Issne JuaTeLINod 
SRIPSU SI] IOAR SUONPIAI SY] ‘SNUI}GO SJHRIJIUSIS s}eI[NSOI 
XNIANOU Sap oI] B aloe onbyyAyeue suinsas uN .p ansosse 
WOS S9QUUOP ap UOISNJJIp onbeys onb sJansses & a}SISUOD 
SPIPSUL SO] JAB SUOTILIAI Sap JuROduu snjd gf yoodse J 
‘neaing np e orfqnd aj anb uorurdo || 
INS IQeIOARJ Je[NUIND JaJJo UN JUO SeIPsU Say suep 
syinpoid sas @ saatjoalgo 3a sajuanbeasy suoisnyye soy onbsind 
‘onbusneis ev] op neoing 9] Inod sJatpnoried 1g19}UI UN Issne 
gquasaid aq “orjqnd np y4ajUL | Was seIpou soy Jed sanbn 
-SI]]S SJUDUIDUSIISUSI OP IANLWOJUI Jo aJUSNbeIy UOISNIJIp 
RB] ‘ound ‘sanbysneis sjusuaUsIasudl Sap JUdUUATIGO ‘snTa 
sjuvjuasaidai sou ap aiquiou stiduios A ‘suas sap yiednyd 
RP] onb saseyodal sind] & 9ORIS 1S9,9 Jed ‘\UeNTJUI Sat 9[QI 
un juonol seIpeul sa] ‘sowe[qoid sa] aipuaidui09 xnemw op 
youlJod uoeULIOJUI | a[fonbe] suep dinsowi vy] & Issne sIeUl 
‘anbysneis ev] op neoing un Jed sjinpoid syusuousIasual sop 
gjenuajod si1]NN | & JoWTNes UOU JUN) VoUDUTIEd eT 


SBIPIUI Sa] IAB SUOTJBJA1 SVT (A) 


“SO9SNIJIP WN9 Pp JUBUDA SasATeUR NO SsaguUOp sajueyOduUII .p 
INS SOIIEJUSUTUOD SINI] IP JUSWIIIILUIPIO BIdIJ9UNq epeUeD 
anbrsieis jo uonesieroods op ourewop Ing] SUepP SeIPOUL So] 
Inod sToinjyeU $19BJUOS SOP JUDUUDIASP SUILIIDD ‘sojURSsIeU 
saouepUud) Sd] 19 SoWg[goId xnedANOU Sg] Ins UOTUDHe | 
JoINe XNoW ap owed Ina] soURSsIeUUOD 99999 ‘IN0} UOS 
V ‘anbnsyeis suraysAs 3] SOAR JOSLIVITIWIeJ 9S UdTQ OP Sorte} 
-ISIQATUN Xne JOULIEd UONRIOGR][Od 91199 ‘sdura} a] DIAW 
‘OUINS ap Isule jo ‘sanbiynuaros saoualajUod 
ap JUaUIB.UeUT] Ne jd UOTJesIURSIO., eB sUOdIONIed snou 
‘sINajNVOd SAUILUOS SNOU JOP Saporye sap xno oaae suorqnd 
snou ‘anbneqqes g3u0d Ana] snou zayo Jassed ap syyiqissod 
RB] SINDYOIOYO Sind] op SuIeIII9 B SUOUUOP Snou ‘sanbys1yeIs 
SdQUUOP oP Saseq sop UOTe][NsSUOD RI dUIBDUOd INnb 929 
ud siar[nonsed surosaq sino] & aIpuodal MoAnod ap sureyao 
NE, P Ulf SOSIOATUN Sd] DdAR JUDUIOONY SUOIOgRI[OD 
SNON ‘“NWOJjo un a31xo gANONposd ev] ep UsNNOS ZI ‘WL 
-euayied 3no} ap sed 9] SUBP SLULUIOD “ayINs op Isure yo sanby 
-Ajeue syinpoid say anaodi ud Jossed ‘synei[nsuod saywio09 
Sop xnearn xne Jadionied ‘saygnbus sajjaanou ap suryd so] 
JOUTWULX9 ‘SOITESSID9U UONPULOJUL Pp syInpoid xnvaAnou $d] 


ovl 


Ins UOQUdNR | JolINe ‘sjanjdaouod saipeo sap UONeIOgeII,| 
e dadionsed issne juaaned siy ‘sanbysneis saguuop 
ap saseq sop Join yned uo onb sajueyodwi suonew 
-IOJUL SI] BUDPIAD Ud SIOjied JUSNOUI SOITRYISIOAIUN SINaYO 
-I9Yyd sa ‘sanbydAyeue sayajoe sina] op sped oJ sued 


SOPISIIAIUN Sa] BAB SJVLIeUazAed Sa (AT) 


“SQIOBSUOD SII|[IISUOD OP 9}TWIOD 
un — onbysieys ev] ap yeuorjeu [losuoD | Jed sayneodeys 
JUOS S}}BI[NSUOD SOWISTURISU $90 sno} ‘UIJU_ ‘sastidanus 
sajjod sap inajoas np sjuejuasaidai sap d0Ae 39 Sa[eIo 
-IOWUI09 SUOTJESTURSIO SOPULIS Sa] S9Av SonbrweUAp sudT| 
Sop SUOUd}aI]US SNON “sjuat[s xnedioutd sou ap 1adnd90;s 
Inod sagusisap s[lasuod-saisA[eue Sap UOSI[PIOIOUWIOS 
op SUOJjJa xnv ovis ‘sastdamus sap soidne stave sane .p 
SUO][IaNdd1 SNON “Jatpnonsed jafns un ev ‘uNdeyd ‘seIoesUuod 
SJRI[NSUOD SITIOS op suIezNop ouN.p snd op xneary) 
xne Juedionied sauia}xa syodxa .p uorutdo J suouajqo snoN 
“SOIQIUIOP $99 JUdSsoi9}UI INb soUTeWIOP Sd] SNO} suep ddeId 
Ud SIL 9}9 JUO SIOUIAOId Sa] D9AR UOT]RI[NSUOS Op SOUIsIU 
-BO9U Sap ‘UONRIAPaJUOD UN jURId BpeURD J] ‘SaT[IIO1JJo 
UOU 39 Sa][aIOYJO suoNeyNsuod op owes oun 9)N0} 
B 013 SsNUd}qoO ‘soiqiinbe Ja xneI9Uas S]USUIOUSIASUdI Sop 
Ins oindde .s uonenyeag anj0u aonb yueyodurt jso [I ‘Juoofqns 
‘osk[eue IdIWap Ud ued saIOLId sap JUdWAssI[guid /T 


«3}N099,p $9}sod» ap nvasai puvis UQ (IIT) 


“xnanjoniy snjd sjanjdaouod sarped sap IOAdDUOD ap NO 
UONLULIOJUL | JUDUILULJSUOD JOIOI[DUWIL ,P JUDOIOJJa S$ S]I ‘aNe 
oun .p no uodej oun.q ‘sounoe] sajueyodull.p osejisidap 
ne no saguuop ap juowaddojaagp ne jusssynoge xneaeyy 
sing] ‘Ino Inq @,nb yudanos snyzd ‘Ja sawsayqold soy JaIpnyie 
@ SOATIOU! OJ JUDUaT[OUUOSIJOd JUOS SaysATeUR SUC SIT 

“SOATILIIUL 
soyjoanou say inod jeiguas uonnos un,p uonudjqo | 
® g[quieaid UONIpUuoOd. oUN jUOS dIUdB 99 Op sSJUdUASSIO 
-Ileo9 sa] “o1qnd yg1ajul .p sowuefqoid syuryodurt .p uorsusy 
-J1CU09 B] B JUIWDJSIJIULU JUSTRIINGINUOD ‘JUDIEISTXO SI ,S 
‘inb sjudWIoUsIaSUaI Sa] IP JUoWoIINe ‘sanbnsiye}s sounder] 
sojuryoduil sj 1auI90 Inod sutosaq sao aipusIdu0d SUOASp 
snON ‘aad onb o1jqnd inajdes np uaiq Issne sausa}xo 
saysAyeue Sap sulosaq so] sIpusiduios xnemwW op joulod 
sulajut onbydAyeue oumueizsoid uog un.p 90Ua}sIxo "J 


sonbryAjeue saytAyoe say) 


“SQ[VOSTJ 19 SOIQIULNOP Sa}JOINe So] SUID ‘TanjUdAg 
anbnsnejs gig}uI uN juRUasoId sJNeNsIUTUIpe sJoIssop 
op sjuryoduit sawiajshs ap sudipres say quos inb xnao 
doar nb isure ‘sanbnijod sap sayqesuodsal sas}stuTW SpueIs 
S3] SNO} SdAV (OGH[ IS2][24) XNeIVIVIIQ SUdT] Op Neaseal 
UN ISsne 19910 ap [alJUaSSa jsa [] ‘sed WYJNns ou NesatuU yneYy 
snjd ne uonoevsiajut 9990 ‘1d0R[duai ey nod ou UdtI IS 

gunn | onurwup anb ygynyd 
assneyal onbytjode aytanoelqo | Juop JusurgTa ‘sonbnijod 
Sop UONeIOgEIS,p snssad01d Np JaNUassd JUDUETS UN jUOS 
sonbnsnejs sjuauoustosual say aonb yey ne saireuuonouoj 


Lvl 


SINVY SI] JOSI[IGISUAS B d}SISUOD J]QudSI[S9U UOU dITepuodesS 
Jnoafqo upg ‘sonbusneis sjuauaustesual sop Jo Ined uo || 
anb syusulesstoliepoe sap juawioutayd a1o1joueq sonbrijod 
sop uoleIogRa,p snssado1d a] anb Jainsse.s op iso [ed 
-1outd jnsalqo J ‘sasnjjip UOS s]I NO JUSWIOW Ne sjuRyOduT 
SJUDWIDSSIOIIL[OY SUILIIO INS UOTUSNL ,] Joe .p no sonbn 
-Se]s SJUdUIaUSTasUaI Sap Ins yuBAnddes ud saugqod soy 
Ins saxe sasodxa sap ole} ap UOISVDIO | JOYS UD UDTIONSNeIS 
N¥ QUUOP SdJSIUILU-SNoOs Sap «qn{o» nv UOISaYpr T “sIoI[Nd 
-Iued siaissop sap Inepuojoid us Jarpnyg Inod SOUWLIOJ [reaeN 
ap sodnois xnoiquiou op e,nb Isure ‘sayeyuowouIaAnos 
sololid sap saouanbasuod sap jalns ne «Sasulugu-snUol» 
ap sonbipouad soyenol sap e& ‘salepeuopqoy suotuNndl 
sina] e odrionsed ja (quourued oiiey9100s) sodSsTUru 
-snos sop odnois np aianuea wed e squid UN jsa Joyo Ud 
udlONsnels a] ‘epeued ne ‘ajdurexoa ieg ‘sajjouuosied saan 
-PINIUL Sap & Ja SaT[JaUUONRSIULSIO SUOT}ISOdsSIp Sop B ddRIS 
‘sdua) np [ly ne addojaagp as al[q ‘OWUI-a]]9,p sed yUdTAINS 
ou asinbar 3sa Inb sanonpold ja 91019 UOTIORIOIUI TJ 

‘SaTeJUDWIDUTOANOS saioLid soinjnj sop 39 suonednds091d 
SO][OANOU Sap SddIPUI sep sfqissod onb 39} Issne 11U9}qQ0 ,p 
ULJe ‘SINIPLOpP SI] SOAP S}HOI]9 SUdT] SOp ‘NedATU ney sn{d ne 
‘TUd}a1US ,p JuRWOduI saqj yUoNnbgsuod Jed jsd I] ‘a[quuesua 
uos suep oijqnd ne ‘Wey usd ‘Ja jgIajUI.p sadnois xne 
‘uontsoddo | ap soiquisw xne Issne sIeul ‘syUOWWOUIOANOS 
xne juauletnas uou ayjoid oqnd jgigjuI,p soweqoid 
S9] ANS sJHdalqo s}USWIBUSIISUdI Op SIQI] DJJO JT “SoTeJUSU 
-suI9AN0S sanbyijod sep uoNeiogry]9,| IuaInos B sgUTsSOp 
SJUDWIDUBIOSUDI SP IIOAIOSII UN J99IO B dJSISUOD 9}1101Id 
arigtueid 93n0} ayou aonb owinysa,f stew ‘s}yusWIOUIBANOS 
ap siarjed so] sno} op sUQU NO [eUOTIeU JUSIUDUIOANOS Np 
SUIOSAq SO] SIIeJsTeS B JUDWONDIUN IISIA WeIADP SI[SIOJJO 
anbysneis ey ajjonbe] uojas asau} ev] e sed syosnos ou of 


SITTVUUOTIUOJ SJNVY SI] d9AB 
synonpo.d 42 $}10.139 sj10ddei ap uayjanus,T (1) 


‘epeurg onbnsieis e aatnonsed souryoduit oun yuo 
inb xnao Id1IO A ‘SJotTpNonIed sowstuvsgu sap ins aindde;s 
douduT}ed ve] DUO s}TeNsge sjdelqgo .p UONesI[eal VT 


gousutyJed ap nevaalu yney UN.p UOyesyeIIey [ZL 


‘SoTBUOTIVU S9DULISUODIIO Sap puadep i]JUOD JonUdAg 
199 dIpNosal op USKOW INaTIIoW aT “ve usd UOJ onb uondaosad 
eR] ‘sulow np ‘no anbrtyjod ayanoelqo | a1inpes yned yuow 
-ayooiddes 39 ‘stojayno} ‘sureyia9 yUoUUTINOS onb aso} B] 
uojas — sonbnijod sap uoneiogeya,p snssaooid np aysoiddes 
as nb juounsed ang,p asoueyo op snjd juejne.p e onbry 
-ST}LIS DUIIISAS J] “sponoIJUod stojred yuOs xnejUWIepUoj 
sjoafgo xnap sag ‘anbriijod souepusdeput | 32 sousutyIEd 
RP] IUOS DUID}IXS JIdIIeINs PV] Op SJotId sane xnop sa] 
‘sanbnsneys 
SOPOYJOW Sone .p & Jo BSeUUOT[NULYSE | & ‘sJHeSTUTUIpE 
SIOISSOP Sop UONRWO|dx9 | B ddRIS (SastIdanuS sayyed sop 
IN]Io JUSWIAIT[NOTVIed) UOeIe[Ep op NvapIeJ 9] LUNUUTUTUT 
ne dInpal jo sjouuosiod syUsUIDUSIOSUdI Sop UONeS[NAIp 
UOU dP S2[LIBINOS SOULIOU So] 19}d0d$aI ‘ddINOS PR] JOIFHUSpI 


666| dIquiadep ‘ajenbuae,p sanbiuyos | 


ined uo juop sanbysneis s}usWIAUSTasUal Sap a[eNUapIyUOS 
RB] JaInsse & JoT[IoA ‘anbysyeys suaysAs np anbyynuatos a8 
-91UL | TUDJUIEW :«SaTe]UDWILPUOJ SINI[VA» SOU aqo[SUA ‘TOI 
sed resajied ua.u af aonb stiduroo uarq ts ‘1arwiaid aq “ssarid 
SION] SUIOW Ne INS JasOdal WeIAapP dUIAIXd aIdIeNS eT 

“SQSTUOWIRY 3139 
JUSATIOP 19 SAJUBPUddapIOIUI JUOS SdISd}eNSs XNap Soy ‘USUI 
-O[[OININ] *«9UII}X9 aIBa}VNs» oun juajdope anbysnyeis ey 
op xnevoing say anb juryodut jsa [I ‘sinINy slap say JaAajal 
R ouJoIUI | @ Joredaid as yuaAtop sjI.nb any swew ny 


ANYALXA AOALVULS ANN.G 
SLNAWATA SAT ‘SANOLLSLLVLS SHINALSAS 
SA’I YNOd SAINANOASNOD SAT *L 


‘saXo[duia sap uoryeuloy 
Op 19 UONRIDIJJeoI Op sJoY9 opuvis e owUeIsOId uN 
SOQUUP SIQIUIAP XIP S90 dovId Ud stu sed SUOTAR ,U SNOU IS 
QP1OIIV IvJapP I] SULP SaITeSsdd9U SAUTPUINY SddINOSsal Sd] 
Jastiqou nd sed yuaurayduits no} suoline ,U SNON “aouesin 
91N0} Op BANSO Ud STU 3g WOp ‘apnyiqey,p sUIWIOD 
‘nb 3a dnoonevagq oyied uo JUOp [eIUDWIOUIDANOS SWIWIeIS 
-o1d nedanou UN,p UOTeNsIUTUpe | B Satqesuodsiput jUOS 
sonbrysiye}s Sa[[aanou soj Woisins oq ‘Ja_qnop ez] ap jutod 
ne SUOISIAIp sanbranb ap jnoejjo,| JowUsWIsNe e eIaSITGO 
snou jofoid 9] stew ‘[e10} }e8pnq anou ap jUd0 Inod Q| a]Uas 
-91daJ JUSUISOURUTY NEdIANOU JJ ‘JUSWATeqQOT[H ‘sonbrwou0sg 
sonbnsneis sop owuieisoid np oajuewodut uorsuedxs 
ouUN Ig.URULJ B SAUNSEp SpUOJ ap s[qQeJapIsuod uONsefluI 
QUN Pp JOIdIJQUSq Sp SUOUDA SNON ‘Iny,pinofne sanaid9 opn1 
B ISIW JS9 I[[OUUOTJVSIULZIO dssajsnqgol aTJOU ‘aTeII UY 


"[210} JOBpNq Np uoIIAUS JUDO INOod ston 
® Jua0 Inod un,p sagssed juos sayjanbsa] ‘uoNeWIOJ 
PR] op on ne sasuadap sou g{di Issne suoae snoN 
‘IQISOUI UONPULIOJ op Jo[dwio0d suUeIZOId UN dIANIO 
Ud STU 19 BIOGRI9 SUOAR SNOU ‘saguUe SdIQIUIOP Sad 
‘QTToINIvU sa SUOTIRIOOTJe SaTJaAnou ap uor}e}da99R ,| 
sjenbsay inod sajdnos ja sjuajaduios saXojdura ,p 
juvjop snou ua nb ynoafqo 190 aipurane suotAnod ou 
SNON ‘SIJap XNVIANOU ap JBAdTOI JLOANOd Inod aysnqol 
JUSUIWURSTJJNS sINsWep neaing af onb suorjnoa snou 
‘salleja3pNq SUONDINSOI Op d19s ONSUO] oUN sIZTePY — 


"s}e][NSOI SUOg ap WeUUOP [391 IJap 
UN,Pp dIVOsse UORIOOJe BJaAnou oun .p satjoadsiad vy] 
‘xno ajua.p wednid ev] snod ‘anb 9]e]su0d suOAR SNON 
‘soXojdua sou op UONRATIOW P| 19 IQIOIUT,[ JTUa}NOs 
ap sudskoul sane .p JaANoN op suoae snou anb sy0s 
ap ‘uonoulold op saanoodsiad say] 1UsWIO]qQeJapIsuod 
yinpsl e& sjaspnq sap siaynse1 uorssoidwi0d ey — 


‘Salqeiajsues) soousjadui0s ap 
sed juepassod ou souuosied sap 19190}Jeal ap Joygtnbur 
snou JIOAep sues ‘sayqiuodsip s}aspnq xne jo sJUsT[O 
SOU Op suIOSaq xne sauUeIZ01d sou Ja\depe oAnod 


JIUBAC,| ap UOIesedaid e7 - senbiysiejs seoimies seq] :1Halje4 


ap xnotiaduit yeusdap [I ‘aireUOS NY ‘UOHENIS 31199 
Wepuajud-snos anb sadinossai sap apis UONRIOAIJe. | 
Ituajureul ap =suaXout say snjd suotav,u snoN — 


"uOdSeJ 991990 Op IaUUOTIDUOJ 
op oameawsed snou snjd juowajduis no} suoiAnod 
ou snou onb ‘suosier sinaisnjd inod ‘ajyduioo snpual 
SOWWUOS SNOU SNOU ‘UOIIAUD su XIp B A [I ‘SloJayno TL, 

UOISIAIP 3}]99 SUPP IRSSTUL] BP] UONROTIQR] BP] Ip no [Ivary 
np ‘uoleonps,| op ‘ajues ev] ap onbyysyejs ua agsieroads 
UOISIAIP BR] SUBP dIQTIeD evs jeSudUUIOD Inb suUOsied 
oun ‘ayeIQUaS 931 UA “[ROIWIA JUDUIDTONI dIQIIIeO 
op judaUTUaYS UN assed 9g] Jed jIeIJJo epeueD onbusnei¢ 
‘anbusieis e] ap xneoing sap uedn{d Pe] ap seysul | Y ‘Ulosaq 
3] UOTIS soUTeUINY sadINOssaI sOU JUOWIITIOe] Ia}DOFJeOI 
B sed suOALUe.U snou IS g9RdTJJa UOS ap pJod UONROy 
-lueyd ap auaysAs onjou ‘ouog ‘jofoid un e saat] sasuadap 
sop ajuvyodun snd ey] ayuesodu09 P| JUSWDTQULIVAUI JUd}UaS 
-91daI SOUTRUINY SIdINOSSAI SI] 19 ‘SIdINOSSaI Sap UOTRIIAE 
-91 BI JUSS QUIRAUL JUSPUd}Ud-snos UONRIIULI PB] B SOAT] 
-R[91 SUOISID9P SIT “(L661 BpeuRD anbysyei¢) a]jauuores 
-1Ue310 ossaydnos ev] op juRWOduITI snjd 9] JURUTULIAJEap I] aN 
jnad jsd SOUIPUINY SddINOSSal Op dIVNU Ud IISa}VINs VT 

‘syinpoid op owes aijJ0U op UOTROIJIPOW 
PB] Op BIIOULUTJ 19 d][INURISQns sINjJeU ap sUOISsNdJadal So] 
JUSUIIJI[NSAI Jan[eag IOANOd sues ‘spuoj ap safquiepIsuod 
suonjooful xnap op saanjouod ‘saguue saigtuiap ozuinb 
SOP SICUIPIO JaspNq a0U ap SadAIssadons suOIssaidwW0S 
Xne IIBedI UdIG Op IIOLJIP WOJ 939 WeIne snou I] “SoIgt] 
-nonied sawanoe.p uorssoiddns ey & no ynole,| Be g190sse 
INOS Z| JawWINSa,p Ja WNpoid anbeyod ap ajueinos ayo0d ev] 
Janjeag,p ‘syinpoid sou ap nod ap sINjONA}s eR] JUDWIIIVI[NSII 
JOUTUeX9 Pp JUdyJoWIEd snou Inb safqesuadsipur syuswg[9 
XNap JUOS sSoUlaIsA$ Sdd “JUSIADI Ap NOD op oWaisks 
3] Ins sxe gilerap yofoid un ins saAndde_s Wop uoneoryiueyd 
RI “Ino} UOS Y “(Z66] I82T[9q) UOHROIyIULTd ap suUIa}sAs 
uos jso uONesTURSIO oUN,p assojdnos ev] ap URWoduIT 
jUeUTULIAJ9p uN ‘ney snjd guUONUOW Ie,] of aUIWIOD 

‘anbyijod ap sayapour sino] 
SUEP daTUa,p SA9UUOP SWIUOD JUaWATIORJ Snyd Jasi[yN soy op 
‘sanbrijod sap uonriogeyd,| op Sasieyo soig\sTumlu sap xnoo 
slidwioo A ‘sauiayxa sinayosoyd xne youllad sinsow 3399 
“sajetoos saygnbua sap ja sadeusu saygnbua sap ssauuOp sap 
uednyid ve] suo} 99199 snos UOISNJIp snou ‘gtidoidde juoul 
-oyle] un saide ‘stojaynoy ‘sanbruou0de saygnbua sap aed 
QpuULIS DUN, Pp SO9UUOPOIOMU So] JosNjjIp op usAow unone 
QANOI) SUOAR,U SNOU ‘sayUdUNJed suOTNgINsIp sop wednyid 
RP] Op JUSWIZTeI9,| QUUOP JULI ‘UONeS[NAIP UOU op SOWIOU 
sap joadsai np ‘Juowlayjamnyeu ‘aAsosaI snos — uoIsnyyIp 
opueis eB SsagUuUOpOIOIW sop osinpoid & jUeSIA soinsoul 
Sd] $9]NO} JosviNOdUA k 9LIOd sreJoas of ‘UIJU_ “UOTR}USWINSOp 
auuo0g ouUN.p ansosse jsa nb 39 neaing np jouuosiad 
Np SaiquiowW say sno} Jed jUuaWIa[IOvJ dd}[NSUOD ag jned 
inb ‘aygnbua.p saguuop sa] $o}no} adnoisa1 Inb saguuop 
-O1OTW ap autajUI aseq oun Inof e ITU} 19 J99I0 SUOAAP 
snou ‘orgnd np seiquiou say ed o9j[nsuod ang jueAnod 
Sogsaise SaguUOp op aseq PI op snyd ud ‘nary sUIgIXNop u_ 


Ovi 


‘JOUIOIUT ,P SIOA ve] Jed sgooe | B UOTIeOI[Gnd x] ap ‘uoIsNyJIp 
ap syioddns say sno} inod uaynos ap simonasedjul.p 
BIIAJOS Inb (sayJanuaplyuoOd UOU AIIP-e-1S9,9) UOISNJJIP 
opuvis vB sofeuONeU sanbiysi7e}s Soy $ojNo] B sgdoR JURUUOP 
anbrun snbruonoeye yeyotns un INOl ev LU} 39 19919 SUOAOP 
snou ‘nal] Jonueid uq ‘soyoIeWap sapuvIS S10] JOUsI[NOS 
B OUOP TRIO] BW af “(VLG6] IS2][24) spose juasgid np 
quay] np don yesayv99 snou d1SayeNs 99} 9uN Pp syUsUIETE 
S23] Sno} ap uondiuosap PR] ‘JUoWasnoInoye ‘soquUOp 
sop gfdnjnu uoneioydxd., apqissod onb juryne soyIpIoey 
B d\SISUOD J[[QUUONRsTURSIO assotdnos Pv] ap Joadse UA 
‘soumtUvIsOId sind] 39 sanbnijod 
SINI] JO[[IaAINs B Jo SUOISIO9P sop sIpudid ke ‘suoIsIAgId 
Sop ole] & JUSIeIOpIe so] s]UdWIOUSIasUdI XNedANOU ap 
uodsej ajjonb op sjuar[o sosaysturu xnediouid xne Ja7UuOW 
suoanod snou sjanbxne aoeis ayjayos ayned ke stesso soy 
19 sajojid saignbus say] 1s0ueUl] & Was SaNqueal Spuoj Sap 
uoniod sup ‘sozedsoid sauistuesio .p sanbnystigjoe.1ed Is }UOS 
Inb [and] [AJU! JUSWLIIJ J] 19 SYTSOLIN ve] JoArasaid ap ouod 
UOTINGINSIPsl op a1uas 9D ‘sjofoid xnesanou ap Ja9URUTy 
Inod ja38pngq anou ap ued Inod ston e xnap 9109 ap suO}oUW 
snou ‘ue [eu ue uog ‘snssad0id 90 oyyroey nb (Z66T 
ISoT[aJ) UONRoIULTd ap ourajsAs uN doRyd Ud SIU SUOAR 
snou ‘epeued anbnsnrig y ‘aeloads ayno} uous}e oun 
Jops0d9v In] JUanbgsuos sed ynvy |] ‘spuo} sap uONRIOTIe, | 
Inod sjurywodunt sjueistxa synpoid op uonsajoid ey] 
JOA DOUDLINIUOD UD JS9 UONLJUWIIadxa | NO ‘sollejaspnq 
SUONDINSO dp spolied Ud IMUDJUTCUL & I[IOLJJIP JUWIIIOT] 
-nomed sd uUONRAOUUT,| UeLINOg ‘aOUdUIIAd es ap INIedap 
as op gunsse udAowW uN jsa ‘salleyaspnq suorssoidu0s 
op ons ey] ev juowonbipotiead yinpsr ong ined nb 
‘QUILUPISOId SUIQUI 9] BOUSUPULIOd Ud 19]ND9Xxa,p 19}U9}U09 
ag ‘sdwiaj3uo0] dJAtAIns ynod ou onbuysnejs ve] op neoing 
unone “IdIUIOp 9d SUBS “UONPAOUUT ,p 39 BYoIOYyooI op yWudsa 
un sdurd} 1nO} Ud ITUDJUTBUL dP I9d1OJJa SNOU SUOASDP snoU 
‘g][JauUOIssayold 3a aTJauuoNeiado assodnos ev] op snid uq 
‘sjuepuodal sop opniine .p sJusuasURYS XNe NO sapoulsUl 
SOTJOANOU XnNe ‘saIsoTOUYdeE} SaTJaANou xne snssado1d sind] 
juejdepe us iuaae| Inod soredaid say] inej [] ‘seestpetoeds 
sooedeo sao «laarasaid» ap juawiayduuts sed wyyns au [J 
“OUINS Op Isule Jo ‘apUuRLUAp BI INS 9axe 
‘gidnos onbnewsojur ayoedeo oun Jtuajurew Inod sores 
-S999U SdUa}EdWIOD ap ajg{du09 SUIS BI SUIOSaq 9] UOTIS 
‘suoneiodo xnev gyoajJe JHOoJo,| JONUIWIP no JoJUNUIsNe 
suoAnod snou janbnp inied e ‘sajjauuoneiedo saynuo 
sop uorstArodns ey e gsodeid aseq op yauuosioed ay ‘anol 
B NUD} 19 VSIULBIO UdIG sasludaMUS Sap d]SIBOI UN SUIWIOD 
‘g]fouuoneiado gy1toedeo PY] yUsoIOJUSI Inb saduajadwios ap 39 
S[QNO,p JUSUTVIOSSe | op juURINe onbsaid aip us jned uO 
‘onbisojopoyjauw aytoedes 3110] oun aovyd 
Ud aNJOW INOd ‘sartuUddEp Sap dIIOA ‘saguUR Sap INV] [I ‘STOW 
sonbyanb us aimnneap ev] ined uo nb sioyy ‘saauuop sap jUeUI 
-O1I2I] OP JO DINSOUI Op sastTeIoUsS s[MNO.p Julod ne ost 
e[ B NO BsepuUos ap sur] sInap[IowW ap UoNdaduU0d FY B IU} 
nod UONRIOI[IUIe NID ‘aTeqo]s sOKdTJJO | B JUUIATQuIEp 
-ISUOD ONGLUOD sanbINUIIOS S9POUISW SOP UONLIONOUIL | 


6El 


anb 97e]SUOD SUOAR SNOU ‘JURIINO ‘S9dULISUODIIO S9[[3} Op 
suep sjofoid xneaanou ap aiquiou puvis un suoluaidanue 
snou onb ajqeqoid nad jsa jt ,nbsind ‘aygnbua ,.p uondaouos 
ap goedeo avoj oun,p uloseq sed suoae,u snou ‘sary 
-98pnq suotssaiduiod ap apotisd ua.nb imuaynos yWelnod 
UO ‘onbysNeIs aIZo[opoyJaw sjOU Ip SUprITRA ev] op puodap 
uoneindal anoN ‘neaing np se}UsWIepUo} a][9UUOIsSsajold 
ayoedeo ve] ap ajueisajul onied yey sIsO[opoyjowW eT] 
“syusuljiad saguuop 
ap sowiaisAs xnvaanou ap julod ne asia PY] B sayqeyeaid suo 
-IPUOd Sap jUOS sfanjdaouod saiped sao ‘Iney snd gsodxo 
1B | of SUMWIOD ‘IN0O} ANE] Y “syanydaouod saiped sap jUSUIOU 
-uonsejiod nev no jurod ne astur eR] & allessao9u JusUIa|e39 
isd saystjetioads sop onbndAyeue gyroedes ey ‘saaneo 
-IJIUSIS SuOIsN[oUOD sap aAndde inod asinbas anbisidwa 
aseq P| ep sajueyodun sounder] say Jotgdoi ap ‘nary v A [Is 
‘Ja sanbusneis s}UsWIaUSIOsSUdI Sop doUdUTVJEd PR] INIOSsoI 
quoj nb sanbydyeue xneavd sap & d0RId J9IIe[D9 BpuReWap 
duN 19919 ap sajqedes ang juareLinod saysiypeioads sao ‘ano 
uy ‘judUasaid as suoIsed90 say onb ainsow e souWeIs01d 
sop julod ne amjjow Inod saystyeroads sou ap ulosaq SUOAR 
SNON ‘S8INOSSAI SOU OP 39 SITIQIPaId aOU ap suIeYO Ud 
UOISOID DUN & Ja}SIsse pp suoNbstI snou ‘ai19eded 9}399 sues 
“QUISIOAPR ,P SPO Ud JUSUASSAIPAI NV oIlessadqU Juda] eIOads 
no} 3s9 onbiyAyeur 39 af[ouuorssayjoid ay10eded syI0j oU-) 
“Sorqeiou[NA JUDWIIeT[NOHIed 
JUOS sISO[OpoyjouM PR] eB 30 osATeUR] Bk ‘dYdIBYIOI 
RI] & Seioesuod suaXoul sa] ‘syInpoid say ins afqudaoisd 
aVIpsuUt UorIssnojodal ounone v,U JUOUIASSI[GIe}Je | 
JUOP 9]ULJUD} B[QID oUN Jso dINJONIYSBIJUI ,| IVd ‘souiejaspnq 
suoissaiduiod ap apoied ua gyoedeo ana0 JaArasaid 
Inod 919qijap Wojjo un suey op yueywoduwt jUsWIIII] 
-nored 3s [J ‘ajfouuoneiedo ja ajouuorssajoid gyroedes 
SPI[OS OUN ,P UdTUIEUL J] INO} JURA 9BTXO9 aITIQuidepe J 


g]]auUOe.19d0 
39 a]JauUOIssajoid g}10eded e] ap SyUIUIZ]a SAT_«¢"9 


“NeaiNg Np sUWUNIB9] op 
j9 oWIsITeUUOIssajold ap neaos 9] Janbrydde .p syodurt JI 
soyfonbxne 39 9[qQuJUdI UOSeJ BP 19]ND9X9,p SOUISTULSIO 
sone .p onb ainsoul ud xno 3so [I,nb sajueasixa 
oyyenb op souou sap e& juepuodeal ayjoyo9 opueis 
e sajgnbus sap pusidanus neaing 9] ‘gatid Iimayoes 
ne soudlinduod sed yej ou epeurD onbnsneis ‘uyuq — 


“SOJURSUDJJO DUIWIOD JoJ9pIsUoD WeUNod 
orqnd aj anb suonsenb say anb tsure ‘anbrtjod a1ajoe1e9 
B® uoluIdoO.p sasepuos so] aqoysua sAIasoI aNeD 


‘yepuvul 
UOS DdAv SatqueduooUr jUOS INb soureWOp suTe1I990 
suep ojgnbua ounone elojnoaxo.U epeueD onbysneig — 


‘sonbyAyeue suoneorygnd 
soidoid sas suep syinpoid sjusWISUSIaSUdI So] JOST ,p 
WOIP I] JoWI[V39 DAIISOI OS NedINg J] ‘soguUOp 


6661 aiquieoap ‘ajenbua,p sanbiuyoo | 


S8P JUOWOININ Ip 1d 9199]]09 ap suonvsado say anb 
Isule ‘asepuos ap uryd 9g ‘arreuuonsenb np uondaouos 
BR] 39 NUDNUOD VJ aqo[sUd [aUUOIssajoid sfoMUOD 
Y] ‘puoj ne juenb jualys np sutoseq xne sipuodg 
HOASp op JuoWwonbiun sdalase1 snos ‘[auuorssajoid 
JONUOD I] JUSWIDIQWUS JUdT}OI epeuRD onbnsneig — 


"sjeqNsol 
So] sed jueNS[NAIp OU Ud dIIP-e-1S9 ,9 ‘aaISaTIAUd uode] 
OP 9IND9XO 31S$9,U JUdI[D UN Jed goUvUTJ [IePAR] UNONYyY  — 


‘Sa[eJUIUIBPUO] Sa[saI 
souleyiad suonbijdde snou ‘sjuar[s say sed sagouvuly 
sajgnbua ,p UONNdEXa | JUDWIDLIOJ SUODDSBINODUD SNOUIS = — 


‘pie snjd ajfauuonesado gy1oedeo ev] ap uonsanb YY e 
IVIPUDIADI Of “ULOSdq 9] UOTAS ‘aTBUISIeW UOISsaIduIOS 
ap no uolsuedxa ,p ajqedeo sagsijenuso soyjauuoneiedo 
Sg1ua,p opljos sjquiosua un,p osovjd ud os — 


‘sastogid sapoiied 
sop juepued sosainonied sayoe] sop e souuosied 
op uONRIOaJJe | JUASLIOAR} IND ya3pnq np jo soureunYy 
SODINOSSII SOP UOT]SOS OP JUSUIOUUOIIAUD UN .p UONRIAD — 


"$9}]9001 
Op s1QgIeUL Ud SayIOI[dxa salqio sap suduios A ‘neaing 
NP B[eyoe | & SUNdYyIeW op sI39}eNs ouN,p uoNndopy — 


‘JeIUOD SNOS SasI[eal 
XNBARI] SOP B DdRIS «UNG UOS JOUSeS» Op soyNuUa 
$90 op ouNdeYD ‘sastidaqus sap anbnsneis ev] op Injao 
suep 39 g[eI90s anbysnejs ve op jo sasvugu saygnbus 
sop oUIeUIOp 3] suep ‘judWIaATOOdSaI ‘JUaT[IeART] 
Inb ‘saguUONUSWSNS SUOISIAIP XNop sep uUuoTRaIgQ — 


‘Te19UaS JIDALgGO 199 JasI[vaI Inod epeueD 
oenbysneis sed o1ana ua stu suadou xnediouud say 110A 
‘Q0RIS asIvAneul op sogidaooe sotejuowa[ddns sagaI09 
Sop IUsAep op yuonbsi st ‘tonb ap ane ‘sayorayoos 
QUIQUI SIIOA ‘SIDUOIOA StIdaUd JOS XNBARI] ap d1U93 99 
NO J[[BUUOTVSTULZIO DIN][ND UN 9919 SUOASDP SNON ‘eap-ne 
UdIq Ja]]W SUOADP snou anb suinsa.f “Uepuadad ‘soles 
-S999U SIINOSSAI SI] JURST[IGOUL Ud sjan}ouod xneAPI) sop 
Jayno9xa ,p aqedeo jsa onbuisne}s e] op neaing 3no} ‘ainsoul 
duIeyao oun suerp ‘jno} saidy {soeloads saygnbua sop 
Jast[eal op ayoedeo ve] UO-JUdTUTeUW 19 UO-}-3919 JUSWWUOD 


‘o9u0d opueis son 
QUN ,P JUOS SOSLIULAR Sd] JUOP JUAI[D | INS saxe oINI[Nd 
dUN JUSUZTQRIIAQUI JUSddO]aAgpP SUOISIAIP SdD “Sd9pI 
SINg] Issne stew ‘ayfouuoNeiedo ayoeded Ing] JUOWe[Nes 
UOU «JOSI[VIOIOUIWIOS» & StIdde yUO Jd SJUSI][O SOJQISTUTUT 
xnedioutd say dae d}10119 UOIBIOGLI[OD Ud JUDT[IeAR] 
SUOISIAIP S90 ap saAo[dula sa] ‘s]UaI[D soy Jed sago 
-uvuly sojgnbua p jusuasenue juatAold yospnq 9] JUOp 
yo uolsuedxa | op Juowoprides oipusid op one | 19 oun | 
saqedeo ‘suOoIsIAIp xnop 9919 eB epeuRD onbnsneig — 


JIUSAe,| ap UONesedaid e7F - senbisie}s seoies seq :1Hal|e4 


‘g]jouuoneiodo gyoedeo ey op uonurew 
Ne JUINGLUOS sosIeYd Soy ‘xNeIQUS STeIy SaT sLIdUUOD A 
‘sJa[AWI0D $]NOd Sd] JUdIQO]SUD SaT[9 NO dINSOW BI sUeq = — 


“JoouvULJ Sa] Inod saieUIpIO Spud} op opueWap 
Rl OIeJ IP URAL SAPOUISW SITJIANOU dp J9}S9) INod 
sansuo0d sajojid saygnbua sap 1UOs $}N0d sap JUSWIIIA 
-nodal np adioutid 9] uojas saastfeas sajgnbus saureyso 
‘JoJJo UY ‘“Sd[9Anou sdepl xne Woano juoWOUUOI 
-IAUO UN.pP UdTUILW Ne JUSWITQeIEpIsUOD JUaNGINUOS 
S92 ‘saqJo} onb jue) uq “suONeAOUUI Sap JUSpUd}Ud-snos 
uOp ‘soUIeWIOp XNvaANOU ap kB je) JUSWIATToNIIGQeYy 
UO S]UdI[D soy sed saguieied sayetoads sajygnbusa say — 


‘anbysiyeis ourgysAs 
Np plesd. | & JOIWJOp 90 ap UONdeJsNes op JUSWIIWUAS 
J] INS JUDWISWOJ ON[JUl JUSITO Np opueUap ve] B sIpuodal 
ioanod ap assaydnos vy ‘isury ‘anbysyeys ey op nesing 
Np soteyaspng SajureUOd Sap nud} a}duI09 aTeJsNes & 
J[QIssOdwII spueWISp ap Svd Ud 9}LINDIS Op SOATPA Sap B 
Sonso]euR JUOS s]UdI[D sa] Jed saguieuied saygnbus say = — 


“SJUdI[O Sa] Jed sagouvuUly saygnbua sap sasieai op guoedes 
RP] ajo nb sameyusugiddns sasejuvae sap dst] eB] IO A, 
(Canbusneis e] ap neoing np oleurpio yespnq 
3] suep juesind ud sjuarjo sap sanbnsnejs s}usWIOUsTOSUaI op 
sjUeINOD SUIOSaq xne dIpuodal JoJgjoid op onbysye}s 911089 
-1JJ2,[ @ 19 onbyod VY & sioj BY e We JURAR SUOSTeI SOUUOG 
OP SISIX [I ‘S[OLIOISIUIW S}UDI[D Sap sayjenjouod sopuewlap 
xne aipuodal ap sywoedeo 9110} oun MUdUTeW op onbiyguaq 
JUSUWIIIIE]S 39 JURIOdUT j10s [I,nb uarg) “orjqnd np 3919}UI | 
suepP oye] SYoIeUIap oUN JUSWd\sojJIuvUI ysa sonbntjod 
op uoneiogr]9,| & saidepe sjusuoUsIasual ap UONONpod 
RB] dp duId} Xo JUSWUBOUULY 9] ‘oI[qnd puvis np uontsodsip 
RP] & SOs 31}Q SINO[No} JUDIeIADP “JUSWUDOUPUTJ Op VdINOS 
PR] op jusuUepuedeapu! ‘salfarlorjyo sanbysneys say soyno} anb 
-sing ‘onbiitjod ap alenew usd sajueyodut suonednosogid 
dP pleSal US SJURI[NSaI SJUDUIDUSIOSUaI Sop sdUdUIIIEd eB] op 
JUDD Qe QUIASIeIA OUSIOWI9] Jospnq didold UOS op sANRdTy 
-1usIs wed oun Jasuadeap e gsodsip wos araqsturu un nb yey 
3] :QYOILUI BP 1S} op dWOs ouN anjsUOd sfanjouod s}usW 
-ouslosual ap UONONpod ev] JoAed ostey ‘o1fqnd ourewop 3] 
suep Juassed ‘sina}das XNVdANOU ap ANS JUDSANOS ‘s}UdWIOUS 
-losual xneaanou op ‘sareloads saygnbua xne s0RIDH 
“SOJURIUIVAUOD JUOS 
SJUdI[D Say Jed sagoueuly saygnbus sap Jasijee1 op suaXoul 
SQ] JIUDJUTCU Op SUOSTRI S3J ‘(966 IS2][24) JUepsoaid spore 
un suep guUOnUeW Iv] af aOR ‘sajojId sajgnbua xne 
no sajjemouod saygnbus xne 191 resoyuuty ow af sreur ‘soWIO} 
SOSIOAIP OIpuaid jnad spuewiap eT ‘onbysneis ouraysAs np 
aiyiqeidepe .p ja assajdnos op sajueyoduit sawsoj sop oun | 
auasgidal ‘sallessadqU SPUOJ SOP JUAssIIOsses sat[o,nb 
uontIpuos ke ‘sayjanjouod sapurwap sap ev aipuoda ap 
aioedeo vy ‘anbysieis ve] ap neaing np oseq op sumureiso1d 
3] uno] Inq ined ou aonb syuowousIasual sap opurulap 
juatyo un puenb aeasi[val ang Wop eyerseds aygnbue sug, 


sayjanjyouod sajyanbua sap Jastjvai ap ayloedes ey 79 


8El 


‘(G1 66 '8a]]94) BoUSUTIOd oNOU Op oI[Qnd 9] IIeJ 
as anb dept, | JUOWII]QLISPISUOD SUOISIJIPOW Snou ‘saguUOp 
Sop UOISN}JIP eT Ins onb 3QjnJd syexNsoI say Ins 1U9d9R | 
JUL}JOW UY “SdQUUOP Sop UOISNIJIp LI Ins JoNUBDUOD snou 
anb joynId ‘s}eI[ NSAI SO] INS S]USUIUSTOSUdI SINO|[IOW JUOW 
-9]]9U SP ITWINO] dP 9d1OJJO SNOU SUOADP SNON ‘SIPS Sop 
asTWdI}Ud | Jed ulosaq B [I JUOp sanbysyeis sjusWdUsTIASUaI 
Sd] JUsWIaTeI9Uas JUsNIGO Inb ‘oljqnd puis np sulosaq 
Sa] aua0U09 Inb 90 Ua JUOWAII[NONIed ‘UOISNIJIp op 
DUIWULISOId JOU IOIONSWL & d}SISUOD Jap SUIIISION IT 

(7661 IaT[AJ) BBdIJJO 
uoneorjiuryd ap ouraysAs un,p Jasodsip suoagsp snou ‘v]ao 
Inod ‘stojaynoy, ‘sosreyorid nod soumueisoid soy aurwiys 
39 NUUODEI SUOAR snoU anb JanUOUT Ja aseq ap suTUeIBOId 
UOS JUSWIDIIIJJO 19]ND9X9,p o[qedvo suUIsTURZIO UN SUIWOD 
sn3iad 3139 SUOAZSP snou ‘sorI[qnd spuo} xneaanou ap J1U9}qO 
® Jissngi Inod ‘aouatiadxe uow saide.p IQ ‘sanbnsieis 
SOATIPIPUL SITJOANOU Sap JUSUTBOULUL] Ne JONGUyUOD JUSWITq 
-PJIAQUI SUOJADP Snou anbsind ‘satwWoUO0ds sap sIIe} op 
udXOUI JJ JOANOI) SUOIASP Snou anb uIe}I99 389 [J “‘UOWapual 
3] JaJUOWISNe B% JOYDIOYD SUOADP SNOU JUOP INIso Issne 
}S9 [I ‘sasuadap sou ap soiz a] SuOasesuUd snou Jonbnp ann 
ne Indo JULI aseq op suTUUeISOId Z| ‘NaIy sWUIgTXNEp ug 

“SOUILUOP S]UdIAJJIp suep sed sraarp ed snuayqo 
syey[Nsol Soy JUsWpITeA Jaieduiod op juayawied sng] 
Inb sJUDWIUSIISUdI SOP IIU9}QO JUI[NIA Jd [PIPUOU 9}X9}U09 
UN SULP JUSUUOT}OUOJ S}UDI[D SOU Op aJURSSIOID UOTIOdOId 
oun nb sajyuryodurt snjd jueyne .p isa sopeuONeUIO}UI SOWLIOU 
ap uoNeIogr[a, J ‘sarqrey juos sjamidaou0s sjusWapuos 
SI] NO LI SWNIZY] DUIeIIOD OUN JUAIQJUOD SaTBUOT}eUIOUI 
SUOTUDAUOD Jd sanbryeid say] WoIdINs aq “SaATOadsaI SadIOJ 
sou juednoisal ud Juswpidel snjd Jassoiso1d suoAnod snou 
‘sayjanj}daou0d say[NoIJIp so] SuUOP 1UId ‘JaJJo UY “OATONP 
-O1d 32 ailessaogu jsa sked aud UONeIOge][09 P| ‘souTeUIOp 
sone xnoiquiou ap suep sumMod ‘1oy “ed anne.p 
‘ginjouolUOd RT 9p UOTNTOAY,] & S}daquod sap uoTeIdepe | 
qo ‘ued oun, p ‘ayInuNUOoD ke] sp UsUTeUL dT OUD sIqITINbe 
aysnf a] JOANON op JonuyUOod vIpNe] [I ‘nary Jorwoid uq 
‘xneadnou onb siarpiuey uatgq Issne 
‘sjuRVIOdUIT SIJap Sap IOAaTaI B s}Qid 9149 SUOADP SNoU sTeU 
‘aynop unone sues elaysisiod ayedioutid uoNoUoj ANON 
‘oUINS op sure jo ‘suoNRol[duio0s 
SO] JOWAD INOd SIAVT] PI JOSsIeq ole} op JoXessa ‘apeyeu np 
QWISII J] JOIJIPOW JUSUIIATIOIJJo SUOANOd SNON *(aTTOUUOTS 
-sojoid UONeULIOJ ap souUeIZ0Id say ‘ajdurexe Jed) suones 
-Ol[aue sop Jowodde ke no (asewigys-sourinsse | ‘ajdurexa 
Jed) asvurgyo np saavis snyd say slajjo soy Jotyed eB JUAasIA 
yo soumueIsold soy Ins a8ejuRAep juoWOd sanne.q ‘Jou 
-uosiod Juswiay10dw109 np uorjye}depe | JUDUIBOUOD SaINsouw 
souleyiag aidepe A,s stidde e& gy91I00s ev] sIeu ‘aseu 
-QYO ne JaIpswias yUsWIIUOD sed ang-jned suoaes ou snou 
‘g1duioxo Ivg “JOUBIOS RP] OP UOSR] LI NO DIA BS Op UOSTRI 
Re] JuaWoUTa[d sed suousidwioo ou snou onb dosed juaw 
-g] duis apeyeul np ainjeradur9} ve] aIpuoid ap sed suossao ou 
SNON “SOUIRWIOP $990 ap UNdeYO suep sje] NSai SOU JaIOITaUIe 


ZEl 


JUSUILUOD [RW Zasse SUOUdIdWIOD snou Is sUIgW JURWOdUIT 
juaWonbasuLUI sINaWap TAINS od] JOP souguIOUgYd — ‘aja 
‘QIURS PI ‘DULIL[ODS PB] ‘NUIADI NP UOTINJOAY, | ‘ASVUIQYD ZI 19 
1o]dusd ,| ‘UONRIJUL,| ‘aNbIWOUODE BOURSSIOIO P| INS sagUUOp 
Sap II][lendd1 op suoJonUNUOD snouU ‘a]nop UNONe suRs 
‘sjusutyied jUaINaWiap o1Iens-saide ,p saguue sap sawiefqoid 
sop uednjd vy] ‘aouryoduit,| ap jususes sfeyUOWIOUIOANOS 
UONUIAIOIUL,p SOUTBUIOP XNBdANOU ap onb sWIQUI SIOTY 


aseq op oueIs01d ay [9 


ATV INANVGNOA 
HIDALVULS ANO INVL Na NOILLVLdVdv.d 
YIOANOd AT :ANOLLSILVLS VT Ad 
XNVAUNNA SAT ANOd SHODNANOASNOD SAT °9 


“QTBUOTIVUIOIUI 
J[2YU99,] B SAQUUOP sap si[Iqeiedwiod PY] ‘WUSWOITepUuodesS 
‘ISSNY SIVW ‘SINS IP SOPOISUW SI] JDIOISUWL ,.P JUWETNAS 
UOU JOWId JIDI][OD WOIJS 39D “syeyNsel sina] gueduro0s 
1UO 39 SaTapOw sap djo]Id Iessa | Be Japsooid inod sasreyUOJOA 
souiod quos as sked sane .q ‘Jnoodsai sked Ino] suep sajue} 
-1oduut snjd say sastidanud soy 99Av UOTVIOGR[OD Ud JUSANOS 
‘SQOIAIOS AP SalsNpul soureyiao Inod sajuepuodsai0s 
«S3]QPOUl Sayanbud» sa] anb tsure janjdaouod siped un 1310q 
-P]9,.P NUIAUOD UOP JO ST] “UNdeYD ap SIdI0J Sop Ted JOIN} 
ap 19 SWOJJa sina] Jansnfuos ap spioap yuo sKed sinarsnyd 
op onbnsneis ve] op xnevaing sa] “aovolja apeuoneusojul 
uolWeIOgeI[OD ap a[dwiaxe uN Issne sJjo suTeWOp 3D 
“g1g7900e snjd usa snjd ap 
1S9 OUIYJAI 9] JUOP s}Inpoid sap syyenb ey] op uoNeIOISUWIe | 
op Jopied sues ‘uononpold ap oyun | MUIJap op sI[NOIJIp RY & 
UdT} Ug [God 9g] ‘sindjdas Sad sURC] ‘S[IaSUOd-syIadxa sap 39 
SUONPOIUNUIWOD9[9} Sap ‘sanbueg sap sin9joas So] SUWUOD 
‘QOURSSIOIN DIOJ UD SIOIAIOS Op soalsnpul sinaisn{d op 
uononpoid ey] susaou0d ‘un ye Ud A [I,nb 3s JU} Is ‘oINsoU 
ap suigjqgoid ay anb yuasued tnb xnao Juos xnoIqUION 
‘«anbrysneys J10U 
NOM» ap satjiyenb yso UoTeNIIs 91399 ‘sIWIOUOI| AY], WNAdI 
PR] sueq ‘sojuapgoaid saguue JSUIA xne jUdWdATeIedUWIOD 
‘SOQUUP SOIQIUIOP JSUIA SAP SINOD Ne snUTWUIp ve aATONpoId 
B] Op aouRssIoIN ap xne} ag] ‘dag sap adnoip np sKed 
sop yednyid ey suep ueynog ‘aIso;OUYde} a]JaANouU ouN suep 
S]JUDWASSIISOAUT SpINO] op sgide ayzanonpod ap syueyodut 
sues Sop & pudye,s UO ‘[eIQUaSs UW “d[deIS ,;XTK ne 
[fel Np 988 | ap sas0de | & Ja] ap SUTLAYD Sa] SUBP S]USIOS 
-SIJSOAUI SAP II[99 B aJUaTeBAINbs UONIOdod ouN jos ‘TeWdeo 
OP [210} YOO}s np judo Inod Z| ajuasgida JrdaT]OO yUSWIassy 
-SOAUL JID JSIWMOUOIT AY J NADI Bl SULP OGG[ SIQuajdas 97 
a aqnd sponse un.p sinojne sgide,q ‘saxouuo0s 
S[OIOISO] SI] 19 SUONRITUNUILUODYTI} Bp SOWIa}SAs Soy ‘sINdyeU 
-Ip1o saj suep uoNeoltdde us sastw sarsoyouyse} soy[aAnou 
S93] SUBP JUSUI}IOJ SUOSSISSAUT SNOU JUSWDATIDET[OD “dAN 
-onpoid ey ap owayqoid ne yen e ojduiexe IalWep a] 


gyanonpoid ey (1A) 


666| aiquiaedap ‘ajenbua,p sanbiuyoe | 


“SOUSIOAIUN S2] SIDA SastIdaNUS sap saouRssteUUOD 
sop xn{J 2] 39 aJUIOd ap sarsojouysa) sap uondoper,| 
‘UONPAOUUL | Ins ‘sairessao9gu JUSUD\SoJIUvU JUOIaS Inb 
‘sJusuI}od s]USWIOUSIasUdI Sap II[[IoNdeI B gOUSUTIOD efep 
SUOAR SNou ‘jInsInod as [anjdaou0d aiped Np uONeIOgrIA, | 
anb sioye ‘ysa snjd ind ‘sXked anou ap ajeloos suey ey 39 
dIWIOUOSY | JUBYONO} Inb sawigtqoid spueis sa] s1pusidui09 
xnomu op eiyjoused snou inb uonewuojul,p uonrealo 
op jenuuetinid swweis0id un sousi] sapueis say suep 
dILIO9p Isure suounod snoy “aipnoseai ynej [I,nb anbniyod 
op suonsenb sapuris sa_ sipucidwos ap suodessa snou 
‘\uoweat[esed sinof{noy, ‘sayuryodun sonbysneis sounoey 
Se] JUOS sayjanb 3a JUsUUaTNOS sal[a janjdaouo0d sped 
NP SJUSWITE sjonb JOUTWUA}ap op UlJe SaJULISTXO S99UUOP Sd] 
SUOUILULX9 SNOU “USWA QT[RIe “INDLI9}X9 JNLI[NSUOD 9}ILOD 
UN SdAR UONeIOGRI[OD Ud JanjdaDU0d sIped UN JaIOQRII 
B QOUSUIWUOD SUOAR SNoU ‘IsuTY ‘suOTsanb sao e sipuods1 
ap JaAvSSa Pp INA Ud SONUdAR SASIOAIP SUOAINSINOd SNON 

Legoueuly 
9[[9-}SO JIOARS NP UOTONpoOId ev] JUSUTWOD {UONRSI{N INI] 
QP S}9JJO SO] JUOS sjanb Jo ‘sagsIy4N say[a-JUOS saouRSsTeUUOD 
Sd] JUSUIWOD {(-2Ja ‘sayanbsip so] ‘SoJAT] SO] SUTUOD SoTqe} 
-[nsuod syoddns sap ins ‘ayjaw40J uodSey ap jo ‘souuosiod 
SOP SILOWIDUI BI SUBP ‘a[[OWIOJUI UOSeJ OP) sddURSsTeUUOD 
SOP ISVYIOIS NP SNOU-SUOARS 9NQ {$}e}[NSat Say JOS sjanb jo 
soourssieuuods ap uoTONpold PY k s]I-JUaNgiUOD (‘JJa ‘sastid 
-O1]UD ‘S9JISIOAIUN ‘SJUDUIAUIOANOS) 9}9ID0S B] Op $1n9}9as 
SIOAIP SoT UONIOdoId atfenb sueq {ayeloos UOIssYyOd eI 
Ing ,enbisAyd jusurouuoMAud | Ing {1o,dwia | Ins suorssno 
-Iod91 sa] JUOS sajand) Zenbruou0sg sourssiolo op xne} 
NV PI] JUDWIIJTOND }S9 SISOTOUYIE} P| 39 BOUTS BT SUep sXed 
UN Pp JUSWdSsNSdAut | onb IeIA [I-Isq “s9gioqol09 sed juos 
dU SUONRSgT][e Pp sIquOU sTeUU ‘a1NUd,.p dnoonevaq Ja[NOd je} 
B IBO[OUYII} PI 19 VOUDIOS LT SULP JUSWIAJeNbepr INSIAUI .pP 
queyodurt sd [t,.nb sapr,J ‘sorqnd ssoanod sap soreywoud 
SJdaf[go sap UN] SNUDASP 3$9 919I90S kL] INS dIBOTOUYII} P| 
OP 39 UIs PB] Op SUOISSNdIodaI Sap UOISUdYaIdUIOD BT 


IISO[OUYII} BI Jd BDUVIOS BT (A) 


“SIO[[IBSUOD op JR UIsIdaI JUSWOSIL] 
ednois un nb tsurte ‘gjues ve] ap Inojoos np xneroutAold 
Jo xnelapay syuRUdAIO}UI xnediouLd soy D9Av }USURULLIAd 39 
dIONS UONLIOGLI[OO Ud 9gINdEXe JSd 9JOAD NeaAnou onbeyo 
OP SIO] SagIBg}UI sarejusUa[ddns suonsanb sap 39 ajgnbua,p 
jUsUININSUI.| ap uUondaou0d ev] ‘sojdwexa sone sop 
SPO I] SUBP SUTWIOD *XNPAPI} $3] JOJUDLIIO B QUISAp aIOI[dxo 
Jemdeouos aiped uN JalOge{a Pp ONA Ud SWOJJa,p dnooneoq 
aXodeap suoae snou ‘aygnbus | ap qutod ne asi ev] JURAY 

“QULS OP JAIOIJJO oUIa}sAS VJ Dae aJQNbud || 
e sjuedionsed sap suonoviojul say Ins sjuoWoUsIasUsl 
Sd] SOQUUOP op aseq P| SULP IJOISIIUI .P UlJe QIULS OP SIDIAIOS 
sop UONeNSIUIWIpR | ap xneIoUIAOJd siaIssop xnve sjuepuodgl 
Sap SJUSWIANSISaIUS Say Ja[dnoo nod sasud a9 JUOWE[es9 
quo suontsodsip saq “(a7e]USUI g}URS RI INS gIUBDUOD 
4sa,s afoAo Joruraid af) JuoWonbrun uonsenb ua es[9A9 


JJUBAE,| Bp UONesedgaid e7 - senbiysiVe}s Seoimas seq :1H9\|/e4 


3] JUBINP sIpNie JaT[NoWIed jafns un Ins jueyod suonsanb 
ap das duN JUdTUOD aJgnbus onbeyo ‘ano u_q ‘sojue} 
-IOGWI SOPAOV Sone .p 39 [IeARI] NP ayoreuL ne uONedIO 
-ed ey onb tsure ‘ayerjmuey uonemis ev] ‘ajues ap sowie,qoid 
So] ‘ojURS OP SdDdIAJOS sap uUOTRsTyN| ‘azoedeout.] 
‘Ques op 1e19,] INS saad studwos A ‘aseq ap suolsanb 
dp sjquiasusd un pusidwi0d aireuUONsanb a] ‘IOUIWA}Ep B 
9)Sd1 99INp PB] JUOP saguuR sinaisnid ap apotiad oun yuepusd 
souuosiod op uoT[NUeYdd UN dJAINS B ASIA dJgnbus.’T 
“QUIVULOP 39 SURP SJUSWASSIOIIe]I9 
sop Joyiodde inod andu09 jsa ayeulpnyisuo, ajygnbua 
DUISION BON “9ULS IP IQNLU UD SUONUDAIOJUI SOP ULID} 
SUC] & 19JJ9,] 39 UONL[Ndod vy] ap diues ek] Op sjURUTWID}Ep 
$3] DUIZDUOD Inb 99 Ud «s}e][NSOI Sa] INS d9pUo} UOISIOap 
ap asuid» oun Iruaynos Inod sallessadgu S]USWIDUBIASUaI $3] 
INUINOJ op g119eded 91}0U UIO] ap JUassedap sa[eIUDWIOUIOANOS 
UONO® ,P SIINLU UD STATJURISQNS sIjap So] ‘11 SIOJ oUN a109U 
‘\uelinog ‘suaipeued sop suonednosoaid sayediourd sop 
d}SI] BP] Op ynvy ne yUuoWNnbNeulaysAs Issne sINSIJ 1NI9as 9D 
“9Q]UeS PR] Op Ind}das a] SULP GI INI] op Usd Nod xIp e 3das 
ap juassnsaaul ydag sap adnoiy np sked sap uednyd e7 


uoyendod e] ap ayues ey (Ar) 


‘g[qejusl uOSe] ap soslejuoUs|ddns 
SJUSUIDUSIOSUDI SUILIIIO I[[Ionde1 op yusWa;duuIs no jolns 
np uorsusysidur09 a1j0U op a]Janpess UOTLIOI[SWIe | 19}9[JOI 
op ule one] e@ afoAo un.p saidepe ong ined aygnbua,| 
‘\uopgodeid inb sajduiexd sap seo a] suep swUlod 
“SaguUOP op aseq P| 
ap uoneioydxe oursyd Be] Joinsse pp ana Ud UONRIOGRI[OD ap 
SOJUDIUD SAIN ,P 19 $}VIJUOD OP ILIVS DUN 9}N0} N[DUOD SUOAR 
snou ‘Jajjo uq ‘aJgnbus,p saguuop sap asATeur.| & ddRIS 
Jouuondejiod at suokoagid snou ‘a1oqe[9g JUOWIa}e;dwI09 
jamdeouos oped un Ans yedap 3] sap saAndde snou ap nol] 
ny ‘oajgnbua | suep sasnjoul sarqeuea op a31e] JUSWST[OUUON 
-daoxo ouIWIeS B] OP SUISIIO | B ISA ISI] BAD “JULJUd,| ap 
juawoddoyjaagp 9] ANs [OLIS}eUL JaJJo UN ITOAR JUaTeIASP IND 
SO]QVLILA OP SISI[ ONSUO] oUN JassoIp nd suOAR snou ‘aIIeyS 
-IOAIUN 19 DIIV[ODS [OUUOSIAd J] DOAV 39 SINDYDIBYO SI] IOAL 
gjqissod anb aj10n9 Issne UONRIOge][OO ouN & d0RIS ‘JUep 
-uadag ‘argnbusa | ap jutod ne ast Pe] JoyUdLIO Inod yaydur09 
Jamdaouos aiped un.p sed suosodsip ou snou ‘toy 
"INdJOaIIP a] Jed ajOd9 | op UOeN]RAY,| 19 JURUBIOSUA | Jed 
jUvjUd | sp UOTeNTeAY,| ‘oIIepoos apniyde .p saanaidg sap 
‘(STaMIUSAN STUUR Soz 19 SIIed So] D9AB SUOTILIAI) UONRSTTRIOOS 
RP] ‘asessnusidde .p no sjauuonows sawaqoid ap sao0091d 
SOUSIS So_ ‘(SUOTJETNUIIS sap jo JURJUd[ 19 sjJUIed soy 
ANUS SUONOLIDIUI SAP OINJVU) S}URJUD SAINI] JUDAQTS sJUsIed 
$9] JUOP UOdS] PI ‘aT [IWIL] LP] op oNbWU0U0d9-O190s UONENIIS 
RI ‘ASSASSOIS PR] JULINP dIQUI P| Op gues e] JOP ‘sjURJUS xne 
en JURA sayuouTpod JUDUTATTONIUDAD SOANBOI[AXd SoTqeueA 
op sues dSIe] OUN INS SsagUUOP Sap SUOT[IONdI1 SNON 
‘sanbniyod sap uonesogeya,| @ saudoidde sonbndyeue syuoul 
-dUBIOSUaI SJULWOCUT ,p JUSWIIIOI[NSaI IWWINOJ Inod anSuod 
sd aygnbua | “Uepuaedasd ‘sue gz e,nbsnf juelle spored 
aun juepuad aiIp-e-1s9,9 ‘ay[npe 338] Ip INngep 9s] JULIAN 


9E1 


quate sji,nb 30 e nbsnf sjuvjudp UOT[MURYSE SUTQUI 9] DIAINS 
ap 3sa Joalgo | ‘sapotiad sansuo] san op 1uepuad juassise 
sjesned sinajovy say ‘aurewiop 90 suep ‘oanb juoworIe[o 
JUaNbIpUL SjULISTXD XNBARI] Sd] WIWUOD ‘s[eIUSWIepUOoJ 
ZaSse UOTJSaNb 999 ANS SJUDUTASSTOIIL[IE Sop Jowodde ve asta 
nb ‘sue [| &Q op sase uedap ne ‘sjuRjua soy Ins ssnonIquie 
San seuIpnysuo] aJgnbua sun ausa0Uod a[dwWi9xd SUIaISION 
UO {aI9190S PR] ap syejsues 39 synonpoid soiquisw op 
juawaddojaagp ne jueueu Inb sinajoej xnedtoutid sa] yuOs 
sjan?) “‘NUdAdI Np ja [leary np onbrueuAp zY ke sat] xnao anb 
JUDW9}Q[CUIOD SUTOWU dIONUD JURJUd | op JUoWaddojaagp 9 319 
uoneonps, | JUBUIBDUOD sag |qoid say suoUdIdWOS snON 


syuvyjud So] Ins s3anbuy = (I) 


‘1ojdurs | op guyiqeas 
RB] DIAB SINDJOBJ S99 SNO} ap UOTIeJAI BT anb Isure ‘soXodura 
sg] Inod sjeiNsai sane ,p 19 UONPULIOJ P| ‘UONeISUNUAI PI 319 
SdIZO[OUYA} Sap UONKST]NN ,[| NUS UOTLIAI PT ‘sAoUd}adWI09 
So]JoANoU ap uoTIsInboe | 39 UOTeULIOJ IN] ‘saXojdurs 
$2] ANS sao Sa] Jo asuudaNnus,| ap jUsWIa}IO0dW0N 3] aUS 
UdT] J] II[Quie,p Issne eyoULIed ajgnbus,{ ‘aja ‘saoljouaq 
sop ‘suoneyodxa sap ‘sajyuaa sap ‘uononpoid ey ap 
INI[VA Bl SUTUWOD ‘dsLIdaNUa | ap JUdWIApPUdI Np «sjda[qo» 
SINDJVSIPUL SAP & SPIJI1 JUOJOS UOSeJ 93199 Op SI[[IoNdII 
SJUSWIDUSTISUdI Sa ‘10[dWId,| ap sJouUOIssajoid uUONIS 
-odw09 8] ap UONRITJIpoUL PI 39 ‘ayoreU Np ayt[ENUSLINOUOS 
ap gI8ap sg ‘(seXojdwia xneadanou op Jayonequia,p aonb 
10nd sirejuowg|ddns sduia} np ostej omrey B DoURpUd) ‘orIeI 
-odwia} no jared sduia} ev sinapjeaen sap eB juanbayj snjd 
SINODO ‘JUSWIIURWAL ‘JIDITJO | ap uotssoduo09 ‘a;duraxa 
Jed) JAN .p-Uleul op dIIIVEUI Ud saIsa}eVNs sal ‘(9a 
‘QYOIVUL UD STU BI Op NO uOTONpold eI op ‘q 19 Y BI OP 
QUIVWIOP 9] SuBp SastIdaUd SIN ,.P OAV UONLIOGR][OS P] 
‘soyoreul XNBIANOU op INs uOIsUuRdxa | ‘s}Inpoid xneaAnou 
xne saplosoe sourwoduil | ‘q 19 Y Pl ap IOI 9] 10 saqI0d 
Re] o[dwoxe sed) astuudanuo., ied satatnsinod sarseayens 
Sof Ins ‘sgAo[dwia xne sWaJJO UOTPULIOJ B] INS ‘satso[OUYyoa} 
So]J2Anou sap uoNeorydde | ap seyod zy] Ans sjusuIBUSIasUdI 
Sop WeIWUINOJ Jasijea1 suoisgdsa snou oanb aygnbua,T 
“asQUUOT}O<IaS BsLIdaNUS,| sURp 
1o[dw19 Ine] sp UONessao P| Seide osreyUowgtddns sauue oun 
SUIOW ne juBpuad jIeIAINS UO | aonb sao; duia sina] ap UOT 
-UBYD9 -SNOs UN SLUIdUWIOD A ‘xneBIOIOUIUUOD SJUSUASST]QuIa Sop 
sgidne ajusueuliod ayeuipnyisuo] ajgnbus oun ,p aytjiqestey 
PR] JOUIWIA}9p Inod ajojId tessa uN 9INdaXd SUOAR SNON 
Lasudanua] op assnei op jueyoduit juswsl9 
UN 9I[9-]S9 (S[OUUOTISedDO NO saIeJOdwiay sINaT[Teael] xne 
JO DURE] -SNOS RT B NIDNv SINODaI) saydnos 1o;dwia ,p sail] 
-epow ap uondope J ¢«safqeief» 11uaaap ap sjI-juanbsu sasty 
-eloads nod sgXojduia saq {saXo[dwis sap juawouuonseayied 
9[ SULP OSeIULALP INSOAUT yNey [INb [I-1-alJlusis atso;ouyse} 
el JosI[aN.p Wey YT {S}oJJo soy juos ua sjenb ja jreaen 
OP NOI[IW Ud I9ST[IIN J[[9-1S9 UONLULIOJUL | 9p BISOTOUYDE} P| 
xneq jonb e ‘ayduroxe seg ‘[IeAvN] op gytuN Jed uononpoid ey] 
12 sostidanus sap sonbyeid op aiquiou ureyI90 UN aUA UAT] 
UN JO}SIX9 WeLINOd [I ‘askyeuR algtUOp Ua _nb 3a anbrwiouoss 


Sel 


-O1OTU NRaATU Ne Nb ssipnjig aj JUdANad ou sTANONpoOd P| 
@ SJNeIaI syey[Nsei say aonb snjd ua snjd ap suuodsdnos uC 


saAojdura sa] 1nod s}e3[Ns9.1 sat 42a 
Is11d3.1jU9,| Ip JUIWIPUIA J] 9.1JUI UOTIVIIIUT,T (I) 


‘Iopneyeyoe 
BR weiaiod saguuop sap asdjeue,, onb sasaujoddy 
S9[[@Anou op JaIpnja Inod sosteyuswistddns suonsenb sap 
Jasod ap ajqissod juawiayese 39 [I stew ‘soyerpmuey sonbnsi 
-J108IRD SO] 19 [IVA] NP gYyoIeUI Z| INS saoUatIadxa soy 
‘NUdAAI J] INS 9seq ap suoNsanb sap puaiduros ayanbua J 
“PPLURD Ne JUASSISE SddIOJ SAD JUOP 
UOSP] LI INS SI9STUBSIO JUSUI[QVUSAUOD SaguUOP 9p UIOSaq 
JUSUISTNIS SUOTAR snouU onb jo sajuvIgdoO sadI10J sopuLIs 
Sop oinjeu P| efap juorestogid saipqnd xneArd soy ‘oureWop 
20 suep ‘aonb guiisd suoae snon ‘ajygnbua,, JonjoAg 
alley ap ayoedes vy MOAR .p aytotdxa Jnoofqo | Jed ‘urus 
‘Ja SaQuUOPp Sap asATeUP | 19 aJgnbua | JIOAIDUOD ap oNA Ud 
SOUSIOAIUN SI] 19 DIQHeU RP] US oNbITOd x] ap afqesuodsal 
arajstur jediouud a] ‘epeuea onbusneig aque ‘jutod ne 
ISIU BS JUIN ‘d}101}9 UONLIOGRI[OD ve] Jed “ayjo B asned ap 
SUONPIAI S3] IIPQuia ,p JoAessa,p ayordxa Jroalgo | 39 apeulp 
-NUSuo] sinjeu vs Jed ynoyns astigjovIVd 9s sUWURISOId a] 
‘OIINS Op ISUI® Jd ‘SAT[MWUL] SaT[aANou ap 91}9-]Ned JUOIOpUoj 
19 [l[IWIeJ IOAOJ J] JUOIJONINb sarquiowW suIvyeo onb ainsow 
B ‘NUDADI SP 19 SNAOV,P SUOTINIIS SASIOAIP JUOIAIA STI 
sajjanbsa] yuvInp saguue xISs SUIOUI Ne JUBpUdd STAINS JUOIIS 
SOIQUISUI S3] JUOP Sa][IWIe} ap UOT[HUeYDE UN Ins oIndde;s 
IL ‘senbrjduioo sauayqoid sao Ins sgn] eB] de} Op oNA Ud 
juoueuied suweIs01d UN goUR] SUOAR SNoU ‘epeUuRD NY 
Loueneal ey e 1ojdwa | 
ap 19 aBeWUIQYO ne 1o[dwia,| ap ‘[reaey ne 9[099 | ap Salssnad 
UOU 39 SdIssnal suONIsUeI) Soy JUONbITdx9 sinajoR} stond 
{«tojduia un e uo,] Is anb asinboe ang ynod ou souatadxa | 
onb sre ‘aouatiedxa | ap a31xe lo[dwia un ,p a8eyoo.l0ap a]» 
aonb Hej Np JLI[NSAI XNSIOIA B[91IO 9] JASLIQ B S]I-JUassIssndl 
‘sallepuosesjsod sapnig.p 11ej sed quo .u Inb xnao JUSUAIaT] 
-noried ‘sinawigyd sounoaf say suonipuos sajjonb sueq 
LUOTENIS INI] & VdeJ D1IeJ UdIG B S[Nas sjusIed sa] Jape 
JUS[QUIDS XNRJUSWIOUIBANOS souUeIsOId sjonb 3a sayjou 
-uosiod sanbystigjoevses sayjand {ajoraned vy ev soddeyss & 
Sd][O-JUDSSISSNaI SotANed sa]MUey SdyT SdouRSUODIIO satjanb 
sueq :juasod as sajyuryiodun suonsanb sinaisnyg ‘soyer[muey 
onb Isure ‘safauuosiad saouR}SUODITO SOT 19 SUATIOR | ‘NUDADI 
J] 91]UD UONLIAI PI Op INJI0 3so awa] Goud 9] ‘ayerguas sny{d 
uodseyj oq “(«a}o1ANed ke] OP XNIIOIA B]OIBO» a] suep sastd 
souuosiad soy Jed guio0j) yuoueULIed-mues opuoul-yenb 
UN.P IJONJUSAS douRssIvU PI 39 B[NODEp Ud INb sJoJAned 
Rl ‘Ada VSVWIQYD Op xne} UN,p souRsisiod eI Isa Jdag 
sop odnoiy np shed soy a0vj ourey yUaATOp janbne yueyodut 
snjd 9] suetqod 9] ‘anbruou0d9-0190s sureUOp 9] SURG 


offre 
B] 9p 39 NUDADA Np ‘[IeaAv.y np snbrureudp eT (1) 


‘(SQUYBOXS) SITQRIIVA Sone .p 
}9 KUONUDAIJUL ,P SIDIAD[» SIOAIP OP DANLIOI BOULLOdUI ,| ap 


666| dIquiadap ‘ajenbua,p sanbiuyos | 


ask[eur | & d[[ANUIsso a]qQufesid UOTIPUOD ‘s}P]A1I0D SANZ] 19 
$]P][NSII SO] INU UDI] 9] II[QeIa Pp JUaoUWIEd Inb saynas so] 
JUOS So[BUIPNsuUO] sajgnbue say anb stew ‘sauguiouaud soy 
Jo][I9AINs op JuaeuLed sayesiaasuey) saygnbus say anbsind 
Queusidins a1gnd jsa,u uoneniis ayad ‘sareurpnysuoy 
sajgnbud .p suo} ve] JuUdUUSId saATeNIUI $90 op uedny{d eT 
‘saqur}[Nnsai saguuop 
sop asdyeur.| e& does jo;duioo snjd jamdaouos aipeo 
un Jo1OgR]9,p 110dsa | suep ‘aTeiguas san aignbus oun sed 
JZOUOWIWUOD 9p Sploap SNOU-SUOAR IssnY “(SddIOJ S99 a1]US 
Soaxo]dui0d suOTORIO]UI Sa] dINJOUT sus sIeUT) satqissod 
SIOIOJ SO] S2IN0} 9p ajo] dw09 yUdWS|qeUUOSIeI 9ST] JUN aN 
suoosnf snou onb 99 onb ‘sasreuayied sou dace UOTIeIOge][OO 
ud ‘Iassoip nd suoar,uU snou ‘JuRjUd,| ap jUaWdddojaAap 
np 39 uoNeoNnps,| op seo a sueq ‘uoneoydde.p sinos 
Ud SIJIPOW 39 sagUUOP Sap UdXAOW Ne ayins ve] Jed ayo 
elas Inb Janjdaou09 aiped uN,p sauSI] sapuvis soy ItuLep 
op ona Ud jURYOdUII WOJJO UN INUASUOD plOge Pp Op UO 
‘QISOTOUYDI} L] 19 DOUDIOS B] NO 91ULS L] SUIWIOD ‘sauIeUOp 
sone p sueq ‘[Ieael] np 3a nuaadl np onbiweudp vy 
OP SUILUIOP 9] SUBP SUIUOD ‘sgIPNId $}eI[NSaI SI] INS S9dIOJ 
$30 OP BOUdPIOU! | JUOWIDAI}e}UeNH JaUIWIA}9p B dISISUOD 
gedioutid ayor) ev] ‘sajurtodo socio} sap ainyeu ey e yuenb 
JUSPUDUD S$ SJULUDAIDJUI SIOAIP SO] IS “SARTO souLVOdUII 
Ind] JaInsowW 39 sajueIado sa010J sapueIS So] JUOS satfanb 
Jasiogid yp juswadNe ‘Jatnoned onbyijod ap ourewop un 
INS SIQMUUN] LP] WIeJ B JOSIA OP 1S9 SOANCNIUI $99 op OUNUTOD 
onbystugyoeiws ey ‘sanbnijod op alanew us sijap sop 
JOAI[OI VIPNVJ [I ‘UOTXaTJol ap adno13 9] UOTaS ‘NO sind}oes 
So] d0Ae ‘onied opueis ua ‘JUapIooUOD Inb saulewop 
xnaiquiou op suep saguUOp ap soulayshs xXneoANOU 
op quiod ne astm vy stidanuo e epeued onbnsnes 


epeues onbysyeys 
B SaguUOp ap sauia}sAs xneaAnou ap sajdwiaxy = 7S 


"SQUIBOX SI[QVLIVA OP SULIOJ SNOS S[aIIO}NAS SOT@pOUr 
So] SURP S}aJJo S90 ap ajidulo9 IMU} ynod uO ‘sIOJaINOL 
“QLIL[OOS OP NRIAIU 9] INS DDUSPIOUI UN ‘Issne Id ‘e g]UeS 
eR] aonb srew ‘9jues ey Ins xnop sno} JUaNTJUI dILIeTOOS Op 
NVIAIU J] 19 NUDAI 9] ONb es UO ‘ajdwioxa Jed :sa[[at10}00s 
souvpusdeplajul sayueyoduit p ajstxa [I,nb suoAes SNON 
‘(L661 
UOSJJOAA 19 I8a][9J) UONsenb ua Ina}oas a] sIpudidu0S 
xnoIwW ep sieued snou Inod yuowisyersads yno} julod 
NY SMW 3119 JUDALIOP S| ‘[a110}DAS JUSWIOPUII 9] INS s}USUI 
-OSSIOIIV[O SAP ILUINOJ JUDATOP S9QUUOP ap SOUIA}SAS S23] IS 
(‘araneu ey ua yedrourd ajo1 a] sutow ne anof no uonsenb 
ud Inajoes np sauweIs01d sap ja sanbyiyod sap sirqiq 
-esuodsal PJ [Nas In] B SUINSse O19]SIUTU UN “JUUOIIRUIPIO 
‘oIINs ap Isure ja ‘sanbruouosgo10eUW sanbiytfod soy ‘[reaen 
Np sgyoreul soy ‘uoNvONps,| ‘aIURS PR] SWIWOD ‘saI[NoNed 
XNPJUSWISUIOANOS saumueIs0Id sap 39 sanbufod sap Jed gsta 
UIVULOP UN IDI BJOUPP «IND}OIS» JOU IT) “o}INS Op IsUIe Jo 
‘govolja snjd uoneonps,p suiaysAs 9] dIpuas ‘uone[ndod vy 
OP QULS LI JDIONOWIe ‘9SLUIQYD 9] SIINP9I OWIWUOD ‘SOLI0}9ES 
sjnoafqo,p osuoj snos saeuiidxa sinofno} onbsoid 


JUBA ,| Bp UOIyesedaid e7 - SanbysHe}s seolues seq :16e}e4 


JUOS $]e][NSII Sop SdaINSOW so] ‘«afeURq» UONPIapIsuod 
a1100 wed e osTW ‘sIOJayno yy, ‘suONBAIASqO sap saouanbesuo0d 
SQ] JOIpNId ,p 1S9 UONDUO}J L] JUOP ‘UOTyeULIOJUI,| Jed sassal 
-91UI SINdpIsap op sdnojs un d}SIxO [I NO oINSoW eT sup 
anb sjusuryiod yuos ou saguuop ap souraysAs sa] ‘o7a ‘asonsnf 
RP] op ‘UONeONpY,| op ‘ajuRs PI Op ‘oMQ-UdIq Np ‘aLNsnpul.| 
op ‘dJOWWUOS Np ‘[reaeN np sgyoreu soap jo soureuNY 
SOINOSSII SOP SAUTRWOP Sa] suBp sanbiAI[od sa] JaI0QRII,.P 
S9SIVYO JOS SJOUNSIP SOUISTURSIO SaTINe Pp 1d SOJQ}SIUTUL 
SAC] “SI[SUUONDUOJ NO Sa][9110}09s UONROILWIOP Op SOUBT] So] 
JUSAINS SOQUUOP op SOWa]sAs xNBdANOU Sap JUIOd ne IsIU P| 
onb sarajgid ap onbuesd ey e,nb puoj ne jue} ueUS} suOsTel 
Sop d}SIXO [I ‘sanbruouods 3a xneIoos sauguiousyd sop 
sourpuadepiaqut | snjd ua snjd ap wWeuuodel UO | Is OWT] 


$3] [9110}9as JUOS sajIIN 39 sanbyead sapoyjgul say (A) 


ee) fe) eR 
op UOT}Oas dIJNe OUN SUP safduiaxd sanbyanb yusuIaAgTIQ 
steIloep of ‘syueyodut sonbnijod op sourewop sinorsnid 
dipusiduiod xno e juapre Inb saguuop ap souiaisAs 
SOP IIOAIDUOD dp dNA Ud sayUROdUUT saANeIUT sInoisn{d 
goury & epeued onbnsiyeisg ‘oreysIoAIUN opuow Np 1d 
oijqnd 1najoes np soireusyed sas 9dAe UOT}RIOGRI[OD UY 
‘jneJap JUOJ UdTINOS 
ap saguUOp ap soWiaysAs sa] 39 sfonydaou0d saiped say anb 
doled ayqissoduit sa «s}eI[NSal SI] INS V9pUOJ UOISID9p op 
astid» onpuajaid ey] no sonbrytjod ap sinajdes say Issne sTeu 
‘sanbrjsijejs sounoey] Sa] JUOUa[Nas UOU JUOS sarfanb Jasto9id 
ap Wemouted snou tnb jurod ne uarq onbyyAyeue oururess0id 
un 90e]d Ud 31]9W SUOLIADP SNoU ‘alIeUOD NY ‘apre aoU 
jUuspueWap snou so;jne _p aonb sipuaye ,.p oitessaogu sed yso 
SNOU OU [J “S[ALDIJJO SUSIONSI}S Sop ‘IOUSI[NOS J] B sudT of 
‘stiduioo A — no ayoduit,u op stud jnad snssad0Jd 9] J90uUR| 
op ona ud uors[ndurt /J ‘aayonpoid jos ajja,nb 39 asiW9I19U0D 
as osinbal uONeIOgeR][OO aJURWOdUII | onb [anuasse 4s9 [] 
‘JoJJo B BsNed Op SUdT] Sop UONeUTWID}Ep 
RI & a[qeieoid UONIPUOD — saTjanjUdAg sayesned saTqeueA op 
QUIWULS SUN & S}PI[NSOI SI] JOINOsse .p ‘SaTesIOAsUeI] SOQUUOP 
sa] onb ainsau apuei3 snjd dnooneagq oun suep ‘juayjouLIed 
SO[VUIPNIUZUO] S99UUOP SIT ‘NUdADI JJ 19 [TeARI] NP gyoIeU 
a] no YUudUAUsIEsUd,| ‘a]URS RT SUTWIOD soUuTeWOp sap 
SUPP SJHLISIUTLUPe SoUa}sAS Sap NO sayeUIpNyTsuUO] saygnbue 
sap JuaAnos snd ua snjd ap qos sauaysAs sao ‘aouatIadxo 
anou sade .q ‘uoneordde ua sowiaisAs soo o1]0W B ‘spuoy 
SO] JOSI[IQOUL & JUDALLIP SIS ‘Jd SOITeSSdd9U JUOS SaQUUOp op 
saulasds stanb ‘saperoos saouatos sap saystferseds say 3a sanb 
-Iy1]od sap sayskyeue Sd] S9AR UONPIOGE][OO Ud ‘JOUTUIO}Op 
B siamueid say ang Issne yoAIop st] ‘unwWoddo juswWO0UI 
ne sgiidoidde syuswiousiasual op oinqytuinoyj ey a3txa,nb 
dainp ensuo] op yuawaddojaagp ap snssao01d np yUWSOUR] 
a] — SInapioap sj — xno inod e,nb onbyw9o souryodult,| 
AP SINIPIOYP Sa] SIOUTBAUOD & SIOTWUId Sd] 919 JUDATOP S|] 
‘auedi UoNesogR][Oo ap a1ues 99 suep jURLOdUII san 3[QI 
un quoJonof anbusneis ev] ap xneoing Soj ‘JUSUOTTOINIeN 
‘yuouanbiidwis saepryea sasayjodAy say 39 saynny 
suontsoddns sa] aud UOTOUT)SIp P| dle} Bp JUOMOULIOd Inb 


vel 


sjneijuenb syusWsUslosual ap 9OUdISIXd,| OP LIOIOIJQUIG 
SQ[BIDOS SADUDIOS SAP SUILUOP I “JUDWITIT[eIeg *S9]ULISIXO 
SOLIODY} SI] JBIJLIVA Inod Ja[quiod op uatAuod [I,nb senby 
-SI]e]s SoUNDe] Sap aseisideap o] suep yelonso sfOJ un JoNnol 
juaIeIAep sanbydjeue Xneaed} SINT] ‘SaOgy} So] JOIJIPOW 
ap 19 JOIJLI9A ap ja ‘syuouTIed souguiougyd say Ins sjuoW 
-aSsIolle[oe sop Joyiodde ke sauljsep syuswINysul sap uoNdad 
-U09 P| JaM]IOeJ ap ‘sajuvINOD satIOgy) sep ajdul0d ouUaT} 
uo, onb Joinsse,p ulye snssaoo0id ne yuodronsed sayetsos 
SQOUdIOS Sap saystfetoads say anb yejuswepuo} so I] 
‘anbiytjod ap aianew ua suondo 
So] 10 dor] us xneUSUISUIOANOS souUeIsOId say JasATeur ,p 
NA UD S]ULISTXA SaQUUOP ap SoUa}sAS Sap 1d Sa[epouw 
sop uoneoldxe | auJa0U09 INb 99 Ud aI[9Ee1 UONPIOGRI[OD 
aun jo (onbnsneis ve] ap neoing np spuoj op sopuewop 
sop tndde J uaiq no) OaIIp JoroURUTy UdTNOS UN ‘TROUT 
UdIJNOS UN-IIOARS B ‘SOULIOJ SIO] SUIOW Ne sIpudid yop 
anbiytjod ey] ap afqesuodsai aiajsturw 9] Jed yajjo uannos 
YJ ‘Saeloos saouaros sap saysieroeds say 3a anbysye}s ve] op 
neaing a] ‘sauI90UO9 a{[al10}Oas onbyI[od ey ap afqesuodsal 
QQISTUIW J] JULGOTSUD dAISUdIUT OYVIedL UONeIOgR][OS ouN 
sues yindj Jayod ynad ou sinbar jso tnb yueyodut W0JJo TJ 
‘slidwioo [ew soueyqoid 
sap aipnosal Inod snduo0d xne\UsUISUIBANOS sowUeIsOId 
sop Injao e& JUOWOATeIedWOD sIqQIe} sa Weed nod 
JI ‘ajqeasljsau uou anbiongd ‘saovojo snjd soumuess01d 
ap 30 sonbiytjod ap uoneiogeys,| & ailessaogu UONIPUOD 
OUN Pp JUSUID}SOJIULU J13e.S [J “WOIJO,| JualyNsnl syuvnsnsy 
snjd sat 1a sjuessoid snjd say sanbruouo0ss jo xneI90s 
sowugiqoid say_ juapusaj-snos inb sao10j say sipusidwi0o 
XNOIU SP I[QNSISaUI ULlOsag YJ ‘asnaniquie WoO} astdanue 
oun ajuasaidal 1o1 ayLIOap onbysiyeis UONN[OAY,p a1ue3 FT] 


saisoid ne ajqesuedsipul 
UOIJIPUOD JUN 7UOS SjelIeUs}1ed saq (AT) 


‘Q0UdIOJOI 
OP dIPed NP UOISIASI LT B JOUSU ‘N[NOA sduia) Ua ‘ja Sorte} 
-usulg{ddns sjyuswasstole[o9 Sap 19 SUOILIOI SaT[aANOU Op 
INOSsaI OIIe} WeLINOd saguuop sap osAjeur | ‘Isa snyd Ind 
‘soqueyioduut juos inb sajjao ap sassnod snjd uonelogeys | 
B 19 (jsonbisojoespr sawizop say ‘ajduioxea sed) sajyusutzed 
UOU NO SdJURIJIUSISUI SUOTRIAI SOP UONLUIWITS,| B INNOGe 
JUSIVIADP SII :UOTNTOAS Ud [anj}daoUod sped 9] Ins apuojoid 
QOUONTJUI DUN IIOAR JOIRIADP SagQUUOP op saUa}sAs So] 
‘ued one .q ‘ddUudI9JeI Op oped oI Jed sagjuaseidas suonoe 
-I9\UI Say JaWuenb ap yuayoutied nb saguuop ap sowie} 
-SAS Sop UONNOAY, | JOIUDIIO WeIANp [anjdaou0d sped J] 
‘ued oun qj “oinsaul ap oura}sAs un e JUaWIoNbrweUAp gdnoo 
ong .p wey ne sandepe yo onburdurs sioj ey] & ay[NN Uos yUdT} 
[J ‘enbnejs tu Wensqe tu jsa,u a[tyn [anjdaouod apes u, 
“SJaJJo SINZ] 
OP UONIEIIP RI 19 SUOTIORIOJUT sINa] studuOd A ‘JoTpNoNWIed 
QuUIeWIOp UN suep sajURIodO sadIO} say ‘JUoWaNbNeUIaYos 
SUIOW Np ‘19}9]JO1 BP 9.199 JOP Sal[anuassa sonbysi1ayde1ed 
Sop uN, | ‘TOU B JURNA “SISIOYd suOAR snouU aonb sieI[NseI 
OP SINDVOIPUL SIT INS JHROTJIUSIS JUSUAT[eENIUDA JoTJO 


cel 


un juo Inb sajuviado sao10j sap ajuvINOD UOTsUsYyeIdUIO0D 
Nou op JUusWssneynuMU aINysuOd sseUWT sUN.p 1OjnN{d 
W13e.S |] ‘olIO9y) ouN ‘Ios ua ‘sed ysa,u famjdaou0d sIpeo 
a] ‘onbnsnejis suraysAs un nod yenbepe janjdaou09 oped 
un.p sinjonys ey e@ Juenb snsuasuod uNone d4STx9,U [J 


3[qeuvoid uoIpuOs 
3UN 482 [anN}d99U09 dIped UN, p UONIULap BT (I) 


‘janjdaouos 
aiped uN Ans ‘Ip jUsWAINe ‘soURpUddEpI}UI INI] ap 39 
sjusutyied syesneo sinajoerj Sap speiguas sanoedsiod oun ins 
Japuoj as JUaTeJAOp sonbijtod sap uoNRIOgE]E ,.p aaVeUI US 
sjuoutied soguuop ap sauraysds say ‘Juanbgsuod Ieg “ayuesS 
ap aulaishs np sayeoipsul suoMUdAJO}UI xne.nb [erprwey 
NUSASI Ne Jue Ne Jud} ynod gues op 3e}9,] “UOWT[IOIeg 
‘DAQIP,| OP sensei soy Ins ajuvyodunt juswosetpnonied 
uodsej op sed onijul.U JUBUSTIOSUD-SdAI[9 ONLI I] NO ass 
RI ap Jnoojjo,, onb juswaeigues Weuuodel uo ‘aj;duroxa 
Jeg ‘sjuvyoduit snjd say JUSWIoIIessad9U JUOS STOUUONIpeN 
UONUDAIOJUI ,P SIDIAZ] SaT onb sasoddns suoanod ou snoN 
UONUSAIOJUL ,P SIOTADT SO] 
QUTWIOUSp SUOAR snoU onb 90 Ip yUsWaTNe ‘oI[qnd y919}UT ,p 
SOINSOUI SO] 19 SILI[NSII Sd] IUD UOTRIAI RI JOWIBOSIP op 
saiskyeue xne 3d SINdJBAIASgO Xne JUd}oWLIEd Inb xno yUOoS 
San JUSWUTeIA SonbINSHeIS SOWIQ}SAS So] IssnYy ‘uOne[ndod 
PR] Op gues Pe] JoJO1faure INod sajdaIIP somnsaw sop sipusid 
ap Iu ‘alqeinp rtojduid,]| JUSWIA}D0IIP 19919 op s]qissod 
sed jso.u ]I ‘ajduroxa sed :0)090NIp UONUSAIOIUI | B USUI 
-alel jUd}gId as 919190S B] ap soWI[N sJrydafqo sa] ‘sores 
-OUIap Sa] SuBp sUIOU Np ‘anbsind sjuRstjJnsul UOS syeI]NSOI 
OP SINSIBSIPUI SUOG ap “JUdUIgTOSI Std ‘stofyayno, ‘satqe[eoep 
uoU NO ywUOS saIZ01d sap Is Juonbrput sjt,nbsind ‘syyoafqo 
Sd] SIOA UOISSaIBOId PT JonTeAg Inod sailessaogu JUOS SINI}Vd 
-IPUI SdD ‘san seguuOp op sua}sAs uN,p yuIod ne ssw 
PR] op odeia argtwiaid ve] anjt}SUOd Sa[qeINSoU JUSWIITIORJ 19 
aiyenb ajney ap sjey[Nseai ap SINIJBOIPUL,p UOIIIULJEp eT 


quejz1oduit Judafqo un 4sa sanbyyod soy 
}2 S}e}[NSII So] 9.1VU9 UdT] UN,p JUIWIISsT[Ge}9,J (I 


‘uolvonp?s,| Ins sanbysiye}s op apn 39 JUoUNIEd JUOWTRIA 
auiaisAs un yulod ne aijaw nod aipuodai Ap januessa 
JUSUWID}SOJIURLU }S9 [I STRUT ‘SaTIOLJIp yUOS suONsanb sad 
{SINGLE SIO op oIINe | NO UOSTeUTQUIOD aUN JUd}UaSaId INb 
no UdKO}D UO UN,p SINa[eA Sa] JUaSseIqud Inb ‘aandepe 
uodsej ap asessnucidde ina] sourgui-sayja arAInsinod inod 
Sallessao9u saoua}eadwi0d say stnboe yuo nb ‘sagiqiinbe us1q 
juos tnb ‘[reaey np syosew 9d] Ins jUassIssngi Inb souuOs 
-Iod sap olmnpoid jlop yuaWOUsTEsUd Pp sUE}sAS UOg UN ,nb 
snou-suosudg ‘stjdurosoe saisoid soy Jon[eag,p sudo 
xne Iu Judafgo 390 ap aayiod vy] e& yuenb [eJguas snsudsuod 
UNONL 9ISTX9,U [I SIVUL JUDWIDUSTOSUD ,P SUIA}SAS 9] JOIOI[OUI 
@ IJOSIA Op d9p!,| Sno} suoAnosdde snou ‘Isury ‘s}eI[Nsel sop 
SNUUODAI JUSWII[VIDUSS INDJVOIPUI UNONe d}SIX9,U [I ‘TRIOS 
SUIeWOpP I] JUSWOIITNONVIed ‘sinajoos XNoIqUIOU ap suep 
‘anb yey ne yUdaT} saqNoIJIp op ajueyodui soinos ou~) 


666] aiqwecoap ‘ajanbue,p sanbiuyoe | 


“SOJUSIOIFIP 
sonbnijod sap imoAnowoid jUoWeT[anjUsAg jUaTIeYyNOS 
inb sia sap sed sgy[nsuood ang juassind sjuauroustasual 
SIpse] aonb ja yuatos Inb sinay[low say syUsWIOUSIasUdI So] 
INS JUBPUO] 9s UD SasT[RaI JUDIOS XNeJUSWISUIAANOS syndafqo 
Sat onb sno} op igJ9}UI,| SuRp 3So [I :anbysiyeis ouIaISAs 
np uonesnfod ey ru sanbnijod sap asuajep aun tu puajus 
-SNOS QU UONRIUSLO 319d) “JOSUOAR] JUSTeIAAp Jal[NoIed 
QUIeWOp UN sup ddRId Ud SIU UOTIOR .p soWWUeIZOId say onb 
syey[Nso1 xnedioutid say aipusidui09 ap ana usd VWOJJa uN US 
91SISUOD S9QUUOP op SOUIa}SAS XNBSANOU 9p JUIOd Ne asIU P| 
op odvj9 osgruaid ey aonb anbiso] yuanbgsuod sed js9 I] “satqe 
-yeyNos sanbmuou0ds o1900s sJrdal[go say sIpuloNe ,.p sadvo 
-IJJo snyd say SUdAOW sa] JUST QU[QUIASTeIA JUOIO}UaSeIdoI 
nb sjusutzied «UOTUSAIOJUL ,P SIOIAD]» Sd] JOWIZOSIP ap ulye 
soyeJUsWIOUISANOS sonbyijod sap uonelogeya,p snssaooid 
QJ Jouploey e aystsuoo yeuly Jnoofqo jueyodut uq 


$}¥}[NSaI Sap sajusujAed sainsaul 
sap ans zaAndde;s yop juawiaddojaaap aJ_s(1) 


“QUISIURSIO 190 Jed IANO Ud SIL SaQUUOP op 
sowlg}sAs xneaanou ap sa[dwiaxe sanbyenb resouuop af ‘sing 
‘epeurd onbijsiejs & SJAINS Op S9dIOJJo SOUTWUOS SNOU snouU 
anb s[e19uas d139}v.NS SUN ,P SJUDSUIET9 SO] SUSI] SApULIS So] 
suep Ieilogp of ‘uonses ajuosaid ve] sue “a[loryip snyd yuour 
-9}]9U SYR} OUN jsa ‘sJaJJo SINZ] JOT[IOAINs yUdWaTduuIs anb 
1OjNId ‘xneId0s 39 sonbrwoUodg souaWIOUsUd say Ins s1QTUIN] 
3] curey onb sastogid udiq suOAdp snou ‘juepuadadg 
‘(L661 UOSHOM 12 189]]2,4) JoNe[I9,] B JonqNUOD ep iQIN|d 
stew onbrytjod snssasoid ne anqune a[O1 9] Jedinsn .p sed 
UOU HBL ;S [[ “‘UONUDAIOJUL ,P SIDIAI] SISAIP OP SO[QR[QUIASIVIA 
$]e][NSII Sd] DoUBINSSE DdAP ITOAQId IOANOd ap ulse ‘saqUeI 
-9do sad10j say o1pudidwios ap JaAessa Inod sye0u0d ojo 
un ole} JUSATOP sored soy saynoy ‘syuedtonied say sno} 
ap suorutdo say 1ar9duu9} onb tsure tuajnos inod sayuourjiad 
sonbiio9y} 3a sanbiuiduia saguuop op Jasodsip ap januassa 
4so [I ‘stojajnoy, ‘sanbyijod ap uontsodoid ey] e yuaUQUI 
anbryjod a1Z0joapt,| @ sean3nfuood ‘sjuRUdAIOIUI S30 Sno} 
ap suotuido sa] 39 soustiadxe J ‘aatid 39 otqnd sinajoes 
sop onbnijod ap saysAyeue say 39 sInayosayo say onb tsure 
‘sargtfnorjied sasneo sap yuepuajep sodnois sa] ‘orqnd 3] 
‘suatontjod say ITUaA19jUI JULSTeJ BxXa[dWIOD snssaooid uN 4s9 
sonbnijod sap uoneiogeya J “‘s9[o SoureWop sa] suep sortqnd 
sjeqep Sa] Jorlejoe nod sairessao9gu sanbysneis sowiaysAs 
XNVIANOU $9] JUIOd Ne dI}OUI B 9]SISUOD Jap NP INwWd IT 


3139}e.1}S 9UN,p SJUdIIJI SAT [*S 
SHANNO Ad SHINALSAS XOAVHANON 


Ad ‘ANOLLSILVLS V1 ad xnvaNnd 
SAT ANOd SHONANOASNOD SAT *S 


‘anbnijode aytanoolgo .J onb tsure sowuiesis01d sop 
dousuIed vy JopIVBIANes ¥ Jd JaINsse & BOUNSOP «dINILI9}X9 


JIUBA,| Bp UOlesedaud e7 - senbysiyejs seoimes seq] :1Halje4 


aisajes» oun Jajadde yeunod uo,, anb 90 e aasoRsuOd 
UOT]I99S BUN ‘UIJUD SaININj UON[OAY ANI] ayeULIEd Inod aires 
-S999U d[[BUUONesIULSIO assa]dnos eI 19 aseq Op soWWPIZOId 
sou e sonbiydde ve sarsayens say ‘sautepoe sorjqnd syeqap sap 
aIOULIAd Inod jo J[BJUSWIIWISANOS UONUSAIOIUI ,P SOUTRULOP 
SQ] ANS STUN] eB] dITeJ Inod sayjanuassa saguUOp saTJaAnou 
Op soulaisAs xne JULUDU SAYSIPUUEP S29] 19 sayquyeaid suon 
-[PUOD Sd] :SAJULAINS SUOT}OAS Say PIPUdIdWOD INb ade | 
Op dINs kL] OP SdUIIY} Sd] JUOIIS s]UDUIZTS SION sad 
“guanjoalgo | 
19 ouyiqeidepe | ‘aououtjiad vl juOS JOYydIOYOOI sUOADp 
snou onb sajegpt sayyenb sion say “sAtN[OAs duOp — a}snqol 
JUDUITLS9 SIV ‘asNaloVpNe IQ VIAOP dISaIeNs aIj0U ‘sIJap 
$90 B DORI SIV} INOg ‘aANSE[go spuLIS ouN,p Issne Sieur 
‘guovordsiod opueis oun .p sAnaid yuesiey ud — s]UdUassIO 
-Ile[o9 sop Jawodde suosaap snou o1qnd Jgsajul .p aue;qoid 
enb ins sJastogid ap afloljip snjd ajnop sues vias snou 
[I ‘Allessao9gU IOS UONPULIOJUL,p a1Ua3 90 soureWOp stanb 
SULP IOUTWIOJOp & JUSUIITQUIQUIDSIVIA SUOIOALe Snou onb 
sioye ‘sulowuraN “sjusoel-snos sanbrueudp souawiousyd 
Sd] INS S}UDWASsIOIIe[N9 sop JoyOdde ve yUSWOTOI[dxO IJOSIA 
J9 DOULT[IOAINS B] Op sped a] Jossedap inod snduos saguuop 
op SoWgisAS XNVIANOU dP Jd1OgLIP B Jd}SISUOD IJap puLIs 
snjd 9] ‘ow uoles ‘QuewoUUOAUS | a[dwoxe Jed) sare) 
-11011d snjd snusaap juos tnb sougwiouayd soy JoT]I9AINS & 
JOOUSUIUWUOD ‘samNe Pp SUBP 19 SAQUUOP ap S]ULISIXd SAUQ}SAS 
SQ] JOIOI[DUIe SUOADP SNOU ‘Sed SUTeLIO SURC] “IOAZIAI B SIJOP 
xnediouud say JtoAgid Suop suoaAnod snou ‘jusWIdAgIIg 
‘sked 9] ulosaq & yUOp onbiyse}s 
SdIAJOS Np [eguas sigjovieo ne yuenb saiiejo suones 
-I[duit sap SdAR — DOURUIOANOS Op dIQIILU UD SAdULPUd} So] 
INS UOTIOIS BI B SIJIOIP SUOTIIOIIP Say SURP JONOAY,p eIONU 
-uo9 onbniyjod ainjouofuos ev] anb siesaynjsod of ‘uruq 
"JNOOLgo 399 IJasI[eaI 
Inod saitessadgu ‘SJHRAOUUT Zasse SUTeLII9 JUOp ‘sonbysne}s 
soguUOp ap souiaisAs say Issne jLID9p [J ‘sarqeyea sonby 
-1jod sapguial op uotjdope | e afqeteaid UONIpuod oun 4s9 
SINDJOVJ $90 op dANPIAI soUeLOdUIT,| BIJeUUOD ‘JJa ‘9AII9 
WINUWIIUTU [eLIeyes xne} I] ‘sayuRIsIxd 39 sasInbar saouay 
-gdu09 sa] o14]U9 doURPIONUOD ap snbuew 9] ‘asnaynoo snyd 
sgAo]duia xnesAnou op syonequia,| jUapual Inb saye1oos 
sasiveyo sapinoy say ‘(aseuUIQYyo-douvINSse Pp 39 xXNeIOOS 
SUOJSULI] OP SOUIIZ9I SOP dINj}eU kT QUUOP jUR}d) QIQUNUDI 
[eur rojdwia un Jajydao0e ,.p juapenssip Inb sinajoej say ‘anbru 
-OU0D9 DOURSSIOID BIQIeJ B] JUOP ‘satqisneyd sasneo sinaisnyd 
B® aseWlQYD Np 9sAd][9 NedAIU JT ‘aWg{goid np aedio 
-ulid asneo P| 1Ue}9 DUIWIOD ‘satqeqoid sinajoRJ ap s1quoU 
uley90 uN Tued ‘IsIoYyd JUsUIZII,[ op pusdep syWoRdTyJo 
Ina aonb snuoU! 3a aseWIOYS op sAg[9 xne} np swefqoid 
3] SIPNoOsal op 19}U9} Inod sasud saye}USWISUIIANOS SoINsou 
SOSIOAIP QSATLUR B (£66 IOIg) 10dIg JOWIeH ‘ajduraxoa ieg 
‘soulgtqoid sap uotsuaysidwioo ey] & We) e INnb 99 Ud SaTe} 
-USWILPUOJ SOUNDP] SP 9OUI}STXA | ISO SUID SOUTRUOP SOP 
aIquIOU UO ap senbnsiig}oRIeO sop ouN | anb ‘uOrxaljel op 
adnois np xnears) xne JUST} UA,S UO] IS ‘a}SOJTULLE 4SO |] 


cel 


‘gIpuaidanusd ,p eipudtauod [I,nb sanbusneys syafoid 
Sop dapl aUUOG UN JaUUOP sNoU jUdIeIADP ‘soITessad9gU 
JUIWIS|Qe[QUIdSIvIA JUOJOS IND saguUOp sop oinjeu ev] onb 
ISuUIe ‘SQUIeWIOp Sa] ‘soratpNosed sajjaanou sainsow sop 
JaAndde inod aonb 39 inj d syejUSWAWIDANOS UONUSAIIUI ,p 
[elguas Inojoas uN Ins d1OTWUIN] ek] oIIeJ Inod sonbysneis 
Soula}sAs SpuvIS op jurod ne suO}oW snou ‘jno} saidy “(27a 
‘UONPUWIOJ BI AP 19 JUDWIOUSIOSUD | OP [OI J] ‘aIpeyeul LP] op 
19 91URS Pl Op S]UvUTLA}Op Soy ‘aIANONpold vy ‘to;dwia | ap 
QINJVU LP] AP UONNOAY,| ‘ASeWIQYD Np suTe[qoid 3] SUTWOD) 
Sap XNILIs op JOAVI[OI DINOp Sues APN] [I sfanbsay suep 
SOUIPWIOP SpueIs op JoUIN ynad uO] anb asuad af ‘amuos 
Jeg ‘adnois a] ied sgsodoid satqeqoid sijap ap ast] be] 
DAIOSAI SUBS Ja}dad0R ,p sed SdLIIO STRIOPULUIUUODAI OU OF 
‘s[uiad 3a sanbst sou e,nb 
sayjanqusag sajuewoduit saouenbgsuod soureyiad Jol0usI 
suoAnod ou snou ‘suloWURaN ‘oydoid ItudaAe UN suUep 
JOAI[AI JUOIAAP Safa ,.nb sijap say a1peid ev a1an3 yUd|JaoXo ,U 
sg1gto0s say no} saidy ‘Jnonpoid jusuergt;nonied 


sed yeas ou d01dJexa,| aonb stojayno} ouINsa,f¢ ‘aTe]USU - 


-OUJOANOS UONUSAIOIUI,p sIgneUI Ud UONUSNe.p snd 9] 
Jopioooe eipney [I sjanbxne sourewiop say] auIa0U09 Inb 20 ua 
$9}99LI09 JUOS SUOISN[IUOD SIN] IS 19 9I9I90S O]0U Bp UOTN] 
-OA9,| INS soUsNTUI,p snjd a] JUSUTATQe[QUIOSIeIA JUOINe 
Inb S9d10} $3] JUDUIIJIILION 9UIIO JUO UOTXaTJaI op odnols np 
SOIQUIOUL Sd] IS IIOARS ap UONsanb eI oNegep WeUNod uG 


A THINASNGA.d GNA ANN 
-ANOLLSILV.LS V1 AG XNVaNNE 
SAT YNOd SHONANOASNOD SAT ‘Pb 


‘(B66 182][a4) «Saatoalqo» UR} sUTUIOD saaidaooe ane 
JUSATOp Inb saanaid sap JooURAR,p ‘a}LINDs op JUeNbUeU 19 
onbndeos uonejndod aun soinsoul sas ap assases ev] ap a1 
-UIBAUOD INOd ‘ddIOJJa ,S JUOWIDUIDANOS 9| aJonbey] suep on} 
-suofuod oun e ansnfuod ‘saTjaro1jjo sanbnsieis sop puris 
snjd joedwi.| op asneo e juourgstogid ‘stewel onb aur} 
-Ioduit snjd sa UONeIapIsUod dNa_D ‘a]J@eUUOISsajoid aouajad 
-W09 op uoNendel naz 19 anbryjod souepusdgpur sng] 
JOPIESIANLS B JO|[IDA ISSNe STRU ‘OpURUAP 91199 oIIeJsTVeS 
JUSUWII[NIs UOU JUSAIOP 19-xnao ‘sanbrytjod sap uoNnesOgey]A,| 
@ sojdepe XnoIw s]UdUIAUSIasUaI Sap a1Inpoid ap anbnsneis 
Rl Op S[slolyjo xneaing xne aspuewep uo,] aonb sioly 

(L661 UOSJTOAA 10 18a]]2,4) speyNos srogad 
$]e][NSOI SUILLIDO JUDD GL|qUASTeIA JUOIINpOd ‘alqeidaooe 
INOS UN B ‘INb UONUDAIOIUI ,P SIDIAI] Sa] Jostogid anod sarees 
-Sao9u sonbysnejis ssquuop ap aseq sYoL Be] aiInpoid ap ‘yey 
Ud ‘opURLIOP SNOU UGC ‘(UONL[NUIS op SUOJ dUN) SUID} SUC] 
B Safqeqold sjajja sap UdWIeXd | JUDUATQuITAQUI aIOdUI0N 
inb do1osoxa ‘sowtueisoid op olgneu ua suondo sasiaaIp 
So] Josod ynej [I,.nb dosed sanbiduwioo snyjd a1oous anpual 
1S9 [OS Ud [LOIJJIP 9yoe] NID ‘sJotpnonsed sadnois sap ins 
SJoJJo Soy ny ,panolne yUsIpNyd sorfqnd sitoAnod sa ‘saye1oos 
soouonbgsuod sopurls Xxne JASsSaIgiUl.s ap nal] ne ‘sa 
sn{d Ind ‘syey[Nsel sap UONDOIIP k] Ins JonTJUI e soURpUa) 
quo Inb sinajorj sa] JourWajap Jaiadsa yned uo ‘xnarw 


Le 


ny ‘ainatigjue onbiun asnvo oun v& ayInsiquie sues JoyoRyRI 
ined ou uo | anb ‘uoneonps,| ap no gjURsS eI op soUreUOp 
So] suep a]durexe sed ‘sasuojoid sjajjo.p xnoo [elgues us 
JUOS S}eI[NSEI Sa] ‘Naty JowWeid ug ‘suostel sInarsnjd snod ‘a9 
}9 ‘JeIOOS DUTRWOP 2] SULP SapINO] snd a10dUd JUOS sadUE3 
-IX9 Sd][9ANOU Soy ‘ayoR} 91199 Hos aonb auRseIOE IssnYy 
‘anbru0u0d9-o1oeW UOTUdAIOJUL | J2AvI9 Inod sasud 
-aUd xNv apie ,p sajuarayoo sanbruouo0s9-o10ru sanbnijod 
SOP IdIOGR]P,P SPdIOJJa JOS ds 39 SastIdaNUS sop oISsnel 
ev] quanbijdxa inb sinajorj say aipusiduio0d ap gAesse 1U0 
S]I UIp jusWioNNYy ‘sonbruouod9g-o1oNU souletqoid say ins 
asvjuraep sayoued juos as epeued ne JUsWIWIO0E1 OANOd 
Nv SJUSWIUIEANOS soy ‘sanbmuouosgoI19eW suoNsonb xne 
JISSIIDIUI ,S IP PNUIJUOD JWUO SII,S ‘stofayno], ‘sonbruouosg 
-OIOBUL SJUDWIOSURYS Sop JOURTIIOAINS eT B dod aneYy 
Sa1] oUN Jap1oNR Pp enuUOD uO ‘anbruOUO0d sUIeUIOp 
a] sueq ‘onbnsneis ey ap xneoing sa] inod sajuryodut 
saouanbgsuoo sap JUSWAT[aINIeU B OpNIINe a][9Anou aa0 
‘aipuodal A inod sairessaogu s]usWIoUsTOsUaI 
$9] II[[Iende1 ap Joinsses B 39 SUOTJsanb souUOg saz Jasod 
B DISISUOD SJUDUISUIDANOS Sop saeJUsUTepUOJ SUOTIOUOJ 
sop oun, aonb Jasuaed e guuop ke sjurywodu soueis 
-oid xneaanou ap Ja9ur] Inod siti] siorouvuly sudAOW 
OP 19 B][aNjOo][A}UI INdNII spuvss snjd oun ,p UOsteulqUIOS 
RI ‘Wey uq ‘snssaooid say ins aonb 3Q3nId syeI[NseI say Ins 
SOXE JUSUIIPUSI IP SINDJLOIPUI SOP JUSWII[AIDIJJO Jaydope ,p 
J JOUTWA}9p op ona usd JUOWIOANOW UN sITGnd In9\9Ns 
3] suep onbods ay)99 B oiIeU NA OUOP B UG ‘soITqnd syeqep 
Sap SIO] synoefqo sina] aipusjap inod sastogid soguuop 
SO]JOANOU OP UlOSaq ISsNe JUSTBAR S|I SIR, “S]UISTX 
Q[LIJUSWISUIOANOS UONDR ,p SOWIWUPIZOId suIe}IID JUSUOPUOJ 
-old Jalipow ap no Jowtiddns ap asiaaonuoos e jueigid 
UOISIOap BI s1pusid ap yueAe asAyeue d1doid Ina] JonIdejJo 
Inod saguuop ap utosaq juareae Inb sorqnd siroanod soy sed 
QSUIP d19 B LOJJa ‘J “AMUOUOD | 19 9I9IOOS P] INS xne]USWSU 
-I9ANOS SouUTUeIZOId Sap SaT]991 SUOISSNoIadal sap saanaid 
Sop IIUd}GO NINOA kB UO ‘sJUdWIaSURYD S90 Op IR} nq 
‘QUIQUI-IN] JUSSUIOANOS 
NP IOA “USUIOUIDANOS Np s[OI np piese,] e swIsIUAD 
uos efep iesastuvu Inb — s17qnd np epmetnbut | 9qisoexo & 
ainjouoluos ayjag *xnourdg snjd aioous npusl yuo | anbods | 
B JuaIeUsaI INb 9AaT{a BBRUIQYO Bp xne} 3] 19 onbrwoUOsE 
OUISPILUL J] SIRW ‘JeoI[ap yUaWoNbiyT[od soroJoxa uN sinofno} 
}SO XNVJUSWIOUIIANOS SOUTWULISOId sap UOISSoIdWIOD eT 
“sololjip suonsanb sao 
e sipuodas inod gue uaigq sed j1e19 ,U anbysnyeis sugysAs 3] 
uepuodag ‘«[anuassa JUSWIIPIA So sUUUeISOId 9] INb nod» 
}2 «s}e][NSaI suog ap suUOP INnb do» OARS ap suONsonb 
XNB JUOWOIIeSsa09U JURUDL sjURISIXO soWUeIsOId soa] 
SUEP SoTqLIaPISUOD SaIndNod sap JURPUD}Ud-sNos UOTINTOSEI 
es ‘yeuoleu Jnoefqgo Jomweid a] NUdASp 3sa oUeTqoid 39 
‘\uonbgsuod Ieg *«}OlJap Np uoNsonb ev] sIpNosai & S]UdU 
-UIJANOS SO] ISEJUPALP JIOOUD O}IOUI B SIOIOURUTJ S9YoIeU 
Sop UOTSITRIPUOW PR] ‘JUdWIITI[eIVg ‘“SHOap sop uon 
-P[NWINIOL | B MINODUOD JWUO ‘[eIIUL Jaspngq J Wepgoxe “JUS 
-g[qelieaur onbsaid ‘tnb sjasraatun xnersos sowueis01d 


666| aiquiadap ‘ajenbua,p senbiuyoe | 


S9P INOD 9g| 19 sonbruOUOdgOIOvU SanbIyITOd sap ajusiedde 
SNIITJOuT | ‘OnbrwOUOdE JouRSSIOIO B] Ip JUSWIASSTUITeI 
YX] ‘WWouNsuLYyS Np UISIIO., B IWOS SINa}ORJ sINoIsn[g 
‘06 SoguUe Sap sInod ne jUsWEpIder snjd ja QE saguuR 
Sop sINOD ne JUSWT]ONpeis — gsuryo & UOTJENIIS eT] 
‘OUINS Op [sure jo ‘(xnezIdoy sa] sed sayja-zoyo sagkOa 
-Udl souuosiad ap siquiou ‘oug]dIp uN jURUaIgO SaAQgte .p 
IqUIOU) sjURIIX9 Sop «Sa}NIg» sdInsoul soap diinpoid 
ap ‘(uIsepeul anbeyp sed atasossop uoneindod ‘jueustasua 
Jed Soag[9,p d1QuIOU) JUSUIAUUONOUOJ op sone xnediouud 
SJ aonb Isule ‘(WUSWIDUSTASUD,.P 19 QIULS OP SODIAIAS Sap J) 
-d9]J9 | ‘oyduuaxa sed) syueyodur syuenut sane ,p ‘soumues3 
-O1d $39 39 NOD Z| JoNTeAd,p (aNg-jned) jepuewWep snou 
uO ‘ny ,pinof{ne nb pinoy suo JUSWIdATeIedWIOD Neapsej 
un onbysnejs ouayshs a] Ins Jasod juarestey sowureis01d 
SD “a}INs ap Isule jo suorsuod sap ‘aseuQYys-souvINSS | 
op ‘ollepuodsesj}sod jUsWIOUsIESUd,| B Sgd0R,[ Op ‘aJURS 
OP SOIAIOS SOP SOUILUIOP So] SUBP S[aSIOATUN SOURIS 
-oid spuvis op sovjd ua ast ey e atians-saide .p saguue 
So] JULINP gISISsSe B UO ‘xNRIDOS SoUIeWIOP sa] sueq 
“SaSRUSW Sap jo Sastidamua sap sgidne sajygnbus ,p 
yo[dur09 Issne yno} surg}sAs un Jed nuajnos sanbrwouoss 
sajdwio0d ap Jafdui09 auaysAs UN, P UOT}VIIO BI 919 B Sd}STUOIS 
-UISIOJUI I[RIOIOWIWOD 39 I[[IWISNpUl ‘oIeyQUOW ‘aTROSTJ 
sonbuijod xne onbnsneis ve] ap xnevaing sap asuodai ey 
‘QISTUUONUDAIOJUL 9pnjje oun a}idope juO 3a sonbrwoU0s9 
-O1DBUI SOUQ{qoId say] Ins yusWaTediouLId ssyouad juOs ds 
sorgnd si1oAnod sg] “qqoQ,| ep shed sa] sno} onbsaid suep 
‘glions-saide .p apotied ey op arsed apuvi3 oun jueing 
‘sarqeqold sjusuasuRYO Sa] 19 $9}U9991 SADURPUd} Sd] 
JUDWIDAIIIG BNADI Ud Jassed ap uog [I-}IeJds IssnYy “oyeydeo 
sourywodu oun.p snou inod juos piese 199 e& oIfqnd np 
$9]UD}NL Sd] 19 SJUDWIDUIBANOS Sa] JUoNol anb aIQ1I 9] ‘yUoNb 
-9SU0d Ieg ‘Ssa[eJUsWaUIBANOS sanbnijod sap uolelogey{a,p 
snssod0id 9] Joy [IOvJ B JUSWA[QeIIGNpUI a}sIsuOD anbysne}s 
eR] Op xnevoing sop ajueyodun snd el uonouoj ey 


AONVNAAANODSD Ad 
AYHILVW Nad SHONVGNGL SUT “€ 


“QIPUSICUIOD So] 
XNOIW Nod saIlessad9U SJUSWIIUBIOSUdI $3] ITUINOJ Op UIOT 
4S9 [I ‘IN0} uOs B,Nb yudAnos snyd ‘syuednod09I1d souguIousyd 
SO] Ip & udIq JSsnNeI janjoe onbnysyeys owaisks J] 
1s ‘anb usWa]e39 dANoOJd aI[9 ‘TOW UOTIg “a[eJUSUIOWIBANOS 
anbniyjod ap aienew ua suonedndoo0gid sapuvss soy IJOssar 
NO} sISTeU ye} aJa,nb siadso.¢ “UdWIAIIesssd9U 3N12,| 
sed yop ou 3a satysneyxe sed jsa,u apaoaid inb ast] eT 


“QIQIUIOp 
91190 Ja[NdeI We] sUOTRIZOIvOUI sop UONRoT[dn[nw ey] 
onb onbiput u uald Is SUIQUI — 9}I[PUTWUILID ve] ap oINSOU 
anne 21n0} anb juswaprides snjd dnooneag ajuowsne 
SUONRIZOIBOUL,p xne} o] ‘slalxuRe o09 eB UONREI 


x 


Ud 9119-INIg “PII[BUIWILID eT aUIgOUOD Inb 99 ua oI[qnd 


JJUBAL,| Bp UOIesedaid e7 - sanbysiejs seoijues seq :1Helje4 


NP SoIQUIsU sop ajURSSIOID 39 BddUOUOId 9I9IxUP | 
ap JUsUSTIOW9} uOIUIdO .p sasepuUoOs seq “oI[qnd aiplo TJ 


‘uoneindod ve] ap ajsa1 np aj[90 enb 
IQSHOAVJ SUIOW JUSUID}IOU O.1}9,P BNUNUOD saUO}WOINY 
sop uolens e, ‘sonbruouosg o1d0s saljayoe so] 
sajno} onbsaid op piesol uq ‘epeursd ne jueyoduil oj 
JaIssop un — 9u0jyooine uoneindod vy e 1e) JUO sanb 
-jod ap suonsonb ap alias oun aynoy, ‘sauo}yooiny 


“SLIUUOD [PUI JUOS 9]URS LI INS SUID} SUC] & S}OJJO So] 
JUOP SIUL ‘Sa[quIOpISUOd SorgIOULUTJ SadUaNbgsUOd sap 
uo Inb ‘(auudtres9o BP] NO UdLIeUOIOD-01108 a8eUOd 9] 
QUIWUOD ‘suoneiado souteyso & Japgooid eB uorsuedoid P| 
9uig0u09 Inb 39 ua ajduraxa Jed) sayuasIOAIp WO} sanb 
-1ye1d Sap dAQIAJ UO ‘AJULS Op [AIOTJJO OWIg}SAS Np ules Nv 
QWIQ/Y *OIdUU09 IUD} Issne INej [I JOP S]UDUIgTE soryNe pp 
quos jUsWOdUUOIIAUa,, 19 anbru0U0d9-O1D0s_ 3M1e1S 
Q[ ‘OIA Op opowl aJ Jueyodur snjd a] sed swiguI ang 
-jnod 4s9,u [I,nb 39 uoNe[ndod x] ap aiues eI Ins JuRssIze 
sinajoej sop un, anb 3sa,u g]UeS ap [aIoIJJo oura}sAs 
a onb saanaid ap snjd ua snjd ap opassod uo ue} 
-INOg ‘SUIDEpaU Say 39 xNeIIdoY soy Jed syaJJo SaoIAJas 
Sop UOIssadu09 P| INS JUoWaTedIOULUd ayUdOUOD as Inb 
o1jqnd yegep puis un 9i10sns ju sasuadap seq JaTO.NUO0S 
Inod USWISWIBANOS say Jed sastid sainsoul sa] “ayURS PT 

“SUP9I94 
OP NO JUSWIOUUOIIAUD | op ‘JaJeNb np jueUsIasud | Op 
‘UONRONPY Pp SUIa}SAS NP ‘sJURJUS SINI] JUDAQTP STI JUOP 
uodse] PR] Op Jd sjuored sap snbrwou0d9-o100s uoTeNIIs 
PR] Op Slajjo soy WOp ‘stIdWIO0d UdIq SULOU aI0DUd 1UOS 
s]URJUd Sa] JUDYONOJ Inb sawigyqoid sureya_ ‘sjanjueag 
SOPIUIII SI] 19 UONNIS 37190 ap Sasned say yusUII}aTd 
-WODUI OJ anb suossisies ou snou ‘JUsWdSNaINIYeIW 
‘sa3e snjd sanzojowoy sino] op xno & JUdWIOIIeUOD 
‘SO9UUL SOIQIUIOP JSUIA Sop SINOD ne gNUTWIP UO 
sINIT[IVAeI] souNal Sap S[aeI SUIeS Sa] ‘aNNO UY ‘sounof 
Sop [IeARI] NP PyoIeU 9] Ins 9d10x9,s Inb uorssaid Pe] 
nod un Jupurowre yer1Aap nb uonenis ‘sapnyd sing] Jas 
-uojoid ap juapiogp sounol ap juessioio aiquiou un nb 
SUIQUI SIOTe ‘sAdT9 JUoWANbIeUIS}sAs sinouap nb 
sounal sop a8eWIQYS Np INI[Io Jsd dIPNOSal & S9TIOIJJIP 
snjd say saurafqoid sap un ‘J ‘sounafl say 19 sjuvjua sa] 


‘anbijqnd 
dNep LP] op uoHONpal eV] & 9OLId opueIs ouN apIOdOR 
uO | no enbodg oun e juaWaJaT[NoIUed ‘ayeIsos gyLINDEsS 
op slaty sop aor ne juenb sanbisayens suonsenb 
sajueWOduil .p jUd}IOSNs saduRpUd} SdD “jJUaseid ve nbsnl 
SUIOW NP — SNUdADI OP Wojsues) op 19 JOdUIT.p dWIs9I 
Np jJissoisoid a1g}0eIv9 a] Jed agsuadu0s yuswIa}g7dw09 
919 & BOURpUd} 91190 ‘epeuRD ne ‘sIUp)-SIeIq XNe dAIISGO 
uo, anb 99 & quaWIaMeNUOD “INE, ey JanuTUIp nA 
UO a][aY99 | Op seq ne Juans as Inb sayjao onb stpury 
‘7e10] Np ed Indy JO]UDWUITNe NA UO 9AdI9 1S9 NUDADI 9] 
JUOp souuOsiad sa] ‘satuUd.Ep SAIQIUIOP XNIp Sop s1Nod 


ne sgououold 3s9,s jn1q [el]MwWe} NUdAaI Np uonesuejod 
ey onb yey ne yuan ‘stup-sieyq xne.nb epeurd ne 
jue} ‘JIROTJIUSIS QUaWIOUsYd UA “yoysuen op 32 Jodu1,p 
QUISSI NP B[OI Jo SNUDAAI SAP JURSSIOIN UOTIVSLIL]Og — 


‘nal Ud Sdd1OJ SOSIOAIP 
Sop souepuedgpiojul,| Ins no suonisuey sap saoons 
3] JUaINsse Inb sinajoRj say INS SoAteWUeND saguuOp ap 
nad wo anb suopassod au snou ‘IQ ‘ae VY B [IRALI} 
Np jo uared op a]OI nv JULJUD SUS SIA OUN.p ‘[IeARI) Ne 
91099, ap ‘a]099,] B BAO] NP asessed 9] JUOS JIA PI Op 
sinod ne JusuUaTAINs Inb syuryoduit syusWasuRYd Soy 
‘TIRARI] NP SYOICU VJ INS SAgAJASqO sUOTTSURT] SoTONNQ = — 


‘JuapUe}-snos sa] Inb sadJoj sa] sIpussdwi09 
[eul op suonuNUOD snou ‘sjusWIasURYD sod JUD 
-onbreulaisAs SUO][I@AINS SNOU IS SUIQUI ‘ICG ‘sJUeWOdUIT 
snjd ua snyid ap juauuatAap ‘saouajaduiod soy aseURALp 
DIOOUD SUIQUI 313Q-JNAd 39 ‘a}LIVJODS OP NRAAIU JI {[IBALI} 
op soinoy ,.p siquiou np onb sules sap usigq Issne uoNes 
-luejod oun aje}su0d uo ‘sjuanbelj snjd juos sapnia.p 
yo oseWIOYD ep ‘1ojdwia,p saportied say anua s}uoW 
-dANOUL S9] ‘(aWOUOINe No aileIOdUIa} ‘Jared sdura} B 
[I@av]]) dJUSWISNe spoUUOTIIpe) UOU SIO[dWIA ,p sIquIOU 
J] ‘one | e anbruou0ds 3]9A9 UN ,p JaJUDWITN ,p 9ssad 
BU BseUIOYO J ‘olIaN3-saide .p apouad ve] JUvINp ‘sast] 
-elysnput sked sap yednyd ey] sueq ‘[reary np spyoreuw 
sop suoneuojsuen sajuryodull.p s]UapIAg sousIs 
SO] DUIDOSIP UGE “[IVALI] NP gyoIeU Ne SdI] SOWIqoIg — 


‘sade sjucied sing] & 19 sjuRjUd Sina] eB JUaNSIpold 
sqt.nb sutos sap gyyenb ey] ins ‘sastiduios yeu steul 
‘sasnoalias suoIssnoJadal sap OAR WeUnod tnb uonenyis 
— sjuvjud sap quo jd JUaT[IVAey) Inb sajdnoo sounaf 
So] uoweyedrourd jusanoide nb «sduia) ap oanbuew» 
jURSeIO? | JURpUdd je} D]JOYDE opuLIs eB oseWIEYD NY 

‘JUDUUDIII[NS9I 9USUIS Ne 

UO Sandy Pp sIQUIOU puLIS UN jo Wed UN JUDTTIeAe) IND 
souuosiad ap suomodoid soy ‘saguue SoJQIWJap ISUIA $3] 
:osgsuejod snjd ua snjd ap isa eae) np uonniedal ey] 
‘oueNII ap sgatid 

anb sorfgnd jue} sawisal Sa] Ins sajqeiapIsuod suorIssaid 
sop dsojlaxa ‘anbrmouosg afoho np souenbgsuos 
g{duits oun ayje,nb 30 yn]d awa) Suc] B sdURpUd} oUN 
SULP SILIOSUI,S a[quIas Inb ‘UOTJeNIIS d0D “JoNUIWIp 
OP MNUUOS o}Ie}AI RP] Bp 93e,] onb sJoye ‘JoJUSWISNe ,p 
QSS99 OU [VARI] NP 9YyoIeU J] INS 99I]Ud,| Op 93k, ] 
onb jrej Np jUvUsIOUIS) ‘sue d]UdT] Ud SNIOU ap gnuTUIp 
B ane | & OUN,| Op ONRI FT “a}TeNAI LV] Op ajjao onb 
a1IN0d snd jsa aJouUOIssajoid aANO,| op dgINp eT 


*sduis} 
np uonesion,| ap saiqyinbasap sap ang JUalepIsuoo 
s[t,nb 99 Ins UOTUDNe | 91Ve UO UOTXaTJe1 op adnoi3 
Np soiquiaw say] ‘sdus} np uonesipnn, | ap aiqyinbasaq = — 


sauleUINy Sdd.1NOsse.t Sap yUsUIaddoyadap aT 


6cl 


‘g[qvinp 
juauiaddoyjaasp np sigiuureq ke] snos onsva uodej 
ap soyoap juos nb ‘sastudwi09 [eu WOJ ‘sayeyUSWepUo} 
suonsonb ap [eigues ud 3e,s [J ‘SoureWOp sane 
sop wednyid ey] daar nb Isule ‘aTUOU0D | S9AV JUASSISE 
-INUI saegtqoid sad “xneUSWIBUUOIIAUS SOWgIGoIg — 


‘auanonpoid 
RP] 39 UONPAOUUI,, ‘also;oOUYydE] ke] sep asesN,] 
‘to]dura .p sanbissv[d UOU SAULIOJ $2] S1aA QOUOUOId snd 
ud snid ap JUSWIdANOUI 9g ‘sastidanua say Jed soaidope 
SdIIVJJ SAP SINPUOS ap sapoyIeUl say ‘saoudjadu09 
OP II[ONprarpul uoNtstnboe | SUIS ‘sadIO} SaUTe}IIO 
aus UONLIAI kT [PW OJ SUOUSIdWIOD snou ‘sny{d ap 
SIO} oun ‘UepUddad “jUuaidepe s 19 JUdAOUUT INb sastid 
-aljua xne juanbrijdde ,s sajqereduios suoneasasqo soq 
“JQUDUISNL Pp JUdSsad ou INb sajqeiapIsuOd saseURAR 
Sap juainsoid “uoueunied asesstusidde | 39 atoevIONT] P| 
ISLIULALP BONUS SUIQUI 31}9-]Nad Ja ‘sapnye soy ‘NUdADI 
np onb ayyIqeAojduia.| ap jue) ajsue,] SNOS ‘saIso] 
-OUYII} IP Jd SAOURSSIVULOD SP UONLIUIDUOS J}IOJ & 
DIATIO“ ,.P SOYDULIG SI] 19 SADIAIAS SI] SIDA STUIOUOS | 
ap SAIS op ajUDD Np JUoWIadRIdap UN,p s}UdTOSUOD 
SOUILUOS SNON “IIOARS NP dp sttuOUo0dg | Re UONRIdepy = — 


‘anbrwiouode ddueRSSIOIO RP] SUBP dTATIONpOId eI ap 
[BIONIO [OI J] SIBTPW ‘sastIdWiod [BU JUOS [NdaI 99 ap 
SUOSIVI SY] ‘SastTelsnpul sked spuvis sinaisnjd suep 
QNUIUIp & dATONpOId e] ap VduLSSIOIO ap xnv} J] ‘sau 
-ue salgiusiap buto-j3uta say anbyewsojul a1s0jouyse} 

PR] Op aJayoe opurss ve uoldope | sIs[eyy “auANONpOIg = — 


‘SoIndtigjue sotuudsap XNv JUSIAT) 
-eIedul0d SAQUUP SOIQIUIOP JSUIA $39 JUUA[QLISPISUOD 
NUS|eI & JaeI USAOUI [eI[MUeJ NUSASDI Np jo JULIIGeYy 
Jed [991 G]d Np soursstoso vy] ‘anbruouose ouRssIOIg = — 


JOULSSIOID BT 


‘epeurd ne suonednosogid 
ap sioljnonsed sourewiop sap juv}a SUIWIOD S19pISUOd JUO 
sjt,nb 39 ap sept aAgiq oun nb 191 JaUUOp aI]NO Ud xnod ou 
of ‘souTeUINY sadINOSsal Sap UaWaddoyadgp J] 19 BOURSSIOIO 
RI JOAeS & ‘1Ol xnop onb Iesjaploge uda,u of “salIosayeo 
SopueIs ston ua sednoiseal yuo sjt,nb “ney snjd sayioep 
suoIssald xne sa1dosse JUSUWIATONS JUdANOS ‘sIOgId sIjap 
sinaisn{d gu1do JUO UOTXa]JoI op odnols np soiquidu so] 


sanbyyod ap d19eUl Ud Sap SVJ —7'T 


“syuessIeU 
no sjuvInod sawa{goid sa_ aIpnosei nod sadinossal op 
uoTeSsT{Igou P| 39 onbiyqnd oyap ev] ap UONONpgsl eT aNUA II[G 
-b19 Inevj [I,nb aiquyinbg | a11p-e-3s9 9 ‘IMIOULUTJ 9}X9]U0D 9] 
JSAP JUDSSISVIDIUI DORI aiIey A INOd d]ULISTXO UONUSAIOIUT ,p 
a31eul ev] aonb Isure ‘saguuONUaUSNs SUOIssald Sa] SayNoOL 


sanbyqnd sasueuly Sap 93x9JU0I ITS" TZ 


6661 eiqwadaep ‘ajanbuae,p sanbiuyos | 


"SdlUSsadgu SaouvssivUuUod 
sop uontsinboe | & ajqvinsudsuWIWOSUI UOSL] ap IeIaNqLyUOS 
SJUSWIIUSIISUAI SINA][I9U JUSWI9}aU ap UOTUIIGO | ‘psesa 
99 Y *XNINOS SOUIWUILISOId Sap B BORIS SIIJIPOU JQ JUDIVI 
-Inod inb xnao juawiasarnored ‘spesnes snajovy say aupuaid 
-W0D XN ap ajqedeo ang ev aysisuod swW[N anbrytyod 
Jap XY] ‘soxa{dwo0d suonoesajul sap yurjuasaid sainp ansuoy 
ap snssad0id ap saydwaxa sap JUOs ayIe.NdJ B] ap JUSWIOWU Ne 
uolsuad oun & HOIp J] No ‘onberipivo aipeyeul ek] ap no Ja90UvO 
np uoNNoag,| ‘fuonpoid yo Wejsyes UdAO}D UN Ud JULJUA 
uN.p UOTeWOJsuRT) eT ‘Uasgid sdwia} np ejap-ne uaiq 
puja s nb Jryepnuind jajjo uN yUO ‘sazjNe,p ja ‘se sag 
“IUDAL | SULP ajURNbILU J]eID0S 
UOISIAIP Op ddINOs OuUN ai}9-jnad vias 39 saddojaagap sXed ap 
SIQUIOU suep saa{qold xNoLIas ap a]Janjoe ainay | v asod 
‘sinay[ie nb epeues ne saris sulow nad un awiajqoid un yso 
Inb ‘ayesa][I UONRISTUIUUL "TJ “9ATOOTI[ON dIWUAPI ,p 39 oNbyITod 
ap ‘sajeloos sowOUu ap sigeW Ud sadUanbasuod sap vB 
S]OINI[ND XNI[IUW SIDAIP ap JURUdAOId sauUOsSiad ap UOTRIS 
-J1UL,| ‘JuIsod JUSWIYTS UN SUTWIOD JUDWIa[eIQUIS DIQPISUOD 
ve] uo nb uarg ‘uoerndod ey] ap sourssiolo ap ayediourd 
d01nos k] “GqQDO.| ep shed sap uednyjd vy suep issne stew 
‘epeuec ne JUSWI[NEs ‘UOU BNUdADP $9 UONRISIWUIU! TJ 
‘sonbiuo1yo 9]ues ap sow] qoid ap jursyjnos saase 
souuosiod xne SulOS op UONR}SAId P| 39 JID OP SOWISI Sd] 
‘\uejud,| op Juowoddojangp ZI ‘[leAe.) Np syosew ne uoned 
-1oed ey ‘ajoraned ey] ouIWIOd ‘a[eJUSWIOUIAANOS UOUSA 
-I9]UI,pP SoUuIeWIOp sjUvyOdUIT,p suep salUassol jUdUOU 
-I€199 1UOS sIeU ‘sastIdwWiod JUSWIOIQIIUS Sed yUOS 9U S}Ud 
-9BULYD $90 ap suOISsNdJadal sa] ‘(sjanxasowloy saydnoo 
‘W1eJ Op suoruN ‘sayejUsIedOUOW soT[IWUeJ) sajURTeAgId sny{d 
JULUDIUILUL JUOS SoTL] IP SOWULIOJ SOJUDIOJJIP STeU ‘AULIOU 
PR] SONUDASP JUOS SNUdADI XNap ¥& Sal[twe} soy onb oinsowi 
B MNJOAY [I-]-B OWUIJ I Op I[OI 9] JUSWIITNAS UON “studw09 
[eu juos Inb sijap ap atigs oun asod ame ey ajuasgidas 
anb a[eJUSULPUOJ JJLIDOS 9IIUN | Bp aJUL}SUOD UONNIOAY J 
“OULIJOI LP] Op 9sv | VIPUTae ‘WIoog-Aqeq np 
Ip JUdWAINe ‘aLioNs-saide | op UoeI9UaS eT puenb juawar 
-Ie1OdWI9} SUIOW Np ‘eIdIg[9IINB ,S BDULPUD) PT “IUASsar snd 
ua snd ap ej as a8e,] ap sprod a] no saigid0s sap yinpod 
UONENIS 9199 ‘AJULSSIOIO BAVSUO] LI & JoNSN[UOZD ‘suones 
-9U9S SOP JUSWIS|[@ANOUAL op [INas Nv INILIJUI USI dITe}eU 
op xne} un juayorye saddojaaap sked sop uednid eT 


sonbiydeaisowgp suotssaid sas1aAlp SOT op [°Z 


*XNEJUSWIOUUOIIAUS 19 xNeID0S ‘sanbruou0sg 
sjnoefgo say amua sjanjuaAg stwoIdWio0d sa] JOUIID op 
Q[LOJIp uUsaJat[No Wed [I-}sa Issn “anbiwiou0ds 32 gTRI90S 
SNAIL | IP UOINIOAD,] 19 JUOWOUUOIIAUD,[ I1JUD SUSI] 
$9] Iu sanbsu sa] tu jUauIaUTaTd suoUdIdWOD aU snoU ‘soua{q 
-O1d $39 & Sa[qIsUaS SOWIUOS SNOU IS ‘sIOJa]INO], “so|[IU 
-UONIPeI) SUOIS9I SAUTeLIOO suLp dyed BI Op JUSWOIPUOJJ9 , | 
no aQue]d ey ap JudWayJNeYdgI 9] ‘9UOZO .Pp YONOd vk] ap uON 
-ONSIP P] SUID ‘XNLIUSWIDUUOIIAUD SOWQ[GOId sap kB S9dT] 
SUOISSAId OP SLI9S SUN ,P SJUSIOSUOD SNO} SOWIWIOS SNON 


So[BJUIULIUUOAIAUD suorssoid SIT TZ 


JIUBAB,| Bp uolyesedaid e7 - sanbysiyels seoimes seq :16a\je4 


‘agovuatu snjd ua snd ap jsa sayjau 
-UON pes] sajuLTluN sayyua xnv uONeoyMuap! | ‘uanbasuos 
Jeg ‘a1gnuol ap sed juassivuuod au Inb sjgiajul.p sadnois 
OP UONLUWIOJ Vl IT[IOVJ 39 apeloos Jd aJaIMIJND UOISaYyoo 
RP] INS Issne oN [UI dIsoO[OUYdI) vY “asivy a] nod saaied 
-g1d yew juos Inb sajjao ap Jasiuyew vj ap sajqedevo yuos 
19 BISO[OUYII} PI B Sade JUO INb sauuOsiad say vsaiedas inb 
QVIDOS J]][IVJ I[JOANOU JUN JaSNIIO as JIOA ap xnatas anbsi 
3] Issne SUOINOD snou ‘juanbasuod Jeg “apuoU 3] 1N0} Inod 
$]OJJo SOUIQUI Sa] sed VINe,U dISO;OUYII} v] “JUepuddag 
‘onbiwiouods JusUTapUaI 
Np snuajnos Ja ajuanbasqns uonejuswsne oun sed juolnpen 
aS SaT]O, Nb 39 ‘UONRWOJUL | IP UOTNJOASI LP] V IOVS IUDAL | 
SULP JUOJOSAINUOD 9S SHANONpoOId vy ap suONPIOI[IUIL 
sojuvyodurt .p anb saigdsa,.p sonunuoo jnad uo ‘siojaynoy, 
“QUUIT] 919 & BI9ID0s PT INOd sjUBUIOSSSIAUI Sd Op USUI 
-9pudal 3] — aWANONpod vy] ap saunsau sou & SUOUd) Ud snoU 
snou 1s — juasgid ev nbsnl ‘stew ‘anbiyewuojul a1s0;ouyse} P| 
SULP SJUDWISSISIAUI! SOWIOUD,P ]IeJ JUO $1NIJ9AS Sa] SNO], 
“sudiq ap uoTONpold ev] Ins anb sadiAjas ap uoNesaid ey] 
Ins soyeJUsWepUo] snjd a109U9 3199-JnNod suOIssndiadal sap 
v ‘anbiulouodg uoNONpold ev] op uONesI|eIpUuOW e] ap INawod 
ne ysa nb ‘saisoid aD ‘uojjes ne say] OOO OST JInosied 
yreuinod ya sieyjop bulo op surow jueuajurew j1e19}N09 
QUvINOD JIqoWO Ne ouUN ‘sInassad01dOIJOIW Sap suTeWIOp 
a] SUBP SasI[ea1 XNJO aonb aoUapeLd SUIQUI BI B Nal] No JUIIeAR 
JIqowojne | ap suleWIOp I] suep saIso1d sa] ‘sorUUdd.ap 
SoIguap xnoep sap sinoo ne ‘is anb yenbrydxo snayne ,J 
‘(966 [) JSMUMOUOIT BY, MNAad LT Suep aijqnd spore uN suep 
onpudl UdIq LOJ 939 & ONDNeULIOJUI UOTN[OASI ap sIjtTeNb e 
uo | aonb sugwiousyd 9] ynpoid jsa,s ajjanbe] ve assayiA VT 


INHHCULIOJUL UOINJOAII eT 7 ['Z 


"JUSLUDUUOMAUD | 
J@ DIN[NS e] ‘xNeVIDOs sawWMULIZOId so] BUIUIOD ‘sauUIeWIOp 
saljne .p suep swWOUOINe JULINIWOp Ud anbiWOUodY UONRIS 
-91UI,] Op SaseyURAR Sap JoWJoId B OUOP RID\SISUOD SIJap 
Spueis Sap UN,’T ‘a][aINI[NO SIA PI Ap 39 V9IN0s eI ap sjoadse 
S23] SNO} INS Issne slew ‘dtWOUOdY,| INS JUSUII[Nas UOU 
suOISsNoJodal Sap & UONLSI[RIPUOUL BT “SOANVOIJIUSIS SUIOWU 
ud sulowl op sked osjUa sd1gUOIJ So] JUOpUaI INb UONNG 
-LSIp op Jo UOTONpoOd ap sai[epow sayjoaAnou op uoNdope || 
ayoduios suguiousyd a] ‘suoneyodxs sap uonejuswsne 
a[dunts oun & JOWINSAI ds Op UOT ‘ASNdINOSI UOTJESITeIUIS 
dUN.P S[AUUONIpeN sasejueAR Pp SIQWIOU JULUdJII UD 1NO} 
uowiaoe|duia anbeyo ap sjiyejai sasejuear soy 19}10[dx9.p 
youtlad Ina] UOTFENIIS B90 “ayQueyd ey] JUSIANOD suoNeiado 
SIN] IS DUIQUI ‘SAQIT9JUI $9IT]US Sap SWIIOD JOUUOT|OUOJ 
SIRULIOSap JUdANAd saxa[dwiod syeLIeUayed sap ja soyeuoNeU 
-II[NUL $9}9ID0S SOP ‘SUONRIIUNUWIWIOS Sap UONSIULIOJUL ,| 
ap jeusuiousyd saisoid nev nb tsure ‘siatuenop sje} sap ja 
uonIpedxa,p sielj Sap aile[noeyoods uonnumuip ey ve asuodgi 
uq ‘sXked SIQAIp So] OU UONNQMIsIP ke] op 39 UONONp 
-o1d v] ap UONRISIIUI,| @ puodsa109 UOTeSI[eIPUOW PT 


uoHesyeIpuowl BT ["T"Z 


8cl 


‘9LO WIM eprurd (ourUO) EMTNG ‘sICOD ‘HY XyIpg ‘epeueD enbysneig ‘epeucy np Joyo ua uatonsneig ‘Waljaj q UAT | 


‘Q]PIUDWISUIOANOS UONUDA 

-IQ\UI,P SOUIRUIOP ap [Ie]UDA9 adie] UN Ins JUONTJUI INb 
Sdd10J SapULIS bUID 9UIIO JUO 9}TUUOD 99 ap SAIQUIDU SIT 

‘966 2190190 Ud epeURD Np dAlid JIasuoD 

Np Jayjoss aj Inod jataisturwajul gytwW09 un Jed giedgid 

«g]eIo0s UOISaYyOR — uleuny juawWeddojaaaq — souURsSsIOID» 
ywodder a] Ins apuojy as gpomie., ap omied anag 


sajue19do $3d10j SapuBls SIT "7 


SHNOLLITOd AG AWALLVIN 
Nd SIWUd XAVdIONINd SUT “7 


‘onbnsiyejs eB] ap xnevoing saj Inod a1sa}eNs 
ouuog dun a9 WeLnod ‘tow uoyas ‘Inb 39 ap ndsode | & 
QIU | Ip SOs 9] aJOKsUOdD of ‘uIJU_ ‘onbnsneis e] AUIBDUOD 
inb 39 ua sajyuaunjiad yuos Inb souvUJaANOS ap ja anbnijod 
OP BINLW Ud S9dULPUd} SOUILIIIO Op dJINSUD IeJoTIEd of 

‘saddoyjaagap sked sap yrednyd vy & 
juonbrydde .s suonearasqo Soy ‘SIAR UCU &B ‘sTeU ‘epeued np 
g[suv | SNOS UONENIIS L] JURUTWURX9 Ud IBIPal 919 ve WOdde1 
¥] ‘odnoiz3 np suorsnjouos sep ndiade un Jouuop sed ouop 
TRIDDUSWIWOD af ‘epeURD onbnstyeI¢ Jed sesedoid ouis9} 
SUC] & SooURpUd) SapUvIS sap sIpuojoidde asAjeur,| op 
armed apuess ud aiidsut,s ‘966 | 9140190 ua gyuasaid ‘yodde1 
dD ‘UOIxaTJal op odnois np yoddes np spuewiw0d x] 919 & 
sosud sainsowi sap oun J ‘sAud Jlasuogd np Jotyjo3 a] red 39 
JOUIgRD Np soiquioU Soy Jed sag;NULIOJ sasnatias sasA]eur .p 
oQpuLvulap P|] & doRJ a}1Ovded 9}]00 IWUDJUIEW Op spURWUWIODAI 
JUSWIUULIOU B SIWIOD J] “ayjonjoe sinoy | B JUSWIOUIOANOS Np 


sonbniyod sap asAyeur ,p ayoedeo vy ins yoddes un sdjuasaid 
ap sesivyo salleuUONOUOJ syneYy dp SULIOJ [alIg}sTUTW 
-IQUI 90D UN JapIsoid B S}AUI 939 B JOYyD Ud UdION 
-siyv}s a] ‘oddei 90 op uonviedaid vy] ev sind ‘apuewiu0s 
eI] & QUoU jUO INb sadej9 soy suep JU OdUUT JURUdAIOIUI 
un 919 & epeuRD onbnsnei¢g ‘saeisos ja sonbiydeisowep 
‘sanbmuouos9 SaouRpUd) Sop UOSTeI Ud SOOT UL. B IDI.p 
QUUDIPLULD 9}9ID0S RI JUDWUITQu|quidsIeIA JUOIJONbiew Inb 
UOISUd} Op SddINOS Sa] Ins WoddeI uN JosIpal ap (UOTXdTJOI 
ap odnois 9] relayjadde .f onb) soraysturu spuris soy inod 
quey[iVaen saenbryijod sap xnedroutid sayskyeur .p odnois 
un & gpueulap e& (gAlId [IasUOD Np Joljois a) epeued 
np onbijqnd uonouoj ve] op Joyo a] ‘1UdUIWWIDD9y “OYdR) 
ew op orsed oun,p uonndaxa,| Inod sayne,.p ins Josod 
-d1 dW ‘aouaprtoUrO; Jed ‘I10Anod ap aoueyd ap dnooneeq 
af-1v IssnYy “IIUdAP | BUIBNUOD INb 99 Ud InoUNS ‘suOIsIAgid 
SOP IIIV] IP ILO JIP UOJ JoJJo Ud }Sa [I ‘asepe,] UOTES 
‘axaduioo snyd a1ooua astid 
-91]U9 dUN }sa onbysNe}s ve] op xnvaing say] Inod Jaydope ke 
dIBICNS LI Ip Joploaq ‘ajloej osoyo steurel sou sayuouTyIEd 
SIOULPUD} SI] JOUIOOSIP Op ONA Ud IIUDAP_| INS Jayouad as 
‘epeurs 
np onbysnejs 939190 ek] Op 866] OP lonuue sgquiosse | 
B® gououold 10,p sal[lepeul sop ossttuel op sinodsIp 
NY JUSWIIPUOJ Op IAIJS Issne ® |] “(L661 SIQUISAOU ‘SoIpuOT) 
QOUDIIJUOD, SIOSE) SONSNVIS WM LO6I LI & oNatgjue 
UOISIOA OUN sUep dJUaSaId 9}9 B JUDUINDOP JUasaId JT] 


SHNOLLITOd AG AWALLVIN 
Nd SIWUd SUT ‘NOILONGOUINI ‘T 


‘anbytode aytanoalqo ‘aousurjiad ‘janydaouos sped ‘uoneoyiueyd ‘aisayens ‘anbysyejs sulstues1Q. :SATO SLOIN 


“so]Januessa ouinsa f anb sarainonied 


soinsou sap ndiode un Jouuop ap teiaju9} af ‘seo anbeyo sueg ‘ajeuoNeUsajUr o[[OYI9 | & UONeIOQe][OO P| 19 B Ua UO,Nb 
uondsoiad e] 39 anbytjod 91a H9Efqgo ,[ ap UoNsonb ev] ‘douduTVIAd Sp 9Ad]9 NVAIU UN IUDJUTEUL Op 39 JIPUIOE .P UOSE] eT 
‘sjutod sto ap iesoyreyy af ‘sodoid 99 y ‘aInojua snou Inb apuoUT 9] DIAL SUONILIOJUT SOU J9I9B JUSUTUIOD :«dUIN}X9 JIB9IV.INS» 
UN _,P SIUSUIZIP So] TeILOgp of ‘nary JOIWOp U_ ‘sazat[Noed usIg soANENIU sop o8rxo syIqeidepe ]]2] aU, ‘soyquidepe 
JUSW9[L9eJ JUOS BSeq Op S9IIATIOe SOU oNb JaInsse Ss B a}SISUOD INb ‘Ind1I9}x9 | & JUasInpoid as Inb sonbrwouods ya xne190s 
S]JUSWIDSULYO XNe BdPJ SII] 9P SNA Ud NSUOD ‘aIBd}VI]s JIJOU Op [eIUSUIEPUO] JUDUIYTD SUIQIXNIp 3] NO,q ‘sesuadgp sou ap 
J] QIej JUDWISATIL[OI UONIOdOId oun nb yUaWIa[qeqoid jUd}UasSe1daI OU SaQUUOP ap SoUla}sAS XNVIANOU Sad ‘sfanuassa Nb usIg 
‘epeued anbiyse1¢ ap SAAeNIUL $9]UIN91 Sp INs JURSe DUI Ud JUIOd 99 TeJONsNII[I,.¢ ‘seguUOp op soutaisAs op sodA) xnesanou 
ap uoNeIOgeR[S,[ BIOIISsoo9U BVO ‘ed ouNn,q ‘sonbysnyejis xneoIng sap UOUDIUT,| B DUIOJUI dIS9}eIIs oUN JossInbsa_.p 
‘gpgogid eine inb asdjeue | op sed e ‘tesa}uUa} af ‘nol] puosss uq “WOAe Us ned uO,nb sajuaye say Jo JUOUIDUIOANOS 
np oinjeu ek] Wqns anb syuawasueyo soy ‘ulus ‘ranbeye .s ney [I soyfanbxne segues anbiytjod ap suonsanb say ‘aqinsua 
‘9191908 AOU }9 DIWIOUODY oN}OU JUDTFIpoWw INb sao10j sayediouud sa] ‘proge .p :sanbystyeIs sourstuesso so] JuaNTOAg Janboy 
SULP 9}X9]U0D 9] IeJo}UNsgId af ‘nal] Jared U_ “Ia]UOIJe So] BV JoIedgid as JUDATOP SI JUOP UOSe] eT] onb Isure sanbysneis 
SOWISIULSIO SI] BdRJ JUOIO} sjonbxne slap sa] JOUTULXS Jo JULAL Ud JopIeSaI aiIsap af ‘a[OaIs DUIQIOZ Np UY o}}00 Uq 


aWnsad 


LOATH “d NVAI 


IUIAB | ap UoTeIBdoAd BY — Sanbyste}s SIdIAIIS Sa’T 


Zéel 


epeuey anbiisiels 
Gri-Zet ‘dd ‘Zz ,u ‘Sz JOA 
6661 aiquiacep ‘ajenbusa,p sanbiuyoo | 


" 5 

Wade. Le a 
iy "oe tare Pr 
a an +e 7 Je prey Dea oa 
Rit) @Linee iw 
@ eo wby) Jw WARE 2 <a 
Byrne) Tie Day Mob 
Gis WhaAsee er 6 HY?) 
bes wt 7 Ten roe, Oa pa § 
eeu cr ate Es > (ier. ae GAs w » 

2 ue?) CS 04 vq ¢) oe. vet oe gay » A 
taht BP anaes eq dwg Orier tS Awe 4 ao, me apa al 
ee AA ee en? as) VT ae 
OP ee pat) A in 

y ay (FGF liye paws: ") i op \ Fen 2 16 7 eee 


7 


r MT via na 1m 34 Siu eR ally 
2 npr nei ety As a ; \ , - 
ied be i had ae ats ; he i 


Am i : ; ae Ad ; 
euel tare Ebi reds 5s e189 . : 
a a ' _ a Ae mY 9 @ 

Pers? 6 Wh Wats, : : ut 

dl inet ae ¢ b aol wens , 
w e Riser A AD 
Ws Bip an I SP better ; 
Dif esp ora Sw SFr « ; 
Stee! Wet) wep 6 ows : — 
eC ae : 
Pies | ae Che , 
a | or 
wi) oy Ta ; 
es ayn i_Qhen ie nrivlw oe eee - abd 
ee ee x 
Pateeaee Wea Ayer avers | MAUR SiH IvI Fa 4 

; Te Rie GS! Hy 8 COD ; a Rede Oe 
Cae Rosa eg % oT AN Fie ae 
prayer raion adey um | 
) Wrees OAs prapng, 4 fio 
scala ae ay STH USE iii. @s & , Ne ae als tJ it ea ai te 
lie nce ihr... o : 

ae bi fe Gate Pern | . = - 

a SS: ora rv 


9 ya ah) PAuatier 


iy 6 pa feos ee ae Se da 


e 

» 
Mle 
s 

* 


eA Mee > inte Yeap ae oeni 4 4.40 Bie hess 9 
Wiihtel # a fh Pa ae alia in Pea IPT ue va Md a re Me!) vit 5 ae a 
prs ae ORV hs Oo ud a Oe a a 
hay): ee ph? Qa Sate ns ha : (iii eae 
wen ey See bo =< Tws af CQ) ; 
LEA PACT SORE, © Bn ope co, ah 2 
Ne i ee betaere ara nowt 
PA thet CAN 5 alin (Uipreenptic: Tay pi iL , (om 


th ee pm AOA 27'S, Pde 5 eal or" emer > Aly 1 na 
pet vite Lae Go? + SA *Y iA jis iy AWAOend rte es TT MulLAaT ns ; 


* Wiegenev-eirenay DAV wml rh er ae 
veneer Hen ser i pes vy WEDS. Slee > fetal Lh es i rein ts 0 Ft, aki 
; ime wi sonnel (te Sapa doen!) Yio Le ee Ppt Corel Veh ity LAR | es 
lneoaaeeial (a9 apa ine ¥ ay iia SOA es mr aie i“ 7 Ty, Piiyy 


se (oy 


“Id “UBANIT (S861) ‘S'S ‘HOIAONYVZ 
“eId UB AWMNIT (7861) AW “TIM 


"286 JeTInl ‘algnbua.p sanbiuyoay ap uonsesIp 
9P JWOD Np [eQIoA sQoo1g (8861) VAWNVO ANOLLSILLVLS 


‘OL ‘alanbua, p sanbiuysa I 


‘uonoepg1 op onbniog ‘(¥861) VAVNVO SNOLLSILVLS 


"| ‘€8ojopoyjapy 
Aaaang ‘uonsepgs op onbutod “(SL61) VAVNVO SANOILSLLV.LS 


“suoS pue AdTIAA UYOr 
YOK MON *6 ‘(CSP “UOSUYOL "TN 19 2109 *S) ‘SaouaIDg JOIUSIIDIC 
fo nipadojaxouq sueq “K8ojopoujay ASAINS (8861) ‘dW ‘HONIS 


aAd VASO 


‘JoUS spUuOU oJ Sup ajURIgpUodaid 
sorjd oun odnooo nb ‘aygnbua,p sanbruysa) soy ins 
sesieroads uoneorfqnd oun juaweese stew ‘neaing 2] Inod 
UONOWOId op dedIJJO [NO UN JUSU[Nas UOU 3S9 ajanbua, p 
sanbiuyoat “Jay 3139,p uosiel ke epeueDd onbysnrs 
JUOP ‘ONAaI eR] Bp douLWOdUIT | ap 19 [eIDUaS IeINL | Op UdIq 
ous1oul9} (Q/) sked xnaiquiou ap suep sguuoge ,p aiquiou 
pueis a] ‘sonbneid ya sanbioay) syeiaiul,p ajqeireynos 


Sel 


UOSIRUIGUIOD OUN,p asudjap PR] aInsse Inb 90 ‘apuowl 
3] suep ynoyed ap sgaud soulstueSIO .p Jd XNVJUSWIOUIIANOS 
SOUISIUBSIO.P ‘SOUSIOAIUN,P SNSSI SgIDOsse sINojORpel 
op gysisse }Sd Joyo ud INaJOVpal JY ‘uOHONpold eI op 
Indo1Ip epARJ YURI] 39 syngep say stindap ajsod a9 adnd90 
Inb ‘Joys ud INd}Oepa1 JUIT[IOX9 ‘YSUIS ‘gy ‘UOTOOIIP 
op sW0d np juaprsoid ‘ouO\syoRIg UOpIOH sed onIew 
Op UILU dp VaSIIIP 1Sd oNAaI RY ‘saguue sinaisnid sindaq 
‘ajgnbua .p ueyd np sajqrey snd so] suaty soy — asuodal 
-UOU PJ 39 SoeUUOsoNb sap UONdsdU0d FI INS safoIe .p 
siquiou pueis snjd un,p uoneoryqnd ey] Joseinooua.p 
‘stoJo]no} ‘naly ang-jned yeine A [J ‘[e1gues 3Q19]UI,p 
sjofns sap ins juayod saponse sanbjanb 3a ayyenuUeplyuoS 
R] op ‘UO NdUIT | 19 UONVOTJLIVA LT op ‘aytyenb ev] ap soues 
-NSS¥ | OP ‘SAQUUOP Sap 9199][09 ap 39 dsA[eUL Pp SOpouIoW 
Sop JUdIIe sapoe sane say] ‘asvuuol[Hueyog.| we sonp 
UOU SINII SI] INS %Z] 39 sajgnbus sap uonesogel9,| 19 
aseuUoT[HuLYse ._p urd 9] Ins %0Z ‘UONeWINSd | Ins yUoLIOd 
WILE ‘satgnd sapoe OTP Se Ans ‘pz B | SowINTOA ‘a}gnbus.p 
sonbiuysa yy, op xapuy,| suep sanbrpur yalns red uoneorisse[o 
Bl QUILURX UO | IS We] aq “AURUUOISSaIGUWII WO} so aT[aN}OR 
dindy,.[ B ONAdI ev] suep satTgnd sjolns sap dI9LIVA PT 
“O]URUTLUOp doURpUd} Be] Sed dUUDIASp ou 
1999 onb Joinsse .s ap JURIOCUIT Issne 3NO} 3sSa [I ‘sonbuosy) 
sopoe sap Jorqnd ap 3a JoUsITNOS op aireyNy[es 39 JUOUTIOd 
wos ji.nb uaiq ‘Yayyo uq ‘shed xnoiquiou ap sind9}d9] 


6661 siquasoep ‘ajenbua,p sanbiuyoos | 


. 
. 


sop soidne jrnvonpe je [eigues wee uos aipied yeinod 
NADI LI ‘9dJ9X9 3S9,U B[QNUOD UNONe Is ‘anb sIojajno} 
JUSUSIVIO SUIvIaD ‘sajonie sap Jaiqnd A juafnoa inb 
XNOO JUOS XNIIQUIOU Jd SdIIe}ISIOATUN Sap soidne sireyndod 
$Q1] ONUDADP $9 SNA PI ‘SaQuUR SdIQIWIIP Sap sInoD NY 
“"NU9JUOD UOS op sivJsizes JUOS 3a aIT]eNb 
opuris ap uoNnvoryqnd oun jsa,9 anb yussapisuoo yednyid 
P| ‘syteysies yuowoutatd sed juos ou sanbyeid suoneordde ,p 
IQeW Ud SUIOSaq sina] onb yUdUIT]sa sind}oa] suTeLIIO 
anb juaquoU sajyudda1 sapnia sanbyanb ap sivinsai so] 
onb uarg ‘anadi P| & dR] SJaseSN Sap SUOTIOvAI Sa] aTeUUOD 
Inod gydIeUl ap Sapnje Sap 9UdU! OUOP ¥ ONAdI ET Bp UOTOOIIP 
RT ‘Soyuae Sap UOTINIOAD,] B JO SJUUaSULYS xne Jo\depes 
Op a9edvod BS JSd SNADI 9]NO} ap [eJUSUIePUO] JUDUIZIA J 
‘UOTIAIIP IP JWOD NP UOTJR9IO PT Op JUSWIOUL Ne IsIe]S 
919 B UOTOLPdI Op ITWIOD 9g] ‘sjoUUOISsajoid sjusWIASeSUS 
Sas & sIpuodal 110Anod op ja onaal ev] sup sattqnd sjalns 
SOP ONPUd}9 | 19 JURSSIOIO DIQUIOU JI JO}IIJOI Op UY 
‘ONADI BP] SUP SQOUOUUP JUSUIIV39 
UOs sajgnbus sap jure. sanboy[oo sa] 19 SadUaIaJUOD SAT 
“Sa[PUIPNISUO] sajgnbua sa] 3@ asAyeue.| anb isure ‘sjusu 
-assi[qeia sop saidne saygnbua sa] inod sagsijnn sapoyyoul 
So] ‘SoguuOp Sap asdeur | “JUSUIASUIDOI NP SIO] dINVSANOD 
OP SINILI9 SJ] : SJUBAINS Sa] SUOUUOTUA ‘sayeIoads suOIdaS 
op yolqo ,| ej Isure quo Inb syafns sap siquiou ny “Jatpnoried 
19Q19}UI UN JuRJUASEId sjafns sap B ‘UOISBDO | B ‘SagIOBSUOD 
919 Issne yuo sajeroads suonjoas saq “(8g6] epeurD 
onbysneis) gg6] ue enaal ey e aginofe a9 & «OJOUINU 
90 SURC» sg[NIVUI soRJoid oUN ‘ag[No} aad sue “saygnbua 
Sop oiped a] suep juouUdtAIns inb sonbrsojopoyjow 
sourg{qoid sap Jo[dur09 [reyUdA9g_,J Joqoysus Inod sinyaANO0d 
BS dIPUd}9,p YNUIUOS & ONAdI PI] ‘SUIOSEq xNeaAnoU xne 
JO S9NUDSIX9 SO]J9ANOU xne sIpUodal B JURYDIOYO Ud INO], 
‘(861 
epeueg onbnsneis) onbysneis swistuesio un JUdssoigqul 
inb sanbysneis sap juowaddojaasp np sjoadse siIoAIp 
$9] INS soporie sap atjqnd ajanbua,p sanbiuysaz anb ure 
‘g[jouuonoepas onbuijod ev] e@ saayodde 939 JuO suoneoly 
-IPOUL SayUeLIOdUIT .p ‘AUIOIUL,.| YW “STPUOTIVUIOJUT 9UQDS PV] INS 
dovid oun ag][Ie) Isure 3S$9,s anvol PR] ‘OUIOIX9 | YW “SUI}X3 | 
e.nb ousajur,| eB que) ‘ondzod yeyg onaal ey JUOp UodSey 
PI JOIJIPOU! ap JoJJo Inod na yuo s}UdWIaSULYO S90 SNOL, 
“xneloads juauouu0ge .p 
SJlie} Op Jo1olyauaq nd yuo suoneioosse sao ap sorquIdW 
Sd] ‘Sp1099N" S90 Op SOULID) XNY “YIAVaSay uoluldG I11qGng 
AOf UOIDIIOSSY UDILIUY J DAB “JUDWUUID9I snd ‘a VOID 
-OSSY JDINSNDIG UDIAUY | ‘epeueD np anbysneys 319190 
PY ‘sajanbua .p suatonsneys Sap sBUuOTeUIOIUI UONRIDOSSY ,| 
IIAP SN[DUOD 9}9 JUO UOTINGLSIP ap Sp10Od9v Sap Jd Neal] ne 
UO SUOISSNDSIP Sap ‘SUOISIDP $99 SAINO} B JUSWE[QT[VIe 
‘UOTJODIIP 9p SWIOS Np 
suolungdl sap Inof np o1ps0 | & JUAANOS JUdINSIy UONONpoid 
RI & Saal] SuoNsanb sa] 39 suORoI[qnd sane So] I9Av SUSI] 
SS ‘ANAAI PB] SP UONLOTJLIL) VT ‘Sa[[oUUOIssajoid sUOTeSI[GO 
Sas ap aj}du109 JuRUa) Ud ‘anAd PF] op UONONpojd ey ap saseyd 
SOSIDAIP S93] JOUUOPIOOD RADpP ‘UOHONpod vy] ap INa}OaIIp 


@1/0}SIY,P SUB GZ “4ALld 


UN Pp QISISSe ‘UONOAIIP 9p aWIOD aD “OUNSIP uOTdoIIpP 
OP STWOD uN JI9IN Op Inj aJUROdUT UOISIOSp oyNe ou) 
‘a10dua Iny ,pinofne aarasqo 
uo, onb sourpud) oun ‘saponie xnoiquioU op jUR}EWINOS 
Ud UONRWAUL.| & Npuodar ev sfeUOTRUIAIUT sIATIOIT]OO 
RT “INII}X9,[ IP sopose sop JaOJOS ap jo Jaj}dao9r ,p 
JO UOTOVpPal Op 9IWIOD Np UOTTSOdWOd PI 39 BNAAI P| 
OP SINUIANOD VJ IISILII,p Yploap 919 OUOp & I] “ayeNIUL sT[OU 
-uonoepal onbrtjod ve] suep sgouous 9j9 uaTeAR Inb ‘anal 
RI op siomueid synoafgo say ona ap aipsad ap Ja}IA Issne 
WR[NOA UO ‘JURpUddaZD ‘sINd}d9] Sas 39 SINaIeIOgR][OD sas 
‘NUQJUOD UOS JURSSIBIL[D UD ONADI PI IP SUOBIIJJa,| 19 INI[VA 
P| WesJo}USWISNe UO | onb asi[eal B UO ‘ANAdI BI OP BINWAANOD 
RI B 19 BJfouUonoepal onbiytod vy ev ye e Inb 90 ug ‘[euUL 
yinpoid np syyenb e] 39 uoNONpold op oypides ey Joinsse 
R AQUeU op ‘sdvdIJJo snjd 39 SwWIOJIUN snjd npudl 919 & 
uononpold ap snssadoid a] ‘saio1jawie 939 JUO UONRUSs9Id 
eS Jo UOISsoIduII | ap ayyenb ey] ‘Jerguas yoadse uos ‘snjd 
2d “(7861 AEM) ensur[iq uoNeorgnd oun juowral[arorjjo 
INUDADP 182 Io 19 JUSUIDJINIVIS saNqUsIp ane,p asseo 
B ONAdI PT ‘suOneognd op sreeUL Ud epeURD onbuysiRI1S$ 
ap onbiyztjod ev] & yUdWUaULIOJUOD ‘ISULY “So]URIIWIODUOD sUON 
-POIJIpOW sInaisnjd gipuasua ve Inb uoIstogp oun ‘epeurD 
anbysyeis op aj[aloyjo uonvorgnd oun asnusdaap pio0ge .p 1s9 
ajanbua, p sanbiuyoa J, “NAdI BY SP B1QJOLILI J] JUD] GISUas 
JalJIpoul ap jojjo 1nod na yuo nb sayueyodun suorsisap 
Sasnaiquiou op jUdWassNOgeE | snbrewl & pes] ouUr,| 
}9 ‘a[[anpess seul aJuL}SUOD UOSe} ap ‘aNjOAg kB aNAdI 
R] ‘QOUdISIXO,P SodUU SatoTWaId XIpP sas op sINnod ny 
(8861 YsuIg) seouatog 
eonsneis Jo eipadojsAougq suep sijqnd aja Issne ve ajanbua, p 
sanbiuydaJ, Ins spose Joiq uA ‘sanbysneis suoeorqnd 
19 SONADI SOSIOAIP suRp InY,pinof{Ne JUDINSIy soporse sao 
@ SQOUDIIJaI SOP 19 ONAI LT SuLp sar[qnd sajone .p sexe 
souInsal soq ‘ajgnbus,p sapoyjaul xne aaioesuoo ‘anbiun 
anbiuyde} sNAdI 9UN JUL}9 OWIWOD SPUOTBUIDJUI SSUTWUOUII 
oun j9 a]JauUOIssajoid uoNeyndei oun sinbow jsa,s anAdl 
PI ‘SUNOS JUSUIBANLIAI opoliad oun u_ “IouUOgE Ss B S9SSdI 
-91UI JIP JUOS as sanbrysiye}s souUsIUeZIO Sap 39 SafoTIIV sop 
DINOUINOS ILO[NOA B QOUSUTUOD JUO SUdIONSR}s sa] “shed ap 
dIquiOU pueIs UN .p sanbysnyes SOWISTURSIO ,p 19 SUDIONSIIE}S 
ap seidne sindde xnaiquiou op Jauses op onAdal PY & stuIad 
ISUIL B I[O ‘Sa[qeJ9PISUOD SjaJJo Sop No ve XNOIOVIS 3191) 
B UOINGINSIp ap anbryijod ayap ‘sesueNs | ve sonbysneyis 
SOUISIURSIO Sap B Jd SaJgNbusS Say Ins sYyd1BYIAI ap saUso 
xne ‘sgjisioAtun sop sanbeyjolgiq xne ‘xne1outAoid 3a 
XNvJOpe] SoIVISIUTL xNe sane anua ‘epeurdg onbysye1sg ap 
INOLIIIXI | B ISSNY SICU INIII9IUL | B JUDUITNIS UOU “JUSLD} 
-INJVIS DANQLISIP }1eI9 aI[9 ‘epeueD onbysnyeig ap joauuossod 
a] Jed sasipal soporte sap JUSWIdAISNTOXS atfqnd e anAd 
BE ‘S99uUL Pp SIQUIOU UTeIJ9 UN JULpuUad Ja sInggap ses Y 


‘(UOTONPR “C861 YOIAOALZ) 
‘ajgnbua .p sanbruysay, Suep JURA | Op SASTU SoapI 
So] Ins onsed spuvis ud saseq 919 & UONLIQUOS 
91190 OP UONLULIOJ VT “SUOTRSIOAUOD SOSNoIqUIOU 


vol 


“epeurs (OuvjUd) eMLNOC ‘epruLD enbysneig v stojanne ‘sanbysneis sajgnbud sof ins [euONeUIDIUT JULI[NSUOD “Yarryg preyory 


ap jo{ns a] Wed a[9 39 SUdIONsNeIs op uONeI 
-9uas ounof vj red g1ogidde juowiojney anbrporiad 
un jnj dJgnbua,p sanbiuysay ‘shed anou sueq 


OIAPTSOSNO X 
op uUdIoNnsyeys JUOUTUI ‘YOIAOYIeZ “S'S  giepoop 
B | QUOD ‘sudTonsNe}s xNvdANOU Sej Inod yUSWIBUSTIASUA ,p 
}9 UONPUIO} ap [NNO un ‘sjngap sas sap anbsaid ‘anuaaap 
}S9 naa vy ‘sed ap aiquiou uleya0 uN sueq ‘sojgnbua 
SOP SUSIDIIOSY} ap 19 suaToneid op [Ie]USA9 puvIS UN B SOOPI 
SINI] 19 XNVALI] SIND] VITLUUOD JIIeJ Bp DoULYO LI IUSILAL 
saystpetoads sao ‘sajorie pp uoneorqnd ey Jeg ‘ajygnbua.p 
Sapoyjeul sap saystjetoads say anod tap un yo xnarogid [yn 
UN ONUDASP JUSUIAILIPSUIUII }S9 a[[9 19 ‘ayanbua ,p sanbruyoay 
Sop ouTeWOp a] suep sdura}su0] sindap 1e}s1xa nb apa un 
J9|QUIOD DUOP UDA BNAaI B[aANoU VT “aseuUOTNULYIE ,p 
urjd np soanbiyeusuyeu sjoodse xne soloesuod JUsW 
-9][eNUASSa Sajotue sap jusrerjqnd anbods | ap sanbusneis 
sonaal sap wednyd eT “urea 3] Ins aanbus oun ,p ajinpuos 
ev] Suep JusUUdTAINs Inb xneiguas sanbisojopoyjeul saue]q 
-o1d say argtuiny ua ame Inod ‘agei9 y1e19 sUNqIN a][93 
aun nb stoj arattuaid vy] 11e19,c- ‘stogid ustg yo onbrun owey) 
uN & dINBSUOD JI[oUUOISsajold NADI dUN J99ID ap 3IeI9 
Jnoolqo | onb juautaseyo san euoU 9y109I1d gououd TJ 


(uononpey ‘S/ 6] epeurd onbnsije}s) 

“neaing os] NO UOTOVpal Op 9IIWIOD 9g] Jed sagseyed 
judUalessaogu sed juoras ou suotuldo singy 49 
SQ[OIB SINI] 9p NUD}UOS Np s}I[Iqesuodsal 31919 | 
JUOIOAIOSUOD SINIINV Sd] STL ‘dINJDe] Op ayTWIO0S 
un Jed san[ead JUOIas SapoIIe So] SNOT, a] [9e1 UOT} 
-enqis ua soanbiydde sastoaid ajanbua .p sapoyyeut 
op uoENeAd,| Ins jd uUONRIOGrIA,p sIsaIeNs 
R] INS Stu vIas yudDNR J ‘ajgnbus,; ep saseyd 
S39] $9}N0} 91QUS SUONPIAI Say] onb Isure uONeNyRAY, | 
‘uorjej}oidiajut | ‘anbysiyeys asAyeur | ‘suonevordde 
SIN] Jo BseUuUOT[WURYSE.p SauIasAS Sap UuOnrI 
-Ogrld | ‘ASPUUO][ULYIE | B SONP UOU SINALO So] 
‘ajanbud ,p sye}[Nsa1 Sa] INS saa sing] 3a SoguUOp 
QP a0a][09 ap sonbruyse) say ‘anbyeid s1ps0 .p 
SO}UIV.IIUOD Op JURTNOSap UONdadU0N ap sauetqoid 
$9] Ins }USUTUUe}OU ‘aJgnbua,p sapoyjaw Sap UONeI 
-Oqv[a,| op saseyd sa] soyno} ANS sopoe sap ISI] 
-nd ajgnbua.p sonbiuyseay, onaai ey ‘ajygnbua.p 
Sopoyjaul sap sjoodse xnoiquiou ap soanbneid 
suoneoidde sa] ins soporue .p uoneorqnd ey inod 


‘UdIPBURD 9}X9]UOD UN SUep ‘oUNQI} oUN ITUINOJ 
ap isd ajgnbua_.p sanbiuyoay, onaal ve] ap Jndelqo TJ 


‘yins Inb ayauuonoepeal onbuytyod ey] sustourg) Ud OWTWIOD 
‘Sd]SOPOU! 3.119, P ULO] JUDIL}S SUOTIIQUIR Sd] JUOP ‘SUOWUT, 
[neg 19 (Jayd ua INa}ORpal) YsUIS “qyW ‘(QUopIseid) 
Yale preyory ap gsoduioo uonoepel op aywos un sed 
dISLIIP SIOTL 11219 INADI I ‘SOJSAPOU sINgap sap d13|eIA] 

‘UOISIAIP oun Jed ag}USUT]R 19 JaSLIp ‘OUIO}UI 
UOISN]JIP eB uONedITgnd oun jUSWIITJONUASSa JIeI9 ONADI 
RI ‘singap sas Y ‘ajanbua,p sanbiuyoay ap ‘aginjyeursid uou 
sTeuL ‘Inaonop ua DOURSSILU PR] V “C/6] Ud ‘EISISSe UO] oNb 
ISUIB JS9_,d “OINIOI] AP S9IWUOD Sap kB STUINOS o4}Q JUDTe.LINOd 
Inb sja1oyjo sajonie sap jaijqnd ap Iisap a] 3a ulosaq 
a] ‘epeurd anbysyeig ap susionsiyeis say zoyo ‘saddoy] 
-dAaP JOS as dWIQUI dp ‘UOISURdxXa,| Op stid yUO JUdUOd 
-doyaaap 19 syosoyoal op xneavd soy onb ainsow Y ‘sane .p 
uaiqg 12 sasuodal say suep uoNeueA vy ‘uoneindum,y 39 
UONBOIJLIDA VL] ‘SJUDWIISISOIUS sap ase[dnoo gj ‘sayeuoIsel 
SUOTJLUINSD S2] INS sane oqUS JURLOd ‘sjURVOdUII safoTue ,p 
aiquiou ulead UN,p UuONPoqnd ke] & IAJaS JUOWIOTe39 
UO Sd]][q “SUIOUD }1e}9 SdLIgs XNap sao Jed syaAnoo sjafns 
OP [IBUWIAI JT ‘SPALId DYdIOYIOI Op $o1jUdd Jo SayISIOATUN 
‘sanbujse}s SOUISIURSIO SIDAIP SUBP SO9ANOI}II S}IA JUOS 
as suoneorqnd sao ‘duta}UL,| @ SIONQIISIP JUDWAT[aTJUSssa 
uaiej9 sotjo,nb uarg ‘[auuosiad a] nod uoNeULOJ op [NO 
UN JUSIL[NOA as SaT]a 39 SoyUeLIOdUUI sn{d soy suONesSITeal Sap 
a}dui09 spuds & 1USTeSIA SUONROITGnd xnap sad ‘ajanbua, p 
sanhiuysa][, ap Sinasinoeid say ‘ppunsouap yo ulazyjng 
Aplaj4on@ suoyeoryqnd so] sageio yuainy onb saanonpoid 
SOUAIIOV Pp apoliad 9109 JULINP JUSWITL39 4s9,D ‘sapeuon 
-PUIOIUI S9OUdIJUOD Sap B sagjUasaid 9139,p SOUSIP ‘soo 
-CAOU J2 Sa}URLIOdUII Sagpt Sap B doURSsIvU QUUOp & opoliad 
anaQD ‘epeued onbnysneis op ulas ne gssoiso1d yusWapuRIs 
JUO dISO[OPOYJoW PL] ANS saydJoyooI soz atjanbey yueinp 
apotiad oun — ¢/6] 19 096] BUA SIAR .p apotiad apuvis 
oUN .p JUsWassNoge | Wenbsewi oyjo ‘sinatsnyd ssoye ywdins 
ud uonvorfqnd ayeo anb ualq ‘a ajanbua,p sanbiuyoa] 
op olguiNuU ated 9] sttqnd ynj aonb ¢/ 6] uinf ua yso.5 
“Inayowo1d 
Issne Jno} soUOUUR,S IUdAR,| J ‘aJgnbus,p sonbruysey 
op sayeu ua gone yey Inb ‘mnayeaou yo onbiureudAp 
ISLIANO UN BNUDASDP 189 SNADI 9999 ‘C/G] UP dddID “ayqenb 
-IRWdI sgoons uN sjnqgep sas sindap yWeuuos inb epeurd 
anbnsiyei¢ sed satjqnd onaos oun ‘ajanbua,p sanbiuysa] 
op diresIaATuUe dUAINbUTIO-}3UIA a] anbiew souuUR 3190) 


rtALV Td GUVHOla 


dALOSTY -P SUB SZ — 
djzonbus,.p sanbruypa jy, 


eck 


epeuey enbiysijeys 
G2l-ezk “dd ‘Zz u ‘gz OA 
666] eiquwacap ‘ajeanbua,p senbiuyoe | 


ysuls ‘dW 


‘aygnbua .p sonbiuysay, sa7 aiffo snoa anb Ja Zapuayjy snoa snoa ayjanby) v ayyjonb 
apuvis D1 Ans spd vaanpful,u UOSIDAA] ap apoyjalu Dv] v UuolvIYfipou ano anb ganssp Zakos 

‘AIUIAD,] D ANAAY DY] Aadsafadd SNOA JUAWUMMUOD ALAANOIaP ap ULf{D 1DSSa,] D 

si 1sa ad&jojoid ad ‘snssap-19 qa assadpv,] BD aanosl as inb ausy ua asvpuos faig nv Zaipuodaa 
snoa anb suoisauip snou ‘anbiuosj2a]2 UOIS4aA VD] ap adubSssipuUOd) Siid Zainvd snoa anbs1oT 
‘{ qnd-a/SIDIUDL{/0I UDIIDIS"MMM 

/aSSAAPD,] D Gan ais asJOu Y JuDpuad SnOd ua aygnbua,p sanbrussa ], 

p dapaoo0 Juawmapiov{ Zaanod sno, ‘anbiuosjoaja uolsiaA ua agnbua,p sanbiuysay, vp savov 
22ND SNOA adIDSABAIUUD CZ Np JvIIads OsaNU ad ap sajdwoz V.Nb sainolo, p xnanay SINS ar 


‘ouyne | & squigyjoid sa uN | suoNenyzs sayjonb suep yuouTUIaIap 
JO SINIJBUINSA sad JUsIVdUIOD sInaine sa] 1gI19IUI,p suTeWIOp onbeys Inod sprod ap sauraysAs 
SIUSIOJJIP Sof Joynoyeo ve sed v.u uo nb so asejURAL UOS ‘JUSWd}saJIULP, “JOWINSS e oUTeWIOp Np 
sjuepusdgpur juos tnb spiod sap puaidwioo ‘sprod-run inayeuinsa | ‘awetxnep a] “Jonyeas ev oureWIOp 
np Juopuodgp tnb sprod sap & nal] QUUOPp 39 DUIBUOP Np NKdAIU Ne SONUUOD SdIIeIIXNe SUOTJBULIOJUL 
Sop dIISsad9u ‘alapoul op JusWaysn{e .p adioutid un.p UoONoUOJ UD sNINsUOD ‘aIIeaUT] UONOIpeid ap 
InoyewiNsa ,| ‘IotwWe1d a] ‘ourewiop sed uoHeUIsa | I[qeia B JURAIOS BBepUOsS ap URI a] Ins sapuoj 
SINdJBUISa .p sad} xnap JusIpNis [epuKS Jd ORADS_ ‘[eIOads OIDUINU 9d ap J[DIPIe JOIUJAp s] sue 
“squudl[esne sapoouse sastidamua soy Ins saguuop sap ins yueAndde_s asuvyoal 
oP S9pOYISU Sap & sjuLI[NSaI SINdJeUUIISA So] 19 splod sap sajyatidoid soy areduu09 II ‘ulyuq “anbryusyise 
aseUuUo]e}d,| Op UdAOUL Ne sjyes9uU splod sap swig qold 9] Jo[saI JUSWI9T[OINIeU Jd JUSUTATIOe] Jnod 
UO JUSWIUIOS IIJUOU JO VOURLIVA V] OP UONLUINSS | Op Issne aye] [] ‘JHOIpsid spapow un Ans sapuoj 
SINDIJCUIT}SS DUILUOD 19 BSepUOs ap urd J] INS s9pUOJ SINd}eLUNSd UIUUOD sa}aId19}UT O4}9 JUDANAd INb 
SINDJCUIT}SD SAP DIP-k-}S9 9 ‘*xne}0) Sap sanbysujso sinayeuinsd sop ywnpod mnb ‘anbuayjsa aseuuoyers 
ogjodde ‘aseuuoy[nueyse | ap svo a] suep splod sap aseuuoleia .p spoyjyow oun asodoid Jomorg 
“OJAINS & SaInpgoo1d say yuaNsny[! Inb sayduiaxs saydnyyjnw op suuop ay[IAoq “uowsyeuLy “oduuts 
uotsuedxa Jed inajyeullsd | ap sed nv JOUDWIeI as INOd Ulassap B Sd}INIISUOD Sa[quLIVA Sap JasI[NN kv 
d)SISUOD sYoIeWEp PT ‘oxatdui09 anbnsnejs oun ,p seo a] sueq “a[duuts uorsuedxe sed inoyewnsay red 
SUINS9 [210} UN,p doURLIvA Op UONeUINSA, Inod [Noyes ap [NO UN sUUOp II]Jq “sexa[dwiod sinayeurlysa 
SOP DOULLIVA B[ Op UOTJeWIISa,| INod AASNII & BNON FdINOd [e980] Np INd}d9IIP [IJ 9] 389 
syoeWlap seg “uoNesuUesul] op enbruyoa} oun juesI[NN Ud saxa[dwiod seo sap sup DdURIIVA PI Op 
UOICWINSS SUN JUDWIOANIIJJa JOSI[VaI Op JUdMULIAd sayduIls S[NO Sap JUSWILUOD 9IJUOUW I{[IAIG 
“910e]U09 aia & sauUOSiod op no saseusU! op UOT[NULYSE JorUaId UN JUOpP syUdWASsI]qQuId 
Sap asepuos ap aseq inod juedAe ajgnbus aun 3s9 SqAgd dup) ‘sesvusuU! op JyeUssoidal UOT[HURYIE 
uN INS sagpuo] sjUsUTASsI[qeie sap seidne saygnbua no (Sqqd) Skaains ajdums Juawysygnisa 
pasoqg uoynjndod sat nod uosdwoy]-ZuwAloY op INoyeuINsa,, JUoTNO[Ted NZIWIIYS 19 UdAIIS 
“OYdIOYIEI op snyd juLssad9u Sind}as 
S$] 19 SOUND] SI] BUIO [I a][anbe] ap sped o| SUP JJURSSoIOJUI UOISSNOsIp uN sUasSeId [I ‘UIyUY 
"saquaoe1 suoneordde .p sajduaxa sinatsntd suuop 19 ‘gH 19 qq ‘AN Id Wd Sopoylew sop UOTOUOJ US 
aoualgjut,p saydoidde sayediouud ston say suep sast[eod Squsosd soy WLO9p [I ‘sing ‘oyun | op neoAlu 
NV SI[QPOUL! So] 19 UOISI RP] OP NVIATU NL SITQPOUL S9] 91JUD UONSUNSIP oun JURSSI[geI9 UD ‘XNeUOIS91 
S2[QPOUI Sap segues UOISsNdsIP ouN psoge.p ajuasoid [] “(A2UaIDg JDINSUDIS ‘pEEl ‘ORY 19 
ysoyg) sajuasaid e jI,nb ajquiasud ,p ona s1gIUJap e| sindap Inof e ssIwW UN, p RI WSLS |] “O[PUOISaI 
UONLUINSS,| INOd Was as UO JUOP Sa[QapoOW sap jo SopoyjoW sap ndiode un suUOp OVY “M'N’L 


OJBWINU 8D SURG 


cok 


‘Sa]foUUONUSAUOD sn{d sapoylaw sop eB ayooidde ay}09 onbuidwis sigruew op jusedu09 sinoyne 
sg] ‘snjd aq ‘siarpnonied sajapour op sodA} sureyiao inod jurod ne stu sa Noy, ‘aseUuUOT[HURYSE | & 
ayooidde a1199 ap uoNeIdepe ,[ ap 1UdIIL SII ‘SIN ‘SPIIOSSE BDULIJUOD OP SI[[BAIOJUL SO] 19 B[QPOU 9] 
Inod saysnqos s}OAld Sap 11U9}q0 ,p ULIJR UOLUINSS,p SUONOUOJ Sap UONeSI[AN | p1oge .p JUOUTUIeXa 
S]] ‘OSCUUOT[NULYE UD DOULIJUOD Op SaT[eAIOJUI Sap UOTJsanb ve] JUSpsoge UosdwOY TL 39 equiepoH 

‘urvoliguie onbnsneis op jloredde | op ulas ne sjnensiurupe syusuNnso0p 
XN& SINODAI J] aIJOIONV B JUSTIA JUSWaddojaAgap Ne Ja DYdIOYOo eI & JULOddeI as suotIsodoid 
sinaisnjd ajuaseid [I ‘eUOTUIO}UT 9}xX9]UOD UN SUeP SJVINSTUTLUpe sJUDWINSOP sap soiNdli9}uUe 
SUONSITNN Sa] ONAdI us assed IOAR saidy ‘uoNe[ndod x] ap s]UdWASUIIII Sd] JOIOI[SW 39 BIJOINIV 
Inod sjijyensturupe s}uswNoop sap sajqissod suonesi[nn so] o1pnja usneyos ‘afore uOos sued 
‘ouyenb op uonses op [loredde un.p sojuesodwos 
SQ] WLIOEpP JI ‘sIng “BouUdI9YyOS PF] 19 UONRIAIdIDIUI Pp dI[IGIssod ke] ‘UOMRUIOJUI | Op UOISNIJIP op 
aupides ey ‘apnynoexa | ‘souounsed ve] :saquuop sap oiyenb ev] op SUOISUSUIP XIS JIUIJEp |] ‘TeUOneU 
anbuysneis op neaing un,p sjinpoid sap ayyenb ev] ap uonsoanb xy pioge.p apsloge suoj\syovig 
“SQOUdLIOAXd SOP UOSIBUIQUIOD P| 
Jo Saygnbus sap UOSTRUIQUIOD PI 3}SPIJUOS Ud JOU Jo DIedWUOD [I ‘sINaT[Ie Jeg ‘uoTe[ndod «awigU» Pv] 
ap saginuins sonbipoiied saygnbua ,.p saguuop so 9 sXed sinaisny{d suep saguaw sojgnbus .p soguuop 
Sa] ‘asATeur,p 9 UOSIeIedWIOD ap SUL} Sap B ‘AUIQUIOD UO satjanbsap sped a] suep soyeUOTeUNTNUW 
saygnbusa say ‘ajduioxa .p ann eB ‘suouuonUa ‘asod eyao anb sijap say aonb sure ‘suoneyndod 
SQIUdIAIJIP op sgidne saguaw saygnbud ,p s99uUOpP Ip UOSICUTQUIOD ap SazIqissod say WOep Ysry 
‘(sanbniyode) synoafqo 39 syudutjioed JuaInowep sonbysnyeis souueis01d say onb 
Inod s}0¥jU09 Sap II[geIa IN| [I ‘OUII}XI | YW ‘UONPULIOJUL ,P 3JD9][O9 kB] B 19 SaJgnbus sap uoTesI[eaL 
R] @ We) v Inb 90 US IIQIxXLJ aoONdeo oUN JOOgLIP INV] [I ‘AUIDIUI,| YW “S]JUBBBULYO sUTOSaq Sad B 
aipuodal & IURSIA JIIeNS SUN, P SOUII]X9 1d SSUIOIUL SUSU $9] JURALIDp Ud JINsINod [J “suIOSaq 
Sap UOTN[OAY, | JUSpUd}-snos Inb sanbisojouyse) Ja sanbrwutouods ‘xne190s s}usweddojaagp soy anb 
QUIQUI SP ‘UONPULIOJUI Ud SJURISURYD SUIOSAQ SOP JUSWIOUUOIIAUD | Pl1Oge ,p WOep [J ‘Ussoduur s inb 
SaISa}eI]S S3] Jo xNeUONRU oNbNsWe}s op XNvaINg Sa] J9AI[OI JUDATOp onb sijfap sa] OUIWUeXA I3d|[34 
‘Tetoads o1guINU JUasaid Np saforje xnv JURUDJUTeU SUOSseg 
‘osneo BP] & SQNOASP 
Issne SINO[NO} JUOS ‘aISIL[S JUDWII[QeJOPISUOD 9]9 B BNADY L] Op soyOd v] No dguur | ‘pg6] US d}TWIOD 
NP SdIQUISU SNUdADP ‘UOIVY *H 19 OFY “Nf ‘asnouyjoag “Yd Jwouwurjou ‘soiquisw sanbrand) 
‘olguinu yuasaid np ulj Be] & sINSIy sjulo[pe sinajoepal jo sjulof[pe Joys ua sInd}ORpel sudToUR 
Sop dQ[dwWo9 djsI] Vy ‘SInoT[Ie Jeg “dJOU 9UN DOURAL | B JUDATOSAI Sjanjoe sguUOQ? soy ‘opnyiqey .p 
QUIZ) “SAUId} BJ DOAK SLIVA JUDWIDT[QLIOSPISUOD JUO g}IWWOD Np UOTISOduLOd PY] 19 aTIIe] BT “sINdyoddes 
SOP JUIUIASESUD PUOJOId Np jd UONIEPal Op 9IUIOD NP SdIQUIDU SAP JUSWIINOASP JJ 39 DUIT[IOXA | 
Ins JUdUIaSIe] Bsodal Sue Sap [IJ Ne aNAdy BI Ip sadons 9] anb suostoaid ‘ang-jned jnouns Jo uu 
“saystqetoads say zayo aonb asepuos sed sajygnbua ua 
SINDYDIOYS SJ] ZY JUL] BNADY L| Josuejndod ve snqujuod juo ‘Japulg *q 39 UdINIYIS “fy ‘UOIeYy “HO 
‘Iepleg ‘q ‘sjuapisoid suatoue sas ap suteyioo sed ‘rotjnonsed ud ‘19 WSV.[ ep Sspoylaw youvasay 
AaAING UO UONJIAG ek] Jed ajanbua, p sanbiuyIa] sp JUeSSIeUUODAL LJ 19 UITINOS 9] anb suojynoly 
‘anbysyeis op xnevoing xne Safijn 39 SINdJBAOU SopoIe .p UoNeoITqnd ey] Inod winsoj un 
SWILUOD SIUTJap ‘ONAdY e] ap saseq sa] Jojol ap stuutad yuo Inb saporse sap asipel yuo ‘TepuRs “q- “D 
19 O8Y NL UPWIEN “D ‘YSry “T ‘Jon “VA “SJoqualy “q's ‘Ae “q’y “Weysyjog “Of awwW09 
‘snuuod udIq ajgnbua ,p sustonsneis sulejisd anb owIgW op ‘UOVIOM “Y'C 1° YILMA “AW “‘Jeods ‘¢ 
‘WOVOgoMoYy “qT ‘WeyyIly “Od ‘Ia][aJ ‘q'J ‘uo yoVIg “fH suMWODS ‘neaing np sinotadns 
SOIPVD SOP ‘ONADY PL] Ip UOT}eWIOJ ap soguue saz Jafedde ynad uo,{ anb ‘saguue sargmueid XIp 
Sa] JURINp onb ploge ,.p suouUOUIPy “aT[anjoe ainsy | B WNof anAdy L] JUOP [PUONeUIOJUT IN}e}S Ne 
gnqujuod juo Inb syurpyoduit syUSWIdUdAP SUIeIIIO JOUBI[NOS Inod UOISedD0 | Op JoUJoid sreIOUNIe ,f 
‘WOU! ap s[eUONeUIOIUI 
uoneorqnd oun e sind ‘a9}dadsai a] [aLI9]SIUIWU UONVoT[qnd oun ve sIIeUUOISIAIP UONROT|Qnd ajsapour sun ,p 
juessed ‘onasy v] ap UONNIOAY, | Ip s[qUIDSUa Pp ONA aJUdT[IOxO uN dJUasald & ‘/ 96] UD .nbsnf onAdy eI ap 
deg B] B dINSUWAp jso Inb “Inayepuo]j Juaprsoid ‘yayelg preyory ‘[elogds oguinu 30 B UOTONPONUI,p asin3 
uq ‘ajanbua,p sanbiuyoa ap aitesiaatuur ,¢z ne Jodionied & sa}taut syuvoduit suatonsnels sureyi99 ap 
SOP SOP JUIULIOJUDI ONADY L] 9p UDA & QOOT UN! op OJOUINU 9] 19 666] IQUID.EP Op OI9UINU 9D 


O1IWUNU 9D SUBC 


epeuey enbijsiejs 
Zzb-bok ‘dd ‘ZU ‘SZ JOA 
Lob 666} e1quadep ‘ajenbus,p sanbiuyoe | 


© VR ee 


qe bd » eed OF 9p - ey. yj dares 
Mya jo 
; iyi ‘inst 1 Ph Pore yy) a) ent? 9 


ee 
a wi Tek ae ae wre 

vee 7: meet 

i i ia ve taaihy ow nding aie 
ev. - ah : a : 

jalla. i ged (3 ME SE DAY Aah! Saati 

ae Seon ¢ iy VRgVee om ¢ wy re) 

ow iy | et eae y vate 7 WM “ 

HDs. A tAD44 ») 


i» at va ‘) , j 
irene 
so ratsellidas anela 12 WR) tad ‘ ou ' (! 
AL 
’ 7 ; 1} wipe SD ii io : 7) a re - as 68 iy Ul i ‘ra § , ua fw @ thé "nn moo ‘ " 
lait (Mart i ouh oferes | MVP OU Je Lahwer + fol i ie ae deseoas Dieta oes 


sae 


tebe AL) Ald as ’ le ca Les Vi CH oe POPU AL ‘ i 1 | iy, vif) rv ’ “ots 
BEN AW. ae Fe AX GATINT paren) 2h) 4 Lwin @ » 
tte y 


46 , i wivea , '¢ ft 
, y ( ¥ j = 


el ise pron ' hou siento uit ; he oa, f é i” Sa) 
Wilson as “es { pie Salametcal oo © { i , 


| “i AcaaH Hie ora Hebei is . Ao | mn 
7 n } iy kag , . 


sat i rl ) vi 
mie thie if ae i, 02 4) a eR Svsihid bl Oat alle | 
Te | | 
- , > rd) ' a] 1 i ae 
aN 
ET Raanrnin tie Sol/Wk-g.pi untbiou =< +0s ado 
4 : ; Toye? VA ecm ri wage Gi mie OMe Ge) CAT ily) Hi eH ea 70 


ve BE aa ai RS | ge | | wy 


nie Omir, biG wenn HW LAs OA RM Ure [une in PAY IE ees We laa 
an Keven ; 4 “0.4 


S,, : , an wv) Ab fa : A | 
es nt a oe ee Rs a is RS wey fs 
| 7 POO ia PU Ettore te 
a5 © Werte: ad j ‘ys td il 


0 LN 4 eQcnes apres ih wiracy oo ery t 
pheno Leena 3 hae 7 . | 


TM ideaieh ow inh ie iti » 4 7 ye MPS CG. ey Po . ‘ ' i} (4 
rf pane 7 } fs) ‘5 y* ‘ , ¥/ 


see TaD) Tr De ¢ 


reine ie hte bi Ada ite valle a uetace r rT 
eas PR ae ile | 
a oN et ae rh 


meierbiciee ~ py begberen ar qs } cain, FPO" iat | ne is 
. eT in & hii.) 


bedrine a gains a prong | ep yy 


ep Bey «4 


‘ 
vis | 
Mead i, Pain oe . | i: phen: 


2 ATM DER ot) Le o NORA 1S I B2ttto 
i ee ie ee | , 7 be paure “wa pb Apu 


‘5 GLESA | Pay stm Sill Soe ae ns neem ven I 
eer nel aie. ‘eat MHD GG) PV LOOe jap is a senken gp Paicg 


at bectiite 1 ih bn. pas 4 Cuunye 
¢ w be! La 


(Bie ae 
2 ee | 


Be eran kr ate oe aabentCue mena onteaiy ciciead. 6 o.dnlnen th nna aruce weenie cn cleo oot le Re co opti nit Bole cided, S wore S]USUISTOIOUIOY 


* g8epuos ap uvyd 9] Ins saapuoj sourewop Jed suoneuinsa so] Inod sonelixne suOMeULIOJUI Sap & SINODII IT 
TIVONUYS 4-019 OVAELSA WA 


ne ca Sa[eSOUT SaITTIGeqold JdAv IBeUUOTNULYY,| IP svd a] SuBp oNbNaUIsa aseRIeO IT 
dam Ma 


a8. ‘al is) ip :0)oy 6 -8t.a heise ca! 'e) ©) ce) s/Ks ln] coh (oe tis) elie) falls) (s\iiaMielion \eulp: (elle Mellie iis: <slri iene en 4) (0) 6) \s) (eae) ohne cs eure Me) oltaluemte SnpIsal sop sonbruyso} 1) uOoneslIesul] 
‘SdXd[dUIOD sINa}eUIl}sa sap 39 sonbysneis sop inod souvleA op uONeUINS| 


ATA Of 


Eidey sj oie) shes spiel Berkores: 1edie Notiohce, solWelue at fofifoNrerotgaMatiet vals MallsdreMaielbe es tsiieiie eliotn: lel leilel iefisiteris) hehe (a) venelsla neuen « uosdwou J -ZWAJOH op IndyeUINsS? | 
: SOSVUDU 9p JNeIUasSaId91 UOT[NULYSE UN INS sddPUO] S}UDWaSsI[qe}a Sap sgidne sajgnbuyq 
NZUNTHS 119 NAS W 


Pe RE Res igs Ba ares J[QPOUL UN ANS d9pUOJ d[LUOIZ9I UONLUINS ,[ JULUIDOUOD $}UIDEI Sais0I1d sanbjangd 
OVa ANT 


a ial 2 RNa Bi aa ag SR SS OS ISLUUOT[NULYIE UD DOULIJUOD ap Sa][VAIOIUI Sa] Ins pIesoI NeIANON 
NOSdWOHL “AW 39 AGINVGOD ‘dA 


RP EE Ser Aah RO a, Wie en rd ene A RNa LO JusuIasuddeI 19 STHENSTUTLUpR sIdISsOg 
NAanNdHOs “4 


aiid edamame epee verte orca OMe h SHOR OMCIGP MISTER Ge eee eR nee anbnsneis op neoing uN suep saguUOp sop ayyenb e] op uonsas eT 
HNOLSAOVAUA ‘O 


sia va alliat-ta tepals “elle elie! eel a avenel alee) oitshiensile} (eke) huetelel a) isi /stfetieikeMeite\ke) (okerla sonbrydeisowap sajgnbua .p UOSIeUIQUIOD P| no nuns on 
HSE “I 


ALontgieen od o.oo oan Ome ao ow cso eh Baio ooo eh 6 OSD 0 MUSAB | 9p uonviedgid eI sanbusneis SOOIAIOS SI] 
JOA Tiss di 


Amagtteg oO d RIOTS CHO OMe In OO OO OC o a COO OO Oo U MeO noone Bao ai10}sTy ,p sue CZ — aignbua .p sonbruysay, 
MALV Td a 


Be Oe te eee ME Pe rE enero ate eee AAC eee ec cert Ol na Puree opored UE e Ge ob s orpuinu 99 sueq 
SHYGILVIN SAd ATAV EL 


666[ FIQuIsd9ep “7 OI9UINU “CZ JUINJOA, 


epeury onbrsiyeis red s9iIpe onAas ou-) 


ALANONGA.d SANOINHOAL 


‘epeuryd np anbysneig aa1d0¢ P| 19 Yoseasay UoIUIdG oI[qng JOJ UONLIDOSsY UvoLOUWY ,| ‘alanbuq,p susionsyeis op 
a[PUONLUIO]UT UOTILIOOSSY ,[ ‘UONRIDOSSY [BONSNIS ULSLIOULY ,| OP SIIQUIOT XNV LIDJJO 1S9 WNpar xd uA “vd"ULdIL}S ® JOP 
: JoUIaIUT Jed NO HE/6-688 OOS I NV NO HRC T-166 (E19) Ne natdoosgiai red ‘EEOT-OOL OOS I NE NO LLZL-1$6 (E19) Ne auoydyya} 
Jed ZapueUIWIOS NO OLO VIX epeurd ‘(o1ejUC) EMLNG ‘aepyieg snudar ‘QZ] ‘UONR[NIID LP] ap UONSayH ‘uONPIZaIUL,| Op 19 
suonvigdo sap UOIsIAI ‘epeurd onbysneis v jUaUIOUUOgR .p IpuLLIDP O.NOA ITUDATed av] OP IIVUg ‘epeuLg Np ANIII9}xI,| & 
aguur Jed Sx $ Lp op 19 epeurg ne aguur ed ¢ /p ap jsa (ANSoOTLIVO Ne GqX-100-ZI oU) aenbua,p sanbiuysay ap xud a7 


yuswauUu0gYy 


"Inaynv | & SaUINOJdI sed JUOIAS dU SaIIL[dUIaXa Sa_ “‘aNAdI LI SULP SadjUasaid SsaATIDaIIP soy UOTas saTydesZO] 
-Ayoep soneduraxe anenb 19A0Aud,p dg ‘OLO VIM epeurg ‘(o1eiuQ) emeng ‘oimsvg s,Aouuny, ‘epeued oanbnsneis 
‘S9SVUDUL SAP Sa}9NbUD Pp SAPOYIJOU! SAP UOISIATG “YSUIS ‘q'JI ‘JA ‘Joyo ud Inaoepa. ne stedSuvJj Ud NO sivjsuv Ud dSIPI 91X9} 
9] tusared aie} & SPIAUI JUOS a[OTIe UN oVTeIed ale] JUvIISaP SINa\Nv Saq ‘uv | SIO} xNap adt[qnd sa ajgnbua_.p sanbruysa yp, 


INAdJ Ly ANOd sa}xa} ap UOTVeUISIIg 


‘epeurg onbnsneis op lu UONOepsl ap 9}IWO9 
NP Sa]]9d JUOWIdITeSsad9U Sed JUOS dU ONADI BP] SULP SASTUID sUOIUTdO Sa] 19 9}X9} IND] AP NUd}UOD Np say;qusuodsal JUdINIWIAp 
SINdINV Sd] Ste ‘anbNLWO auUN v STUINOS JUOIIS Safe S3] SNOT, ‘Sa[[9a1 S9guUOp sap ev soanbijdde no saguuop ap 9}99][09 P| 
Inod sagstjNn 939 JO INnb sapoyjaul op UONEeNyRAY, | & 9 UONLIOGE]I, | & opsJOOOR jS9 JIT|NOTVIed souryOduil sup] ‘sastpesouss 
sowiaysks ap juduraddoyjaaap 3] 19 S2gUUOP ap asATeuUr ,p 19 UONLUINSA Pp sapoyaU Soy ‘sonbryysNeis s2guUOP Op UONLISOIUL | 
‘sonbrydeisowlap sapmia soy ‘uonestjeuuosiesap Pv] ‘SanbisojouoIYo satias sap asAjeur ,| ‘aJgnbus .p sapoyaul Sa] INs DyoI1IYyooI 
RI ‘sajgnbua sap uonen[ead,| ‘sajgnbus say suep SINdIIa Sa] ‘da}da[[OD dP SA9POYIOU AIP Jd SADUUOP OP SIdINOS Sd}UdIIJJIP 
ap uonesi[yn | ‘anbyeid ipso .p sayulenuos ap jur;nosep uondasuos ap sawaqold say ‘ajduiaxa sed ‘awuo0s anbrysneis 
duisIuesIO UN JUdssaig}UI Inb sanbysne}is sapoyjau sap s}oadse sIDAIp Sa] Ans sponse sap aijqnd ajygnbua.p sanbiuysay, 


NOILLOVGaa Ad ANOLLITOd 


ppouvy anbiysivs ‘jayMs ‘q 32 a[tAquuand ‘“g ‘Jaury “H AI ‘d syutofpe sinajoepay 


AJISAIAIU() PADAAD HY ‘KYSAR|SCZ, “VW 

dajuay Yyodvasay uoiuidg: JOUONDN ‘I[OM ‘WS 
‘DUI ‘JDISAM “BIIQSYC AA ‘f 

snsuay ay] fo nvaing ‘Sf: ‘Ue ‘fd 

xassq fo Qissaaluy) “euLlaA “SA 

‘DUI ‘JDISAA “\ULIT[PA “AY 

uojdupynos Jo A1saaaiuy) ‘IOUUTYS “['D 
AJISAIAIU] AISDAY UOUNS “IIS “YY 

AJISAIAIU[] AALASAY UABISAM, ASDD “ASULIPIS “f£ 
IINJNSU] UDGA) AY J ‘UBINIYIS “f° 

VS) Yodvasay SUOIDIIUNUUO, [Jag ‘IPULS "T 
[DADT P1ISAIAIU) “SOALY “d-"T 

AJISAIAIU(] UOJAJADD ‘OLY “Y'N'f 

AJISABAIU) MagaH ‘UURULIOIJIJg “q 


ysuls ‘d'W 
Aoy 'd 
(quopisoid ustouy) Yared “Y 


JaDAs] ‘sosynjg fo nvaing [DAJuaD ‘UeYIeN *D 
SISIDIS {O NDaANG UDI]DAISNY ‘d1OeUTT “S 
ujooury-vyspigan fo Ayissaauy “WYye’T] ‘d 

ppouny anbysynys ‘ayjadeyor’y] “y 

‘QUT ‘IwIsan “UOIey “HD 

YN ‘221ffO [orusuvig jV4UaD YOH “dd 
ppoun, anbysiynig ‘no[solply “WW 
punjtunpy fo {isdaaluy) ‘S9AOID “WY 
AJISAIAIU() AJDIS DMO] ‘IJIN WA 
AIssaaluf) APY Svxa ‘ssunl{q ‘f 
ppouv, anbisuvig ‘M21q ‘df 

AASNI ‘ASC “O-'f 

ppouvZ anbisyvj¢ ‘Iapulg ‘qd 

OUDIUGC Usajsay JO KJISsaalus) ‘asnouT[og wWd 


SILDOSSE SINIJIVPIY 


ppouny anbisyvis ‘ysuls ‘dW JY Ud ANIUEpIy 


NOILOVdae dd ALTINOOD 
yomed “OD 
(uononpolg &] op Ina}901Iq) epAry “4 
SIOH OTD 

Jopulg ‘q SIIQUII]A 

suoj\syovlg (DH yuapIsoig 

NOILOAYIG Ad ALINOD 


“Spoyrep 2ANLITENY Ul sJUdJUOD [euINos 19 ‘sonsNeIS 


0} XOpuU] JUSLIND sup sadUdIJ9I Sa] I9ANON Ud Jnod UG. ‘AjISIOAIUL-) SNUSeIg ‘ASO[OPOYIJoJ YOIeasay [eI90g Jo asequieqd 
WUS 19 sloRNsgy spouey pue AJOsY, [eonsneig ‘uvronsneig Adaing ay, suep d9tIojJ9d91 Jso aIgnbua,p sanbruysap, 


epeurs onbiysije1¢ Jed 99}Ips onAdl ous) 


ALANONA.G SANOINHOAL 


epeur) ee Do 


a | 


emeno 
Sv00-v1Z0 NSSI 
Ql|QlLJSOWAS :a}dIPOLad 
enbojeyeo ne GdX-L00-Zl oN 
000¢ J9HA94 


‘910 WLM Bpeued ‘ouejUO ‘emeNO ‘epeued enbijsiejs 
‘HuleyJeW NP UOISIAIG ‘8DUGOd!| Bp S}IoIp sep 
UOISS8DUOD Bp SEdIAIES Sap sjqejeeid ey09 UO!}ESOjNe,| Sues 
‘juawaJAnooes ap awaysAs uN suep JoulsebewWwa,| ap no ‘aJjne no 
‘anbiudeibojoud ‘anbiueoaw ‘anbiuoijoeje@ Uuolonpoideas ‘anbneubew 

yoddns ins jueweujsibeiue ‘os 90 anb uaAow anbyjanb sed 

no awWso} anbjenb snos ‘uoneayjgqnd ajuaseid e) ap nuajuod 9| 
SAJJOWSUBI} BP NO auiNposdss Ap Wpseajul Sa |] “SaAJeS9s SOUP SNOL 


0002 “SHISNPU],| OP BASIUIW © 


epeueg enbijsiels ep ejqesuodsel 
adjsiulw 9] sed eesisoyne uolyealgnd 


Cc OHFWAN © SGCUWNIOA © 6661 FHEWYOId 


VAVNVO GNOILSILVLS UVd 
qgLida 
anaAgy GNn 


ALINONA,G 
SAUNDINHDAL 


4 


ZL oN 


100 


FRI 
x 
asc 
c 
oO 
a 
a 
= 
0. 


iil 


Hitt 


ma f i} if ‘ 

ver: 
Wi a 
i 


ea w 
ay 


| my 
ans i i 


Heed 


Puig: 
h 


ss +p alee B 
oe 


: ‘c 
Lr Uk 
Baie 


; 1 1s 
wiee » 
mi eee mn 
t U f \ 
{ La i 
nq 
ri a \ 
1 ne My 
res ; oe } 
el ‘ 
wale s] 
My Ap na 
f) ; i 
7 A, 
i" . ; ii 
; by 
i eh ; 
HY, AZ 5 
’ ha ‘ 
ip ’ ; ¥, e 
vy ' ak = 
' 
m Hoya, 
i j 
ia 
+ tye tee 
re oy 
omit Hm 
ied 
ii i i 
Pav } 
i 
f 
' 
j 
Te 
»©@ 
‘ 
4 
i 
P 4 
5 1 
L 
gry 
if 
al 
iat i 
: 
j 
: ow 
ti & 
1 
5 
i 
' a A 
bid j 
ie . a 
un) ¥ nin wv 


Ay ty 
OT 
Lyrae 


pens ch 


Po lod 


Wy 
4 
i 
T 
A 
rn 
j 
uM j 
¥ 
« 
{ 
! 
« 
, 
LAL. 
‘ 
‘ 
j 
t 
Va 
! 
4 
( 
i 
t 
Niel 
ly 


U 
We qt 
ee wee hurt? tis Verba 


Gibran 
Pui nk Wibe Aree ace ER 
oat 


prensa) 
a 


N yo epas 
NSE eh 1 
NeW Ione 


of 


ber Henn 
Chet 


See 


Nii Le 
UOUPORCEA DL 
K t 


Ri 
Hees 
sitcdeaet 


yey 
ae 


